-- Logs begin at Fri 2022-06-17 06:37:02 UTC, end at Fri 2022-06-17 08:02:01 UTC. -- Jun 17 07:14:21.202011 dv-cinder-797333-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 17 07:14:21.210771 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 17 07:14:21.212771 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 07:14:21 2022] *** Jun 17 07:14:21.212771 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 07:14:21.212771 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 07:14:21.212771 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: nodename: dv-cinder-797333-4-iscsi Jun 17 07:14:21.212771 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: machine: x86_64 Jun 17 07:14:21.212771 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: clock source: unix Jun 17 07:14:21.212771 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: pcre jit disabled Jun 17 07:14:21.212771 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: detected number of CPU cores: 4 Jun 17 07:14:21.212771 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: current working directory: / Jun 17 07:14:21.212771 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: detected binary path: /usr/bin/uwsgi-core Jun 17 07:14:21.212771 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: your processes number limit is 47680 Jun 17 07:14:21.213520 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: your memory page size is 4096 bytes Jun 17 07:14:21.213520 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: detected max file descriptor number: 2048 Jun 17 07:14:21.213520 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: lock engine: pthread robust mutexes Jun 17 07:14:21.213520 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: thunder lock: enabled Jun 17 07:14:21.213520 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 17 07:14:21.213520 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 07:14:21.257316 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: Python main interpreter initialized at 0x556a022da9c0 Jun 17 07:14:21.257316 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: python threads support enabled Jun 17 07:14:21.257316 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: your server socket listen backlog is limited to 100 connections Jun 17 07:14:21.257316 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: your mercy for graceful operations on workers is 90 seconds Jun 17 07:14:21.257698 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 07:14:21.257773 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: *** Operational MODE: preforking *** Jun 17 07:14:21.258039 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: *** uWSGI is running in multiple interpreter mode *** Jun 17 07:14:21.258039 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: spawned uWSGI master process (pid: 80226) Jun 17 07:14:21.258243 dv-cinder-797333-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 17 07:14:21.260063 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: spawned uWSGI worker 1 (pid: 80239, cores: 1) Jun 17 07:14:21.260063 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: spawned uWSGI worker 2 (pid: 80240, cores: 1) Jun 17 07:14:21.260063 dv-cinder-797333-4-iscsi devstack@keystone.service[80226]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 07:14:26.772761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:14:26.772761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: from cryptography.utils import int_from_bytes Jun 17 07:14:26.773560 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:14:26.773560 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: from cryptography.utils import int_from_bytes Jun 17 07:14:26.773714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:14:26.773714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: from cryptography.utils import int_from_bytes Jun 17 07:14:26.774221 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:14:26.774221 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: from cryptography.utils import int_from_bytes Jun 17 07:14:26.823322 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 07:14:26.823498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 07:14:26.823586 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 07:14:26.823675 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 07:14:26.823753 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] command line args: [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 07:14:26.823831 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] command line args: [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 07:14:26.823970 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 07:14:26.824054 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 07:14:26.824153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ================================================================================ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 07:14:26.824238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ================================================================================ {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 07:14:26.824407 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] admin_token = **** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.824495 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] admin_token = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.824654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config_dir = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.824731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] config_dir = [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.824837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.824920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.825016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config_source = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.825104 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] config_source = [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.825180 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] debug = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.825255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] debug = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.825397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.825649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.825745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.825811 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.825955 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.826038 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.826169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.826255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.826416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.826499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.826649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.826733 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] list_limit = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.826834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_config_append = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.826943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] log_config_append = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.827044 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.827150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.827250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_dir = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.827350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] log_dir = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.827450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.827558 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] log_file = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.827668 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.827746 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.827861 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.827941 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.828034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.828118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.828281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.828360 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.828477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.828595 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.828718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.828834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.828953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.829072 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.829191 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.829304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.829454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.829573 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.830181 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.830302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.830421 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.830533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.830692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.830815 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.830938 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.831058 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.831177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.831293 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.831442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.831567 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.831929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.832039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.832202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] publish_errors = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.832322 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] publish_errors = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.832435 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.832553 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.832666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.832777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.832888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.832999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.833110 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.833241 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.833389 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.833506 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.833618 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] standard_threads = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.833736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] standard_threads = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.833857 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.833976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.834090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.834208 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.834327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.834440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.834563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] use_journal = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.834682 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_journal = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.834796 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] use_json = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.834907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_json = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.835019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] use_stderr = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.835138 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_stderr = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.835322 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] use_syslog = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.835469 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_syslog = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.835584 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.835702 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:14:26.835816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.835927 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.836048 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.836162 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.836280 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.836398 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.836516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.836629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.836740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.836853 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.836964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.837075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.837187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.837305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.837451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.837565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.837677 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.837788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.837904 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.838009 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.838129 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.838241 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.838359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.838472 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.838583 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.838695 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.838822 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.838945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.839059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.839170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.839282 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.839407 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.839521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.839633 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.839745 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.839857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.839974 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.840098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.840212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.840323 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.840437 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.840548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.840661 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.840843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.840957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.841069 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.841180 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.841297 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.841436 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.841559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.841673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.841784 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.841896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.842014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.842127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.842247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.842360 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.842479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.842593 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.842710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.842829 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.842953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.843066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.843178 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.843290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.843407 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.843520 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.843640 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.843753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.843865 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.843976 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.844088 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.844199 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.844303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.844398 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.844497 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.844598 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.844727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.844832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.844936 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.845032 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.845126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.845225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.845990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.846115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.846243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.846359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.846472 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.846585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.846700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.846822 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.846945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.847060 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.847181 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.847302 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.847422 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.847536 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.847649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.847774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.847880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.847996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.848110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.848220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.848333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.848454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.848558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.848669 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.848783 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.848907 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.849022 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.849143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.849258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.849396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.849519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.849634 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.849748 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.849869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.849983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.850087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.850199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.850312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.850433 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.850554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.850668 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.850781 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.850903 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.851029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.851143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.851264 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.851384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.851504 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.851624 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.851738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.851851 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.851977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.852091 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.852204 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.852317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.852430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.852542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.852728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.852844 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.852964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.853078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.853197 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.853362 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.853495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.853611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.853724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.853843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.853957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.854070 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.854196 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.854323 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.854443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.854557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.854676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.854789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.854903 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.855023 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.855139 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.855252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.855365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.855478 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.855591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.855712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.855827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.855939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.856052 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.856172 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.856293 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.856415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.856536 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.856655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.856775 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.856895 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.857009 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.857130 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.857246 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.857371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.857496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.857612 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.857724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.857845 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.857960 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.858078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.858192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.858306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.858418 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.858539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.858654 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.858767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.858880 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.858993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.859105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.859227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.859342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.859460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.859595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.859709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.859822 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.859946 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.860061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.860174 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.860288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.860401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.860524 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.860647 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.860767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] auth.external = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.860881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.external = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.861048 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.861229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.861402 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.861560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.861690 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.861814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.861929 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] auth.password = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.862043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.password = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.862157 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] auth.token = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.862271 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.token = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.862386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.862386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.862609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.862609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.862925 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.863045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.863159 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.863282 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.863397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.863512 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.863626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.863748 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.863863 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.863984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.864107 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] credential.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.864223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.864336 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.864450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.864565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.864687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.864803 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.864916 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.865036 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.865150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.865264 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.865411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.865530 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.865644 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.865758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.865872 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.865993 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.866109 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.866222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.866337 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.866459 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.866574 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.866761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.866879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.866993 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.867113 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.867236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.867236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.867460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.867460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.867675 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.867675 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] federation.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.867888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.868004 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.868126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.868247 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.868362 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.868476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.868597 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.868733 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.868857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.868972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.869086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.869199 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.869312 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.869474 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.869600 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.869717 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.869830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.869944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.870057 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.870171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.870292 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.870408 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.870521 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.870635 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.870754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.870870 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.870992 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.871107 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.871221 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.871334 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.871448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.871561 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.871683 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.871799 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.871913 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.872026 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.872139 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.872252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.872374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.872489 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.872603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.872722 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.872837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.872951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.873073 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.873188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.873308 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.873443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.873557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.873670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.873799 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.873917 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.874030 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.874144 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.874257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.874370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.874493 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.874608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.874721 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.874835 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.874948 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.875070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.875185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.875305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.875419 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.875532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.875645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.875766 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.875882 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.875995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.876110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.876223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.876337 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.876458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.876574 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.876724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.876916 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.877111 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.877259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.877430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.877550 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.877664 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.877778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.877891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.878009 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.878132 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.878247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.878361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.878474 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.878588 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.878701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.878823 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.878944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.879065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.879181 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.879295 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.879409 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.879531 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.879646 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.879759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.879873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.879986 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.880100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.880223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.880223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.880439 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.880439 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.880652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.880765 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.880887 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.880887 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.881101 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.881215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.881349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.881489 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.881622 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.881739 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.881854 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.881968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.882082 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.882195 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.882318 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.882423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.882541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.882656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.882770 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.882884 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.883007 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.883121 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.883235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.883349 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.883463 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.883590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.883714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.883829 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.883943 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.884056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.884224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.884341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.884465 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.884580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.884694 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.884847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.884964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.885077 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.885200 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.885315 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.885529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.885644 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.885757 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.885871 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.885997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.886113 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.886226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.886340 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.886454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.886569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.886691 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.886806 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.886920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.887039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.887154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.887267 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.887389 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.887504 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.887619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.887732 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.887846 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.887963 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.888085 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.888201 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.888315 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.888428 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.888541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.888656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.888778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.888892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.889006 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.889119 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.889233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.889439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.889559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.889673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.889787 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.889900 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.890014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.890135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.890250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.890364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.890477 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.890591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.890705 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.890826 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.890942 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.891056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.891169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.891282 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.891395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.891518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] resource.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.891633 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.891994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.892110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.892756 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.892944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.893123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.893245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.893401 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.893518 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.893632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.893746 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.893874 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.893990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.894103 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.894217 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.894330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.894444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.894565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.894680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.894794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] role.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.894909 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.895023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] role.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.895136 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.895258 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.895373 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.895487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.895601 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.895715 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.895829 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.895952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.896067 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.896181 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.896181 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.896396 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.896510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.896631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.896747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.896860 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.896975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.897089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.897203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.897338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.897455 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.897580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.897695 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.897809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.897926 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.898051 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.898166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.898280 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.898280 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.898492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.898606 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.898728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.898843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.898957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.898957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.899171 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.899292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.899407 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.899521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.899634 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.899748 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.899861 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.899983 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.900098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.900213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.900327 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.900442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.900555 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.900677 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.900792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.900906 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.901020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.901135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.901249 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.901414 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.901533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.901647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.901767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.901882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.901995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.902117 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.902233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.902347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.902460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.902573 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.902687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.902808 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] token.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.902923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.903036 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.903149 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.903263 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.903377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.903503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.903619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.903733 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.903847 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.903960 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.904073 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.904195 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.904309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.904424 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.904537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.904651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.904764 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.904886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.905000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.905114 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.905227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.905364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.905483 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.905605 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.905719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.905833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.905946 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.906059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.906172 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.906294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.906409 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.906523 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.906637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.906750 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.906864 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.906986 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.connection = **** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.907109 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.907232 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.907347 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.907461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.907575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.907688 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.908379 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.908514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.908514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.908745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.908879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.908993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.909107 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.909298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.909458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.909575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.909689 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.909803 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.909916 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.910042 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.910158 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.910273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.910387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.910501 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.910615 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.910738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.910853 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.910967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.911087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.911202 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.911316 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.911438 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.911553 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.911668 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.911783 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.911897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.912011 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 07:14:26.912134 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.912134 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.912134 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.912134 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:14:26.912134 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 07:14:27.036628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.036811 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.036998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.037369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.037593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.037816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.045234 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.046479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.074054 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.074280 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.075267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.075498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.127326 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.127482 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.176073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.176303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.176499 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.176734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.241904 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.242056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.242132 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.242238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.242426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.242524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.242605 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.242681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.242755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.242876 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.242961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.243091 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.266164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.266368 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.266470 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.266603 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.267078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.267209 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.267809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.267809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.268066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.268205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.268343 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.268527 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.268605 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.268690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.279203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.279466 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.292010 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.292245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.292363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.292448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.292574 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.292660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.292801 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.292885 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.293017 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.293101 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.293229 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.293312 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.293467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.293680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:14:27.310426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.310635 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 07:14:27.310860 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.310969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.311087 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 07:14:27.311168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 07:14:27.311385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.311468 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.311587 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 07:14:27.311668 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.311855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.311938 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.312113 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.312193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.312364 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.312614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.323411 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.323682 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.323944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.324219 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.324300 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.324530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.324791 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.325066 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.332971 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.333873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.336252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.336528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.336803 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.337079 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.337161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.337373 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.337463 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.337630 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.337772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.337891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.337971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.338157 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.338240 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.338419 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.338501 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.338684 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.338773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.338942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.339023 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.339204 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.339471 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.339733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.365274 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.366249 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.366896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.367171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.368323 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.368598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.372377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.372764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.373047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.373863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.374258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.374536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.380982 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.381259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.382347 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.382628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.385736 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.386013 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.386286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.386560 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.386825 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.387091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.387175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.387352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.387435 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.387612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.387704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.387901 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.388173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.388447 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.388716 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.388982 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.407227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.407500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.408960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.409232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.412182 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.413801 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.415881 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.416276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.417691 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.418094 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.421244 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.423257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.425097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.426935 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.428730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.429023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.429299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.429613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.429884 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.430166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.430598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.430893 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.431172 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.431451 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.431726 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.432003 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.449833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.450108 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.450368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.450625 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.451519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.451802 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.452066 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.452326 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.459133 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.460839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.460921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.461110 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.462655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.462938 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.465526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.465801 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.466073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.466364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.466643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.467386 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.467665 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.467944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.468241 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.468518 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.480536 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.480809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.481091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.481386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.481756 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.482028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.482296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.482379 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.482585 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.482863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.483140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.483513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.483786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.484062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.500711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.502587 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.504035 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.505856 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.507316 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.509030 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.509165 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.510698 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.510905 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.510987 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.511244 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.512557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.512836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.513122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.518812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.520427 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.520761 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.522416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.523665 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.523950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.524335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.524607 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.525666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.525955 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.526345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.526622 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.534484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.534771 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.535043 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.536468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.536752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.537028 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.543073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.543299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.543574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.543845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.544112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.544499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.544776 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.544921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:14:27.545048 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.545199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.545340 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.545498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.545593 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.545771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.545854 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.546038 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.546122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.546361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.546443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.546629 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.546712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.546969 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.547244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.547513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.547781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.548051 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.548314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.549265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:14:27.585348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556a022da9c0 pid: 80239 (default app) Jun 17 07:14:27.587213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556a022da9c0 pid: 80240 (default app) Jun 17 07:14:27.588708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fc6ef-cf79-4dd0-ab04-b8304b73d0ac None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:27.589006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fc6ef-cf79-4dd0-ab04-b8304b73d0ac None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:27.589284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fc6ef-cf79-4dd0-ab04-b8304b73d0ac None None] PATH_INFO: `/v3` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:27.593478 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Fri Jun 17 07:14:27 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:36.316203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b65ac7-49e4-45f8-952a-c74b7ae82dc6 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:36.316783 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b65ac7-49e4-45f8-952a-c74b7ae82dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:36.316783 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b65ac7-49e4-45f8-952a-c74b7ae82dc6 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:36.321099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:14:36.326438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2cf72-9b6a-4c71-8aae-20697ed9b891 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:36.326883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2cf72-9b6a-4c71-8aae-20697ed9b891 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:36.327000 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2cf72-9b6a-4c71-8aae-20697ed9b891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:36.397906 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: INFO dbcounter [None req-f1f2cf72-9b6a-4c71-8aae-20697ed9b891 None None] Registered counter for database keystone Jun 17 07:14:36.419190 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f2cf72-9b6a-4c71-8aae-20697ed9b891 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:14:36.425949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writer thread running {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:14:36.604429 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG passlib.handlers.bcrypt [None req-f1f2cf72-9b6a-4c71-8aae-20697ed9b891 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80239) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 17 07:14:36.604856 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG passlib.handlers.bcrypt [None req-f1f2cf72-9b6a-4c71-8aae-20697ed9b891 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80239) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 17 07:14:36.659822 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f1f2cf72-9b6a-4c71-8aae-20697ed9b891 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:36.661469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f1f2cf72-9b6a-4c71-8aae-20697ed9b891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:36.786313 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 17 07:14:36.937079 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b65ac7-49e4-45f8-952a-c74b7ae82dc6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:37.008919 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: INFO dbcounter [None req-76b65ac7-49e4-45f8-952a-c74b7ae82dc6 None None] Registered counter for database keystone Jun 17 07:14:37.027855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG oslo_db.sqlalchemy.engines [None req-76b65ac7-49e4-45f8-952a-c74b7ae82dc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:14:37.034647 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writer thread running {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:14:37.154380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b65ac7-49e4-45f8-952a-c74b7ae82dc6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:37.159259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780b150-ffa9-480c-9703-05406a8612c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:37.159923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780b150-ffa9-480c-9703-05406a8612c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:37.160206 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780b150-ffa9-480c-9703-05406a8612c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:37.160484 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780b150-ffa9-480c-9703-05406a8612c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:37.168770 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780b150-ffa9-480c-9703-05406a8612c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:37.221428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0780b150-ffa9-480c-9703-05406a8612c9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 17 07:14:37.221713 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780b150-ffa9-480c-9703-05406a8612c9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:37.231268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1324 bytes} [Fri Jun 17 07:14:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:14:37.238038 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2cf72-9b6a-4c71-8aae-20697ed9b891 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:37.255245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2cf72-9b6a-4c71-8aae-20697ed9b891 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:37.259659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846dbd6c-6b0d-449e-bcba-63969f70c401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:37.260777 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dbd6c-6b0d-449e-bcba-63969f70c401 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:37.261069 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dbd6c-6b0d-449e-bcba-63969f70c401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:37.261370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dbd6c-6b0d-449e-bcba-63969f70c401 admin admin] PATH_INFO: `/v3/projects/be5f0ec6059e4393ac953e1a8c865e6d` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:37.262882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846dbd6c-6b0d-449e-bcba-63969f70c401 admin admin] RBAC: Authorizing `identity:get_project(project_id=be5f0ec6059e4393ac953e1a8c865e6d)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:37.314975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: WARNING keystone.common.rbac_enforcer.enforcer [None req-846dbd6c-6b0d-449e-bcba-63969f70c401 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 17 07:14:37.315326 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846dbd6c-6b0d-449e-bcba-63969f70c401 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:37.319938 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 3/5] 10.222.0.52 () {56 vars in 1207 bytes} [Fri Jun 17 07:14:37 2022] GET /identity/v3/projects/be5f0ec6059e4393ac953e1a8c865e6d => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:39.443638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd6392-cd1c-44b5-9362-3a9ae36b749a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:39.444155 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd6392-cd1c-44b5-9362-3a9ae36b749a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:39.444261 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd6392-cd1c-44b5-9362-3a9ae36b749a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:39.448365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 3/6] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:39.453687 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21be8a-10fc-480c-968f-c27b18e47261 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:39.454125 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21be8a-10fc-480c-968f-c27b18e47261 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:39.454242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21be8a-10fc-480c-968f-c27b18e47261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:39.473070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-eb21be8a-10fc-480c-968f-c27b18e47261 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:39.474642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-eb21be8a-10fc-480c-968f-c27b18e47261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:39.482600 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 17 07:14:39.505820 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd6392-cd1c-44b5-9362-3a9ae36b749a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:39.518101 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd6392-cd1c-44b5-9362-3a9ae36b749a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:39.522264 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6553c-68af-48c4-9b8b-a6c31f396fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:39.522953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6553c-68af-48c4-9b8b-a6c31f396fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:39.523237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6553c-68af-48c4-9b8b-a6c31f396fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:39.523561 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6553c-68af-48c4-9b8b-a6c31f396fd0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:39.531316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6553c-68af-48c4-9b8b-a6c31f396fd0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:39.533758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6553c-68af-48c4-9b8b-a6c31f396fd0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:39.542528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1324 bytes} [Fri Jun 17 07:14:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:14:39.547887 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21be8a-10fc-480c-968f-c27b18e47261 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:39.557913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21be8a-10fc-480c-968f-c27b18e47261 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:39.562241 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422acd0-1642-4b91-84da-42eb57b67a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:39.563114 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422acd0-1642-4b91-84da-42eb57b67a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:39.563422 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422acd0-1642-4b91-84da-42eb57b67a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:39.563734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422acd0-1642-4b91-84da-42eb57b67a98 admin admin] PATH_INFO: `/v3/users/5c26ce8b01664633a37c5e3b13519935` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:39.565213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422acd0-1642-4b91-84da-42eb57b67a98 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c26ce8b01664633a37c5e3b13519935)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:39.567091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422acd0-1642-4b91-84da-42eb57b67a98 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:39.568642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 5/9] 10.222.0.52 () {56 vars in 1198 bytes} [Fri Jun 17 07:14:39 2022] GET /identity/v3/users/5c26ce8b01664633a37c5e3b13519935 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:41.754543 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50891e80-c180-4b1a-a230-9dc0c166662d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:41.755065 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50891e80-c180-4b1a-a230-9dc0c166662d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:41.755157 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50891e80-c180-4b1a-a230-9dc0c166662d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:41.756437 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:41.761667 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f5ac-f375-4bbf-a91a-ad24828cee17 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:41.762085 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f5ac-f375-4bbf-a91a-ad24828cee17 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:41.762229 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f5ac-f375-4bbf-a91a-ad24828cee17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:41.762457 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89948f4-fc12-41e9-9f5d-e1177e4ac188 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:41.762750 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89948f4-fc12-41e9-9f5d-e1177e4ac188 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:41.763031 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89948f4-fc12-41e9-9f5d-e1177e4ac188 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:41.764279 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 6/11] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:14:41.770247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c512d30-13d7-43c6-a3ec-8398d01c19e4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:41.770536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c512d30-13d7-43c6-a3ec-8398d01c19e4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:41.770816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c512d30-13d7-43c6-a3ec-8398d01c19e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:41.779552 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-21f6f5ac-f375-4bbf-a91a-ad24828cee17 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:41.780719 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-21f6f5ac-f375-4bbf-a91a-ad24828cee17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:41.809768 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG passlib.handlers.bcrypt [None req-4c512d30-13d7-43c6-a3ec-8398d01c19e4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80240) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 17 07:14:41.810194 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG passlib.handlers.bcrypt [None req-4c512d30-13d7-43c6-a3ec-8398d01c19e4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80240) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 17 07:14:41.856011 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4c512d30-13d7-43c6-a3ec-8398d01c19e4 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:41.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4c512d30-13d7-43c6-a3ec-8398d01c19e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:41.860364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:14:41.884211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f5ac-f375-4bbf-a91a-ad24828cee17 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:41.907836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:41.959104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:14:41.981796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c512d30-13d7-43c6-a3ec-8398d01c19e4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:41.984487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f5ac-f375-4bbf-a91a-ad24828cee17 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:42.019038 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38421bae-2e49-46d7-b57c-dcd49456ebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:42.019833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38421bae-2e49-46d7-b57c-dcd49456ebd2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:42.020118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38421bae-2e49-46d7-b57c-dcd49456ebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:42.020395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38421bae-2e49-46d7-b57c-dcd49456ebd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:42.031498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38421bae-2e49-46d7-b57c-dcd49456ebd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:42.042727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-38421bae-2e49-46d7-b57c-dcd49456ebd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:42.042727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:42.042727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:42.042727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:42.042727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:42.042727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:42.042727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:42.042727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:42.042727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:42.042727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:42.042727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:42.042727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:42.042727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:42.042727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:42.042727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:42.042727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:42.043650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:42.043650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:42.043650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:42.043650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:42.043650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:42.043650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:42.043650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:42.043650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:42.043650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:42.043650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:42.043650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:42.043650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:42.043650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:42.043650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:42.043650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:42.043650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:42.044543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:42.044543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:42.044543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:42.044543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:42.044543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:42.044543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:42.044543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:42.044543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:42.044543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:42.044543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:42.044543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:42.044543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:14:42.044543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 7/14] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:14:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:42.050287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38421bae-2e49-46d7-b57c-dcd49456ebd2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:42.084682 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c512d30-13d7-43c6-a3ec-8398d01c19e4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:42.086976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:42.121869 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c7997-bf6a-45b6-a83e-0f47db6c73a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:42.122762 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c7997-bf6a-45b6-a83e-0f47db6c73a0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:42.123046 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c7997-bf6a-45b6-a83e-0f47db6c73a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:42.123320 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c7997-bf6a-45b6-a83e-0f47db6c73a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:42.131669 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:42.149653 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38421bae-2e49-46d7-b57c-dcd49456ebd2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:42.185237 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9eac2-e0b8-4b0c-948f-5a4d4a7294c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:42.186160 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9eac2-e0b8-4b0c-948f-5a4d4a7294c0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:42.186443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9eac2-e0b8-4b0c-948f-5a4d4a7294c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:42.186717 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9eac2-e0b8-4b0c-948f-5a4d4a7294c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:42.187459 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9eac2-e0b8-4b0c-948f-5a4d4a7294c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:42.187761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9eac2-e0b8-4b0c-948f-5a4d4a7294c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:42.189726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9eac2-e0b8-4b0c-948f-5a4d4a7294c0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:42.192327 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c7997-bf6a-45b6-a83e-0f47db6c73a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:42.193887 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c7997-bf6a-45b6-a83e-0f47db6c73a0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:42.201105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 8/15] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:14:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:42.206589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9eac2-e0b8-4b0c-948f-5a4d4a7294c0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:42.291474 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 8/16] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 07:14:42.296958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c7997-bf6a-45b6-a83e-0f47db6c73a0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:42.299811 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:42.308148 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9eac2-e0b8-4b0c-948f-5a4d4a7294c0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:42.346211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164b616-0180-4666-8fff-2ac1f35e2b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:42.347073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164b616-0180-4666-8fff-2ac1f35e2b9d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:42.347357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164b616-0180-4666-8fff-2ac1f35e2b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:42.347639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164b616-0180-4666-8fff-2ac1f35e2b9d None admin] PATH_INFO: `/v3/users/5c26ce8b01664633a37c5e3b13519935` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:42.348845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164b616-0180-4666-8fff-2ac1f35e2b9d None admin] RBAC: Authorizing `identity:get_user(user_id=5c26ce8b01664633a37c5e3b13519935)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:42.350347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164b616-0180-4666-8fff-2ac1f35e2b9d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:42.351968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 9/17] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:14:42 2022] GET /identity/v3/users/5c26ce8b01664633a37c5e3b13519935 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:42.357428 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164b616-0180-4666-8fff-2ac1f35e2b9d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:42.372061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:42.397508 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c7997-bf6a-45b6-a83e-0f47db6c73a0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:42.431775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f27780-10f9-427b-aeed-2b3b859a48e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:42.432596 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f27780-10f9-427b-aeed-2b3b859a48e0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:42.432882 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f27780-10f9-427b-aeed-2b3b859a48e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:42.433157 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f27780-10f9-427b-aeed-2b3b859a48e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:42.451462 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f27780-10f9-427b-aeed-2b3b859a48e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:42.453021 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f27780-10f9-427b-aeed-2b3b859a48e0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:42.457572 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164b616-0180-4666-8fff-2ac1f35e2b9d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:42.474344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e5f27780-10f9-427b-aeed-2b3b859a48e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:42.474344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:42.474344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:42.474344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:42.474344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:42.474344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:42.474344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:42.474344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:42.474344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:42.474344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:42.474344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:42.474344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:42.474344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:42.474344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:42.474344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:42.475290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:42.475290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:42.475290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:42.475290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:42.475290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:42.475290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:42.475290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:42.475290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:42.475290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:42.475290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:42.475290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:42.475290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:42.475290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:42.475290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:42.475290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:42.475290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:42.475290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:42.476087 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:42.476087 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:42.476087 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:42.476087 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:14:42.476087 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 9/18] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:42.481256 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f27780-10f9-427b-aeed-2b3b859a48e0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:42.492516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf79d3-bebc-4db3-beef-6d9299e9bd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:42.493339 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf79d3-bebc-4db3-beef-6d9299e9bd2a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:42.493632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf79d3-bebc-4db3-beef-6d9299e9bd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:42.493909 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf79d3-bebc-4db3-beef-6d9299e9bd2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:42.495094 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf79d3-bebc-4db3-beef-6d9299e9bd2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:42.496570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf79d3-bebc-4db3-beef-6d9299e9bd2a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:42.498205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 10/19] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:42.504315 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf79d3-bebc-4db3-beef-6d9299e9bd2a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:42.538525 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:42.582307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f27780-10f9-427b-aeed-2b3b859a48e0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:42.585372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:42.604304 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf79d3-bebc-4db3-beef-6d9299e9bd2a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:42.616806 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97b3d8-2435-4f17-84c2-212ec9d539e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:42.617508 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97b3d8-2435-4f17-84c2-212ec9d539e3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:42.617798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97b3d8-2435-4f17-84c2-212ec9d539e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:42.618127 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97b3d8-2435-4f17-84c2-212ec9d539e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:42.618879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97b3d8-2435-4f17-84c2-212ec9d539e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:42.619186 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97b3d8-2435-4f17-84c2-212ec9d539e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:42.620699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97b3d8-2435-4f17-84c2-212ec9d539e3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:42.637833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d997a45-f1bd-459f-b6d2-9d5db37286fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:42.637972 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 10/20] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:42.638495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d997a45-f1bd-459f-b6d2-9d5db37286fe None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:42.638776 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d997a45-f1bd-459f-b6d2-9d5db37286fe None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:42.639131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d997a45-f1bd-459f-b6d2-9d5db37286fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:42.639965 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d997a45-f1bd-459f-b6d2-9d5db37286fe None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.domain.id=default, user.id=5c26ce8b01664633a37c5e3b13519935) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:42.640277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d997a45-f1bd-459f-b6d2-9d5db37286fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:42.642791 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d997a45-f1bd-459f-b6d2-9d5db37286fe None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:42.650382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 11/21] 10.222.0.52 () {56 vars in 1322 bytes} [Fri Jun 17 07:14:42 2022] GET /identity/v3/role_assignments?user.id=5c26ce8b01664633a37c5e3b13519935&scope.domain.id=default&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:45.117361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eacad-dc3e-4aec-b3b3-9d329e21b006 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.118408 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eacad-dc3e-4aec-b3b3-9d329e21b006 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.118975 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eacad-dc3e-4aec-b3b3-9d329e21b006 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.120619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 11/22] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:45.126109 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184c1b2-d69d-4f20-ba8e-f1dce800dcc0 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.126963 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184c1b2-d69d-4f20-ba8e-f1dce800dcc0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.127436 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184c1b2-d69d-4f20-ba8e-f1dce800dcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.146031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b184c1b2-d69d-4f20-ba8e-f1dce800dcc0 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:45.147508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b184c1b2-d69d-4f20-ba8e-f1dce800dcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:45.233839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 12/23] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:45.268579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eacad-dc3e-4aec-b3b3-9d329e21b006 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:45.419302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eacad-dc3e-4aec-b3b3-9d329e21b006 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:45.439318 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:45.470712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86ea83-db9d-456d-beeb-350edd68ec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:45.471805 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86ea83-db9d-456d-beeb-350edd68ec93 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.472095 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86ea83-db9d-456d-beeb-350edd68ec93 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.472373 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86ea83-db9d-456d-beeb-350edd68ec93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.490002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86ea83-db9d-456d-beeb-350edd68ec93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:45.498892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887bdc8-fd28-4e11-874a-de2ceee5fc0e None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.499431 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887bdc8-fd28-4e11-874a-de2ceee5fc0e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.499911 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887bdc8-fd28-4e11-874a-de2ceee5fc0e None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.501772 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:14:45.503618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-cb86ea83-db9d-456d-beeb-350edd68ec93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:45.503618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:45.503618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:45.503618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:45.503618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:45.503618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:45.503618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:45.503618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:45.503618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:45.503618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:45.503618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:45.503618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:45.503618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:45.503618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:45.503618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:45.503618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:45.504464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:45.504464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:45.504464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:45.504464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:45.504464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:45.504464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:45.504464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:45.504464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:45.504464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:45.504464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:45.504464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:45.504464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:45.504464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:45.504464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:45.504464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:45.504464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:45.505223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:45.505223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:45.505223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:45.505223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:45.505223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:45.505223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:45.505223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:45.505223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:45.505223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:45.505223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:45.505223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:45.505223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:14:45.505223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 12/25] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:14:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:45.509827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fe712-a7de-4144-9814-b6256ad5ca1c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.510338 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fe712-a7de-4144-9814-b6256ad5ca1c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.510831 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fe712-a7de-4144-9814-b6256ad5ca1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.511158 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86ea83-db9d-456d-beeb-350edd68ec93 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:45.546620 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0e4fe712-a7de-4144-9814-b6256ad5ca1c None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:45.548803 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0e4fe712-a7de-4144-9814-b6256ad5ca1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:45.688271 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 14/26] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:45.692490 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b02c7-7b9f-4bc4-8007-e65904e8e1c6 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.693202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b02c7-7b9f-4bc4-8007-e65904e8e1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.694678 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b02c7-7b9f-4bc4-8007-e65904e8e1c6 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.696221 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 15/27] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:45.702757 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf92d3a-cad9-43af-b7cf-5ed0337151dc None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.703484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf92d3a-cad9-43af-b7cf-5ed0337151dc None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.705128 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf92d3a-cad9-43af-b7cf-5ed0337151dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.718451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:45.721682 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86ea83-db9d-456d-beeb-350edd68ec93 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:45.740652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-dbf92d3a-cad9-43af-b7cf-5ed0337151dc None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:45.742511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dbf92d3a-cad9-43af-b7cf-5ed0337151dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:45.793355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e42db3-f6fd-4e4c-9292-cfcd4b10b396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:45.794529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e42db3-f6fd-4e4c-9292-cfcd4b10b396 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.795778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e42db3-f6fd-4e4c-9292-cfcd4b10b396 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.796890 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e42db3-f6fd-4e4c-9292-cfcd4b10b396 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.798922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e42db3-f6fd-4e4c-9292-cfcd4b10b396 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:45.800389 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e42db3-f6fd-4e4c-9292-cfcd4b10b396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:45.801674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e42db3-f6fd-4e4c-9292-cfcd4b10b396 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:45.815603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 13/28] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:14:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:45.816765 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e42db3-f6fd-4e4c-9292-cfcd4b10b396 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:45.845234 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 16/29] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:45.846931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9bd09-1fc4-4cd8-bfaf-947db449dfb4 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.847432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9bd09-1fc4-4cd8-bfaf-947db449dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.847910 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9bd09-1fc4-4cd8-bfaf-947db449dfb4 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.849395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 17/30] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:45.850392 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9bd09-1fc4-4cd8-bfaf-947db449dfb4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:45.874590 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:45.952402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e42db3-f6fd-4e4c-9292-cfcd4b10b396 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:45.982906 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9bd09-1fc4-4cd8-bfaf-947db449dfb4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:45.988428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612dd02-60d2-4b1d-adc4-4d79026c3592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:45.989434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612dd02-60d2-4b1d-adc4-4d79026c3592 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.989922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612dd02-60d2-4b1d-adc4-4d79026c3592 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.990402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612dd02-60d2-4b1d-adc4-4d79026c3592 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.991347 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612dd02-60d2-4b1d-adc4-4d79026c3592 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:45.992939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612dd02-60d2-4b1d-adc4-4d79026c3592 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:46.024706 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df2e10-5a00-48cf-a354-d857aaa0338a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:46.025640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df2e10-5a00-48cf-a354-d857aaa0338a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.025920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df2e10-5a00-48cf-a354-d857aaa0338a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.026194 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df2e10-5a00-48cf-a354-d857aaa0338a None admin] PATH_INFO: `/v3/users/5c26ce8b01664633a37c5e3b13519935` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.027632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df2e10-5a00-48cf-a354-d857aaa0338a None admin] RBAC: Authorizing `identity:get_user(user_id=5c26ce8b01664633a37c5e3b13519935)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:46.029180 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df2e10-5a00-48cf-a354-d857aaa0338a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:46.033464 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 18/31] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:14:45 2022] GET /identity/v3/users/5c26ce8b01664633a37c5e3b13519935 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:46.034920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fcf39-3752-457b-a73a-1c431285c6ec None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.035435 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fcf39-3752-457b-a73a-1c431285c6ec None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.035895 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fcf39-3752-457b-a73a-1c431285c6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.042614 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:46.053559 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-5f5fcf39-3752-457b-a73a-1c431285c6ec None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:46.054727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5f5fcf39-3752-457b-a73a-1c431285c6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:46.133223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 19/32] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:46.135147 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fcf39-3752-457b-a73a-1c431285c6ec None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:46.203481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 14/33] 10.222.0.52 () {60 vars in 1131 bytes} [Fri Jun 17 07:14:45 2022] POST /identity/v3/roles => generated 219 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:14:46.210560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612dd02-60d2-4b1d-adc4-4d79026c3592 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:46.300935 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fcf39-3752-457b-a73a-1c431285c6ec None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:46.342395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:46.347746 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55f5b0-9bdf-408b-b02a-b928b496d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:46.354066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55f5b0-9bdf-408b-b02a-b928b496d694 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.354066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55f5b0-9bdf-408b-b02a-b928b496d694 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.354066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55f5b0-9bdf-408b-b02a-b928b496d694 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.354066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55f5b0-9bdf-408b-b02a-b928b496d694 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:46.354066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55f5b0-9bdf-408b-b02a-b928b496d694 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:46.370008 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:46.374567 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612dd02-60d2-4b1d-adc4-4d79026c3592 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:46.412608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cb3ed-b9d9-4af6-9740-b8494789db69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:46.413452 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cb3ed-b9d9-4af6-9740-b8494789db69 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.413740 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cb3ed-b9d9-4af6-9740-b8494789db69 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.414020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cb3ed-b9d9-4af6-9740-b8494789db69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.415542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cb3ed-b9d9-4af6-9740-b8494789db69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:46.417162 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cb3ed-b9d9-4af6-9740-b8494789db69 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:46.419173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 15/34] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:46.419960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cb3ed-b9d9-4af6-9740-b8494789db69 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:46.648479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cb3ed-b9d9-4af6-9740-b8494789db69 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:46.676350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 20/35] 10.222.0.52 () {60 vars in 1131 bytes} [Fri Jun 17 07:14:46 2022] POST /identity/v3/roles => generated 225 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:14:46.680062 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83c237-46b5-4997-862e-2dd93c890963 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.680062 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83c237-46b5-4997-862e-2dd93c890963 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.680062 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83c237-46b5-4997-862e-2dd93c890963 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.684070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 21/36] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:46.685070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83c237-46b5-4997-862e-2dd93c890963 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:46.698681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642e0a9-fafb-475d-b96b-dbc0bb8a7600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:46.700267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642e0a9-fafb-475d-b96b-dbc0bb8a7600 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.701088 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642e0a9-fafb-475d-b96b-dbc0bb8a7600 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.701930 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642e0a9-fafb-475d-b96b-dbc0bb8a7600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.717447 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642e0a9-fafb-475d-b96b-dbc0bb8a7600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:46.720411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642e0a9-fafb-475d-b96b-dbc0bb8a7600 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:46.746209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-2642e0a9-fafb-475d-b96b-dbc0bb8a7600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:46.746209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:46.746209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:46.746209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:46.746209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:46.746209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:46.746209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:46.746209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:46.746209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:46.746209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:46.746209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:46.746209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:46.746209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:46.746209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:46.746209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:46.747110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:46.747110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:46.747110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:46.747110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:46.747110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:46.747110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:46.747110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:46.747110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:46.747110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:46.747110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:46.747110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:46.747110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:46.747110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:46.747110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:46.747110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:46.747110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:46.747110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:46.747933 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:46.747933 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:46.747933 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:46.747933 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:14:46.750134 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 16/37] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:46.752266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2beb2-381d-4c12-89a7-5965ef1bd6ff None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.752900 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2beb2-381d-4c12-89a7-5965ef1bd6ff None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.753312 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2beb2-381d-4c12-89a7-5965ef1bd6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.773479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-eab2beb2-381d-4c12-89a7-5965ef1bd6ff None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:46.775470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-eab2beb2-381d-4c12-89a7-5965ef1bd6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:46.792784 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:46.833958 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83c237-46b5-4997-862e-2dd93c890963 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:46.858360 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 17/38] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:46.859031 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2beb2-381d-4c12-89a7-5965ef1bd6ff None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:46.878232 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9661fbd-e668-4122-8816-dd3eec2269e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:46.879565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9661fbd-e668-4122-8816-dd3eec2269e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.880055 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9661fbd-e668-4122-8816-dd3eec2269e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.880532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9661fbd-e668-4122-8816-dd3eec2269e9 None admin] PATH_INFO: `/v3/domains/default/users/5c26ce8b01664633a37c5e3b13519935/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.883284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9661fbd-e668-4122-8816-dd3eec2269e9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5c26ce8b01664633a37c5e3b13519935, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:46.885503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9661fbd-e668-4122-8816-dd3eec2269e9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:46.963221 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 22/39] 10.222.0.52 () {58 vars in 1361 bytes} [Fri Jun 17 07:14:46 2022] PUT /identity/v3/domains/default/users/5c26ce8b01664633a37c5e3b13519935/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:14:46.963221 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9661fbd-e668-4122-8816-dd3eec2269e9 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:46.981831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2beb2-381d-4c12-89a7-5965ef1bd6ff None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:47.018847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:47.024198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5b1ed-a2aa-4258-806d-93b1c62842ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:47.024879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5b1ed-a2aa-4258-806d-93b1c62842ec None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:47.025161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5b1ed-a2aa-4258-806d-93b1c62842ec None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:47.025468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5b1ed-a2aa-4258-806d-93b1c62842ec None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:47.026205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5b1ed-a2aa-4258-806d-93b1c62842ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:47.026515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5b1ed-a2aa-4258-806d-93b1c62842ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:47.027925 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5b1ed-a2aa-4258-806d-93b1c62842ec None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:47.042589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 18/40] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:47.049632 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eba0a1-7d17-464d-8841-37f2e797682b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:47.049931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eba0a1-7d17-464d-8841-37f2e797682b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:47.050210 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eba0a1-7d17-464d-8841-37f2e797682b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:47.051812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 19/41] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:47.052421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eba0a1-7d17-464d-8841-37f2e797682b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:47.065927 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:47.075478 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9661fbd-e668-4122-8816-dd3eec2269e9 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:47.115319 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d3057-38e7-4beb-ae62-e90912bdf80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:47.116307 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d3057-38e7-4beb-ae62-e90912bdf80e None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:47.116774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d3057-38e7-4beb-ae62-e90912bdf80e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:47.117051 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d3057-38e7-4beb-ae62-e90912bdf80e None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:47.117862 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d3057-38e7-4beb-ae62-e90912bdf80e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:47.119574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d3057-38e7-4beb-ae62-e90912bdf80e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:47.179140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eba0a1-7d17-464d-8841-37f2e797682b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:47.208252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 23/42] 10.222.0.52 () {60 vars in 1131 bytes} [Fri Jun 17 07:14:46 2022] POST /identity/v3/roles => generated 223 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:14:47.208252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105d56c-9f16-431a-a208-dc120d5de7be None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:47.208252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105d56c-9f16-431a-a208-dc120d5de7be None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:47.208252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105d56c-9f16-431a-a208-dc120d5de7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:47.222284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-2105d56c-9f16-431a-a208-dc120d5de7be None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:47.224209 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2105d56c-9f16-431a-a208-dc120d5de7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:47.225307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701c381-af0e-4c65-b622-be53700d514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:47.226098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c381-af0e-4c65-b622-be53700d514a None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:47.226391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c381-af0e-4c65-b622-be53700d514a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:47.226676 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c381-af0e-4c65-b622-be53700d514a None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:47.227563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701c381-af0e-4c65-b622-be53700d514a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:47.229235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701c381-af0e-4c65-b622-be53700d514a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:47.309575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 20/43] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Jun 17 07:14:47 2022] POST /identity/v3/projects => generated 301 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:14:47.311081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 24/44] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:47.350056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701c381-af0e-4c65-b622-be53700d514a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:47.458603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:47.506424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701c381-af0e-4c65-b622-be53700d514a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:47.542971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e28b0a-11fd-49c3-b31e-b9be8d2435ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:47.544032 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e28b0a-11fd-49c3-b31e-b9be8d2435ee None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:47.544460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e28b0a-11fd-49c3-b31e-b9be8d2435ee None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:47.544876 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e28b0a-11fd-49c3-b31e-b9be8d2435ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:47.546214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e28b0a-11fd-49c3-b31e-b9be8d2435ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:47.547968 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e28b0a-11fd-49c3-b31e-b9be8d2435ee None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:47.549956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 21/45] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:47.555652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105d56c-9f16-431a-a208-dc120d5de7be None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:47.599797 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:47.655189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105d56c-9f16-431a-a208-dc120d5de7be None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:47.692447 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4fbdc-0a29-4019-8d01-f8df50c1573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:47.693124 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4fbdc-0a29-4019-8d01-f8df50c1573b None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:47.693445 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4fbdc-0a29-4019-8d01-f8df50c1573b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:47.693727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4fbdc-0a29-4019-8d01-f8df50c1573b None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:47.694446 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4fbdc-0a29-4019-8d01-f8df50c1573b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:47.695928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4fbdc-0a29-4019-8d01-f8df50c1573b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:47.784847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 25/46] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Jun 17 07:14:47 2022] POST /identity/v3/projects => generated 312 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:14:49.116863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7791be-eafe-4ce0-b4d2-5941360f2a37 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:49.117435 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7791be-eafe-4ce0-b4d2-5941360f2a37 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:49.117510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7791be-eafe-4ce0-b4d2-5941360f2a37 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:49.118849 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 22/47] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:49.124192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b31eb-86d6-4215-ae59-cf6953cb4bf4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:49.124609 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b31eb-86d6-4215-ae59-cf6953cb4bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:49.124926 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b31eb-86d6-4215-ae59-cf6953cb4bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:49.143211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-540b31eb-86d6-4215-ae59-cf6953cb4bf4 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:49.144395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-540b31eb-86d6-4215-ae59-cf6953cb4bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:49.208992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 26/48] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:49.231627 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7791be-eafe-4ce0-b4d2-5941360f2a37 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:49.332482 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7791be-eafe-4ce0-b4d2-5941360f2a37 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:49.358154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:49.366302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e5fb1-dc63-4b94-bad9-381cba9f4e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:49.369367 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e5fb1-dc63-4b94-bad9-381cba9f4e43 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:49.369367 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e5fb1-dc63-4b94-bad9-381cba9f4e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:49.369367 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e5fb1-dc63-4b94-bad9-381cba9f4e43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:49.378632 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e5fb1-dc63-4b94-bad9-381cba9f4e43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:49.386415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ea7e5fb1-dc63-4b94-bad9-381cba9f4e43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:49.386415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:49.386415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:49.386415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:49.386415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:49.386415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:49.386415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:49.386415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:49.386415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:49.386415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:49.386415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:49.386415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:49.386415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:49.386415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:49.386415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:49.386415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:49.387340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:49.387340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:49.387340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:49.387340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:49.387340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:49.387340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:49.387340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:49.387340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:49.387340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:49.387340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:49.387340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:49.387340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:49.387340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:49.387340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:49.387340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:49.387340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:49.388140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:49.388140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:49.388140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:49.388140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:49.388140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:49.388140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:49.388140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:49.388140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:49.388140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:49.388140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:49.388140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:49.388140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:14:49.389128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 23/49] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:14:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:49.394497 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b31eb-86d6-4215-ae59-cf6953cb4bf4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:49.418797 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:49.493713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b31eb-86d6-4215-ae59-cf6953cb4bf4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:49.527959 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5926bc-0179-4557-b7da-6c66df9056e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:49.528638 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5926bc-0179-4557-b7da-6c66df9056e0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:49.528925 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5926bc-0179-4557-b7da-6c66df9056e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:49.529205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5926bc-0179-4557-b7da-6c66df9056e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:49.529997 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5926bc-0179-4557-b7da-6c66df9056e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:49.530311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5926bc-0179-4557-b7da-6c66df9056e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:49.531722 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5926bc-0179-4557-b7da-6c66df9056e0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:49.540886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 27/50] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:14:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:49.546330 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e5fb1-dc63-4b94-bad9-381cba9f4e43 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:49.643946 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e5fb1-dc63-4b94-bad9-381cba9f4e43 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:49.676816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94bf4c-7f51-4aae-a556-f5f8590680d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:49.677749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94bf4c-7f51-4aae-a556-f5f8590680d8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:49.678035 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94bf4c-7f51-4aae-a556-f5f8590680d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:49.678313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94bf4c-7f51-4aae-a556-f5f8590680d8 None admin] PATH_INFO: `/v3/users/5c26ce8b01664633a37c5e3b13519935` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:49.679766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94bf4c-7f51-4aae-a556-f5f8590680d8 None admin] RBAC: Authorizing `identity:get_user(user_id=5c26ce8b01664633a37c5e3b13519935)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:49.681243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94bf4c-7f51-4aae-a556-f5f8590680d8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:49.682910 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 24/51] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:14:49 2022] GET /identity/v3/users/5c26ce8b01664633a37c5e3b13519935 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:49.688544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5926bc-0179-4557-b7da-6c66df9056e0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:49.774285 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:49.788974 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5926bc-0179-4557-b7da-6c66df9056e0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:49.822018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664cdac-fc7d-40b9-af9f-50f4ce7d139e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:49.823142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664cdac-fc7d-40b9-af9f-50f4ce7d139e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:49.823663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664cdac-fc7d-40b9-af9f-50f4ce7d139e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:49.824332 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664cdac-fc7d-40b9-af9f-50f4ce7d139e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:49.825680 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664cdac-fc7d-40b9-af9f-50f4ce7d139e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:49.827201 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664cdac-fc7d-40b9-af9f-50f4ce7d139e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:49.828991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 28/52] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:49.835746 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94bf4c-7f51-4aae-a556-f5f8590680d8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:49.891407 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f035747-7020-42e5-ac1d-85ee5dbd1815 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:49.891712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f035747-7020-42e5-ac1d-85ee5dbd1815 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:49.892018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f035747-7020-42e5-ac1d-85ee5dbd1815 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:49.893434 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 29/53] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:14:49.894826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:49.898192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3686719-f599-4fdd-8dee-650d5da088bb None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:49.898476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3686719-f599-4fdd-8dee-650d5da088bb None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:49.898752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3686719-f599-4fdd-8dee-650d5da088bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:49.915667 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e3686719-f599-4fdd-8dee-650d5da088bb None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:49.916887 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e3686719-f599-4fdd-8dee-650d5da088bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:49.939731 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94bf4c-7f51-4aae-a556-f5f8590680d8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:49.972425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc50a1c-1b6c-4eeb-aab5-5f3b4f95829e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:49.973084 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc50a1c-1b6c-4eeb-aab5-5f3b4f95829e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:49.973388 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc50a1c-1b6c-4eeb-aab5-5f3b4f95829e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:49.973665 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc50a1c-1b6c-4eeb-aab5-5f3b4f95829e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:49.974489 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc50a1c-1b6c-4eeb-aab5-5f3b4f95829e None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.domain.id=default, user.id=5c26ce8b01664633a37c5e3b13519935) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:49.974796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc50a1c-1b6c-4eeb-aab5-5f3b4f95829e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:49.976249 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc50a1c-1b6c-4eeb-aab5-5f3b4f95829e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:49.982683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 30/54] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:14:49.993370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 25/55] 10.222.0.52 () {56 vars in 1322 bytes} [Fri Jun 17 07:14:49 2022] GET /identity/v3/role_assignments?user.id=5c26ce8b01664633a37c5e3b13519935&scope.domain.id=default&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:50.006540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3686719-f599-4fdd-8dee-650d5da088bb None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:50.095370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:50.111858 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3686719-f599-4fdd-8dee-650d5da088bb None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:50.149135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0662df1-0725-4efd-a3b3-b6cfecd009b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:50.149894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0662df1-0725-4efd-a3b3-b6cfecd009b6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:50.150183 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0662df1-0725-4efd-a3b3-b6cfecd009b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:50.150460 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0662df1-0725-4efd-a3b3-b6cfecd009b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:50.151644 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0662df1-0725-4efd-a3b3-b6cfecd009b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:50.153268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0662df1-0725-4efd-a3b3-b6cfecd009b6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:50.154948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 31/56] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:50.160796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc50a1c-1b6c-4eeb-aab5-5f3b4f95829e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:50.263576 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc50a1c-1b6c-4eeb-aab5-5f3b4f95829e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:50.282875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:50.296181 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f880d3-4c95-48f9-a6f0-7b4e9dbbf6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:50.296849 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f880d3-4c95-48f9-a6f0-7b4e9dbbf6c3 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:50.297141 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f880d3-4c95-48f9-a6f0-7b4e9dbbf6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:50.297455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f880d3-4c95-48f9-a6f0-7b4e9dbbf6c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:50.298723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f880d3-4c95-48f9-a6f0-7b4e9dbbf6c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:50.300191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f880d3-4c95-48f9-a6f0-7b4e9dbbf6c3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:50.423838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 26/57] 10.222.0.52 () {60 vars in 1140 bytes} [Fri Jun 17 07:14:50 2022] POST /identity/v3/projects => generated 298 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:14:52.545485 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cc6b8-5a55-462d-a185-5e289de686dd None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:52.545996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cc6b8-5a55-462d-a185-5e289de686dd None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:52.546106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cc6b8-5a55-462d-a185-5e289de686dd None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:52.547419 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 32/58] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:52.552558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de305692-3a35-42cc-bb01-54d30c686bb5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:52.552938 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de305692-3a35-42cc-bb01-54d30c686bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:52.553117 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de305692-3a35-42cc-bb01-54d30c686bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:52.569202 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-de305692-3a35-42cc-bb01-54d30c686bb5 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:52.570432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-de305692-3a35-42cc-bb01-54d30c686bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:52.633655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 27/59] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:52.659430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088cc6b8-5a55-462d-a185-5e289de686dd None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:52.759520 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088cc6b8-5a55-462d-a185-5e289de686dd None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:52.793132 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7f471-5e89-467e-8645-8cd14a05ffec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:52.793947 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7f471-5e89-467e-8645-8cd14a05ffec None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:52.794235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7f471-5e89-467e-8645-8cd14a05ffec None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:52.794514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7f471-5e89-467e-8645-8cd14a05ffec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:52.795756 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7f471-5e89-467e-8645-8cd14a05ffec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:52.797165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7f471-5e89-467e-8645-8cd14a05ffec None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:52.799161 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 33/60] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:52.804644 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de305692-3a35-42cc-bb01-54d30c686bb5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:52.901379 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de305692-3a35-42cc-bb01-54d30c686bb5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:52.902883 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:52.934029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad1bac-1278-4700-a75c-34783a669759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:52.934693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad1bac-1278-4700-a75c-34783a669759 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:52.934975 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad1bac-1278-4700-a75c-34783a669759 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:52.935254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad1bac-1278-4700-a75c-34783a669759 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:52.935959 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad1bac-1278-4700-a75c-34783a669759 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:52.937455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad1bac-1278-4700-a75c-34783a669759 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:53.026100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 28/61] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:14:52 2022] POST /identity/v3/users => generated 275 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:14:55.978309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c785f-aac4-42eb-8216-37e8f20a9663 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:55.978785 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c785f-aac4-42eb-8216-37e8f20a9663 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:55.978785 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c785f-aac4-42eb-8216-37e8f20a9663 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:55.980408 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 34/62] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:55.986032 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673e4fb-bfe6-4e91-9323-9521f3f46597 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:55.986536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673e4fb-bfe6-4e91-9323-9521f3f46597 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:55.986711 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673e4fb-bfe6-4e91-9323-9521f3f46597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:56.006833 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7673e4fb-bfe6-4e91-9323-9521f3f46597 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:56.008058 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7673e4fb-bfe6-4e91-9323-9521f3f46597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:56.103677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 29/63] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:56.136138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c785f-aac4-42eb-8216-37e8f20a9663 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:56.171499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:56.279077 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c785f-aac4-42eb-8216-37e8f20a9663 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:56.328820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779e08b-fd56-48db-8a9e-46075d3e7f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:56.329996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779e08b-fd56-48db-8a9e-46075d3e7f8f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:56.330285 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779e08b-fd56-48db-8a9e-46075d3e7f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:56.330568 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779e08b-fd56-48db-8a9e-46075d3e7f8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:56.344576 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779e08b-fd56-48db-8a9e-46075d3e7f8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:56.352452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-f779e08b-fd56-48db-8a9e-46075d3e7f8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:14:56.352452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:56.352452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:56.352452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:56.352452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:56.352452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:56.352452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:56.352452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:56.352452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:56.352452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:56.352452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:56.352452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:56.352452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:56.352452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:56.352452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:56.352452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:56.353525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:56.353525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:56.353525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:56.353525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:56.353525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:56.353525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:56.353525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:56.353525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:56.353525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:56.353525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:56.353525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:56.353525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:56.353525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:56.353525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:56.353525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:56.353525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:56.354503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:56.354503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:56.354503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:56.354503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:56.354503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:56.354503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:56.354503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:56.354503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:56.354503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:56.354503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:56.354503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:14:56.354503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:14:56.354503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 35/64] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:14:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:56.362164 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673e4fb-bfe6-4e91-9323-9521f3f46597 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:56.483407 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:56.503858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673e4fb-bfe6-4e91-9323-9521f3f46597 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:56.548908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb45273-9e3e-4cba-b9f0-f78d88e342cf None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:56.549180 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb45273-9e3e-4cba-b9f0-f78d88e342cf None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:56.549425 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb45273-9e3e-4cba-b9f0-f78d88e342cf None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:56.550812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 36/65] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:14:56.555821 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbc0e7-b82d-410d-865d-05003dabd85c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:56.556114 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbc0e7-b82d-410d-865d-05003dabd85c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:56.556399 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbc0e7-b82d-410d-865d-05003dabd85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:56.566252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac07bd-2693-47bb-a70d-cbe0671db1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:56.566950 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac07bd-2693-47bb-a70d-cbe0671db1ce None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:56.567238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac07bd-2693-47bb-a70d-cbe0671db1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:56.567521 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac07bd-2693-47bb-a70d-cbe0671db1ce None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:56.568291 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac07bd-2693-47bb-a70d-cbe0671db1ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:56.568605 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac07bd-2693-47bb-a70d-cbe0671db1ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:56.570055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac07bd-2693-47bb-a70d-cbe0671db1ce None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:56.585822 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d3cbc0e7-b82d-410d-865d-05003dabd85c None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:56.589099 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d3cbc0e7-b82d-410d-865d-05003dabd85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:56.591338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 30/66] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:14:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:56.595206 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac07bd-2693-47bb-a70d-cbe0671db1ce None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:56.718549 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 37/67] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:14:56.725857 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd829992-c68c-4194-aa01-6bb31539127b None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:56.726834 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd829992-c68c-4194-aa01-6bb31539127b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:56.727284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd829992-c68c-4194-aa01-6bb31539127b None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:56.729651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 38/68] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:56.737913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394dae6-173a-4744-a248-623caab21412 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:56.738559 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394dae6-173a-4744-a248-623caab21412 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:56.738979 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394dae6-173a-4744-a248-623caab21412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:56.760262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac07bd-2693-47bb-a70d-cbe0671db1ce None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:56.763101 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8394dae6-173a-4744-a248-623caab21412 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:56.764521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8394dae6-173a-4744-a248-623caab21412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:56.769868 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:56.801891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cbac9-6b63-4d84-9fb0-0180d480f328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:56.802830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cbac9-6b63-4d84-9fb0-0180d480f328 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:56.803104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cbac9-6b63-4d84-9fb0-0180d480f328 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:56.803381 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cbac9-6b63-4d84-9fb0-0180d480f328 None admin] PATH_INFO: `/v3/users/30b6406c9904428284345736fa549292` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:56.819526 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cbac9-6b63-4d84-9fb0-0180d480f328 None admin] RBAC: Authorizing `identity:get_user(user_id=30b6406c9904428284345736fa549292)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:56.820999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cbac9-6b63-4d84-9fb0-0180d480f328 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:56.822860 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 31/69] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:14:56 2022] GET /identity/v3/users/30b6406c9904428284345736fa549292 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:56.823463 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cbac9-6b63-4d84-9fb0-0180d480f328 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:56.837691 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:56.840760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 39/70] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:56.842336 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c35f16-a969-4761-b3ad-182bcfb00e72 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:56.843014 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c35f16-a969-4761-b3ad-182bcfb00e72 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:56.843623 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c35f16-a969-4761-b3ad-182bcfb00e72 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:56.845191 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 40/71] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:56.846213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c35f16-a969-4761-b3ad-182bcfb00e72 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:56.940393 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cbac9-6b63-4d84-9fb0-0180d480f328 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:56.958297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c35f16-a969-4761-b3ad-182bcfb00e72 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:56.979545 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54aa98-089c-4eca-ad4f-8ae0ff09f810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:56.980358 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54aa98-089c-4eca-ad4f-8ae0ff09f810 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:56.980654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54aa98-089c-4eca-ad4f-8ae0ff09f810 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:56.980939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54aa98-089c-4eca-ad4f-8ae0ff09f810 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:56.993357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54aa98-089c-4eca-ad4f-8ae0ff09f810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:56.993922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42029928-fea9-4a57-ba99-ba94c2b1e696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:56.994406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42029928-fea9-4a57-ba99-ba94c2b1e696 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:56.994609 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42029928-fea9-4a57-ba99-ba94c2b1e696 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:56.994883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42029928-fea9-4a57-ba99-ba94c2b1e696 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.002054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ae54aa98-089c-4eca-ad4f-8ae0ff09f810 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:57.002054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:57.002054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:57.002054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:57.002054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:57.002054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:57.002054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:57.002054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:57.002054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:57.002054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:57.002054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:57.002054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:57.002054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:57.002054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:57.002054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:57.002054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:57.002934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:57.002934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:57.002934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:57.002934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:57.002934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:57.002934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:57.002934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:57.002934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:57.002934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:57.002934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:57.002934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:57.002934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:57.002934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:57.002934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:57.002934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:57.002934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:57.003725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:57.003725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:57.003725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:57.003725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:57.003725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:57.003725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:57.003725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:57.003725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:57.003725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:57.003725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:57.003725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:57.003725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:14:57.003725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 32/72] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:14:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:57.004941 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7c3f7-571a-4577-8e36-8e650ae1c0ee None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.004941 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7c3f7-571a-4577-8e36-8e650ae1c0ee None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.005085 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7c3f7-571a-4577-8e36-8e650ae1c0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.010009 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:57.021951 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1ce7c3f7-571a-4577-8e36-8e650ae1c0ee None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:57.023173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1ce7c3f7-571a-4577-8e36-8e650ae1c0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:57.073763 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42029928-fea9-4a57-ba99-ba94c2b1e696 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:57.075219 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42029928-fea9-4a57-ba99-ba94c2b1e696 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:57.090872 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:57.097807 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 33/73] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:57.106613 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7c3f7-571a-4577-8e36-8e650ae1c0ee None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:57.186943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 41/74] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:14:57.187868 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42029928-fea9-4a57-ba99-ba94c2b1e696 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:57.215833 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7c3f7-571a-4577-8e36-8e650ae1c0ee None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:57.236523 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:57.255449 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6e134-947b-40c0-931e-8149838aa3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:57.256263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6e134-947b-40c0-931e-8149838aa3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.256537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6e134-947b-40c0-931e-8149838aa3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.256817 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6e134-947b-40c0-931e-8149838aa3e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.267869 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6e134-947b-40c0-931e-8149838aa3e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:57.275615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-64e6e134-947b-40c0-931e-8149838aa3e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:14:57.275615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:57.275615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:57.275615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:57.275615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:57.275615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:57.275615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:57.275615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:57.275615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:57.275615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:57.275615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:57.275615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:57.275615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:57.275615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:57.275615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:57.275615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:57.284754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:57.284754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:57.284754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:57.284754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:57.284754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:57.284754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:57.284754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:57.284754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:57.284754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:57.284754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:57.284754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:57.284754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:57.284754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:57.284754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:57.284754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:57.284754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:57.285661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:57.285661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:57.285661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:57.285661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:57.285661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:57.285661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:57.285661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:57.285661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:57.285661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:57.285661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:57.285661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:14:57.285661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:14:57.285661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 34/75] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:14:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:57.285661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6e134-947b-40c0-931e-8149838aa3e0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:57.301591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42029928-fea9-4a57-ba99-ba94c2b1e696 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:57.334935 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76821920-43a6-4e2f-9a45-8978e1431ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:57.335602 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76821920-43a6-4e2f-9a45-8978e1431ddc None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.335881 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76821920-43a6-4e2f-9a45-8978e1431ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.336158 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76821920-43a6-4e2f-9a45-8978e1431ddc None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.336895 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76821920-43a6-4e2f-9a45-8978e1431ddc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:57.337208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76821920-43a6-4e2f-9a45-8978e1431ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:57.337499 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:57.338620 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76821920-43a6-4e2f-9a45-8978e1431ddc None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:57.347460 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 42/76] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:14:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:57.350656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fdb4d-a399-4fa7-9e53-05e048bb164d None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.352676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fdb4d-a399-4fa7-9e53-05e048bb164d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.352676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fdb4d-a399-4fa7-9e53-05e048bb164d None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.352676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 43/77] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:14:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:57.353669 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fdb4d-a399-4fa7-9e53-05e048bb164d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:57.380789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6e134-947b-40c0-931e-8149838aa3e0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:57.415365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12eaf4-8e0d-450e-9963-b8c85bd2ef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:57.416303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12eaf4-8e0d-450e-9963-b8c85bd2ef52 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.416656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12eaf4-8e0d-450e-9963-b8c85bd2ef52 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.417043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12eaf4-8e0d-450e-9963-b8c85bd2ef52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.428523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12eaf4-8e0d-450e-9963-b8c85bd2ef52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:57.436602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9d12eaf4-8e0d-450e-9963-b8c85bd2ef52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:14:57.436602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:57.436602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:57.436602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:57.436602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:57.436602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:57.436602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:57.436602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:57.436602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:57.436602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:57.436602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:57.436602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:57.436602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:57.436602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:57.436602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:57.436602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:57.437565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:57.437565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:57.437565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:57.437565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:57.437565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:57.437565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:57.437565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:57.437565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:57.437565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:57.437565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:57.437565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:57.437565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:57.437565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:57.437565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:57.437565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:57.437565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:57.439075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:57.439075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:57.439075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:57.439075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:57.439075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:57.439075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:57.439075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:57.439075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:57.439075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:57.439075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:57.439075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:14:57.439075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:14:57.439075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 35/78] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:14:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:57.439857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12eaf4-8e0d-450e-9963-b8c85bd2ef52 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:57.457716 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fdb4d-a399-4fa7-9e53-05e048bb164d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:57.459316 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:57.492580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4a590-b233-4285-9b26-f99879b57be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:57.493475 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4a590-b233-4285-9b26-f99879b57be4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.493762 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4a590-b233-4285-9b26-f99879b57be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.494042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4a590-b233-4285-9b26-f99879b57be4 None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.495211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4a590-b233-4285-9b26-f99879b57be4 None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:57.496677 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4a590-b233-4285-9b26-f99879b57be4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:57.498403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 44/79] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:14:57 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:57.502492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4a590-b233-4285-9b26-f99879b57be4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:57.539490 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12eaf4-8e0d-450e-9963-b8c85bd2ef52 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:57.556387 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:57.572704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbddcf1d-8275-4b45-bab4-3e9481bc6f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:57.573387 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddcf1d-8275-4b45-bab4-3e9481bc6f99 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.573672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddcf1d-8275-4b45-bab4-3e9481bc6f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.573946 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddcf1d-8275-4b45-bab4-3e9481bc6f99 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.574685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbddcf1d-8275-4b45-bab4-3e9481bc6f99 None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:57.574989 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbddcf1d-8275-4b45-bab4-3e9481bc6f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:57.576374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbddcf1d-8275-4b45-bab4-3e9481bc6f99 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:57.585648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 36/80] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:14:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:57.586777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52224e39-061e-4347-b312-f84c7aed80a5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.587064 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52224e39-061e-4347-b312-f84c7aed80a5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.587468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52224e39-061e-4347-b312-f84c7aed80a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.605862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-52224e39-061e-4347-b312-f84c7aed80a5 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:57.606406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4a590-b233-4285-9b26-f99879b57be4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:57.607055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-52224e39-061e-4347-b312-f84c7aed80a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:57.642924 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2486e-4f75-452e-b2f0-f195b2f85f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:57.643789 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2486e-4f75-452e-b2f0-f195b2f85f7c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.644073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2486e-4f75-452e-b2f0-f195b2f85f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.644344 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2486e-4f75-452e-b2f0-f195b2f85f7c None admin] PATH_INFO: `/v3/users/5c26ce8b01664633a37c5e3b13519935` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.645549 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2486e-4f75-452e-b2f0-f195b2f85f7c None admin] RBAC: Authorizing `identity:get_user(user_id=5c26ce8b01664633a37c5e3b13519935)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:57.647007 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2486e-4f75-452e-b2f0-f195b2f85f7c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:57.648630 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 45/81] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:14:57 2022] GET /identity/v3/users/5c26ce8b01664633a37c5e3b13519935 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:57.649415 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2486e-4f75-452e-b2f0-f195b2f85f7c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:57.682364 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 37/82] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:57.683221 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52224e39-061e-4347-b312-f84c7aed80a5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:57.692214 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:57.753878 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2486e-4f75-452e-b2f0-f195b2f85f7c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:57.786799 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52224e39-061e-4347-b312-f84c7aed80a5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:57.788338 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e331cf2-1b4e-42f2-a09a-89bd742e603d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:57.789001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e331cf2-1b4e-42f2-a09a-89bd742e603d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.789281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e331cf2-1b4e-42f2-a09a-89bd742e603d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.789592 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e331cf2-1b4e-42f2-a09a-89bd742e603d None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.790329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e331cf2-1b4e-42f2-a09a-89bd742e603d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:57.790631 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e331cf2-1b4e-42f2-a09a-89bd742e603d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:57.792009 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e331cf2-1b4e-42f2-a09a-89bd742e603d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:57.797350 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:57.800236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 46/83] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:57.804828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e331cf2-1b4e-42f2-a09a-89bd742e603d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:57.820728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edc365-5752-46d8-bd8f-af7748581804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:57.821414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edc365-5752-46d8-bd8f-af7748581804 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.821712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edc365-5752-46d8-bd8f-af7748581804 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.822231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edc365-5752-46d8-bd8f-af7748581804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.823214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edc365-5752-46d8-bd8f-af7748581804 None admin] RBAC: Adding query filter params (role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0, scope.project.id=89c6b2302f0d4de4a8c94b498362991f, user.id=30b6406c9904428284345736fa549292) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:57.823801 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edc365-5752-46d8-bd8f-af7748581804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:57.825265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edc365-5752-46d8-bd8f-af7748581804 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:57.831453 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 38/84] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:57 2022] GET /identity/v3/role_assignments?user.id=30b6406c9904428284345736fa549292&scope.project.id=89c6b2302f0d4de4a8c94b498362991f&role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:57.832227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edc365-5752-46d8-bd8f-af7748581804 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:57.913193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:57.916471 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e331cf2-1b4e-42f2-a09a-89bd742e603d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:57.956460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edc365-5752-46d8-bd8f-af7748581804 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:57.958907 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e889b-9326-44a1-b58e-a11f0ee4665c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:57.959935 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e889b-9326-44a1-b58e-a11f0ee4665c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.960124 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e889b-9326-44a1-b58e-a11f0ee4665c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.960367 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e889b-9326-44a1-b58e-a11f0ee4665c None admin] PATH_INFO: `/v3/users/30b6406c9904428284345736fa549292` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.961643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e889b-9326-44a1-b58e-a11f0ee4665c None admin] RBAC: Authorizing `identity:get_user(user_id=30b6406c9904428284345736fa549292)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:57.963131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e889b-9326-44a1-b58e-a11f0ee4665c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:57.965000 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 47/85] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:14:57 2022] GET /identity/v3/users/30b6406c9904428284345736fa549292 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:57.970954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e889b-9326-44a1-b58e-a11f0ee4665c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:57.998426 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee504c-a2e1-4f69-b88a-c4daa1c4b3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:57.999838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee504c-a2e1-4f69-b88a-c4daa1c4b3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.999838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee504c-a2e1-4f69-b88a-c4daa1c4b3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.999838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee504c-a2e1-4f69-b88a-c4daa1c4b3f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:58.045968 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:58.072818 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e889b-9326-44a1-b58e-a11f0ee4665c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:58.074302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee504c-a2e1-4f69-b88a-c4daa1c4b3f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:58.075973 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee504c-a2e1-4f69-b88a-c4daa1c4b3f1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:58.107862 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e9efc-6515-4ffd-bc5f-5cf840f13e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:58.108660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e9efc-6515-4ffd-bc5f-5cf840f13e47 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:58.108946 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e9efc-6515-4ffd-bc5f-5cf840f13e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:58.109226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e9efc-6515-4ffd-bc5f-5cf840f13e47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:58.111069 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e9efc-6515-4ffd-bc5f-5cf840f13e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:58.112432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e9efc-6515-4ffd-bc5f-5cf840f13e47 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:58.118405 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 48/86] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:58.118405 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e9efc-6515-4ffd-bc5f-5cf840f13e47 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:58.153892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:58.187994 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 39/87] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:14:58.187994 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee504c-a2e1-4f69-b88a-c4daa1c4b3f1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:58.229186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e9efc-6515-4ffd-bc5f-5cf840f13e47 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:58.266501 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71f4eb-9c10-43ea-a0f4-280ddcbee691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:58.267386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71f4eb-9c10-43ea-a0f4-280ddcbee691 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:58.267678 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71f4eb-9c10-43ea-a0f4-280ddcbee691 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:58.267956 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71f4eb-9c10-43ea-a0f4-280ddcbee691 None admin] PATH_INFO: `/v3/users/30b6406c9904428284345736fa549292` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:58.268953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:58.269856 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71f4eb-9c10-43ea-a0f4-280ddcbee691 None admin] RBAC: Authorizing `identity:get_user(user_id=30b6406c9904428284345736fa549292)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:58.271524 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71f4eb-9c10-43ea-a0f4-280ddcbee691 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:58.273190 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 49/88] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:14:58 2022] GET /identity/v3/users/30b6406c9904428284345736fa549292 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:58.274037 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71f4eb-9c10-43ea-a0f4-280ddcbee691 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:58.299283 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee504c-a2e1-4f69-b88a-c4daa1c4b3f1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:58.334122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f0e26-aebe-4b41-b8d9-cb12ad24b50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:58.334771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f0e26-aebe-4b41-b8d9-cb12ad24b50f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:58.335053 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f0e26-aebe-4b41-b8d9-cb12ad24b50f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:58.335328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f0e26-aebe-4b41-b8d9-cb12ad24b50f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:58.384423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71f4eb-9c10-43ea-a0f4-280ddcbee691 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:58.389412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:58.406290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f0e26-aebe-4b41-b8d9-cb12ad24b50f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:58.408129 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f0e26-aebe-4b41-b8d9-cb12ad24b50f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:58.425067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e447f-d0bd-4349-9f18-e2f4b799fd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:58.425762 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e447f-d0bd-4349-9f18-e2f4b799fd5d None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:58.426047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e447f-d0bd-4349-9f18-e2f4b799fd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:58.426321 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e447f-d0bd-4349-9f18-e2f4b799fd5d None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:58.427031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e447f-d0bd-4349-9f18-e2f4b799fd5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:58.428543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e447f-d0bd-4349-9f18-e2f4b799fd5d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:58.488757 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:58.513689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 40/89] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:14:58.514521 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f0e26-aebe-4b41-b8d9-cb12ad24b50f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:58.555211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 50/90] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:14:58 2022] POST /identity/v3/users => generated 289 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:14:58.555898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e447f-d0bd-4349-9f18-e2f4b799fd5d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:58.633100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f0e26-aebe-4b41-b8d9-cb12ad24b50f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:58.677671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3447f6-e0ab-4e02-9a4c-234f22f5abb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:58.681875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3447f6-e0ab-4e02-9a4c-234f22f5abb8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:58.682538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3447f6-e0ab-4e02-9a4c-234f22f5abb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:58.682538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3447f6-e0ab-4e02-9a4c-234f22f5abb8 None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:58.684150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3447f6-e0ab-4e02-9a4c-234f22f5abb8 None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:58.686528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3447f6-e0ab-4e02-9a4c-234f22f5abb8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:58.689405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 41/91] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:14:58 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:58.690486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3447f6-e0ab-4e02-9a4c-234f22f5abb8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:58.707263 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e447f-d0bd-4349-9f18-e2f4b799fd5d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:58.750008 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:58.756180 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4f275-1cc2-423b-b797-65d888d965d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:58.756847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4f275-1cc2-423b-b797-65d888d965d6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:58.757134 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4f275-1cc2-423b-b797-65d888d965d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:58.764259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4f275-1cc2-423b-b797-65d888d965d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:58.794675 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:58.820395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3447f6-e0ab-4e02-9a4c-234f22f5abb8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:58.846952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4f275-1cc2-423b-b797-65d888d965d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:58.848911 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4f275-1cc2-423b-b797-65d888d965d6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:58.871714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8509ed-d24f-44bc-ba82-d5e273ddfe86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:58.873425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8509ed-d24f-44bc-ba82-d5e273ddfe86 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:58.873716 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8509ed-d24f-44bc-ba82-d5e273ddfe86 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:58.874000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8509ed-d24f-44bc-ba82-d5e273ddfe86 None admin] PATH_INFO: `/v3/projects/d229605d5dbf4cdb8969b905797b8003` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:58.875238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8509ed-d24f-44bc-ba82-d5e273ddfe86 None admin] RBAC: Authorizing `identity:get_project(project_id=d229605d5dbf4cdb8969b905797b8003)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:58.876775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8509ed-d24f-44bc-ba82-d5e273ddfe86 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:58.878585 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 42/92] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:14:58 2022] GET /identity/v3/projects/d229605d5dbf4cdb8969b905797b8003 => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:58.879362 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8509ed-d24f-44bc-ba82-d5e273ddfe86 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:58.975991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 51/93] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:14:58.977687 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4f275-1cc2-423b-b797-65d888d965d6 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:59.026119 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8509ed-d24f-44bc-ba82-d5e273ddfe86 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:59.048330 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:59.055005 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:59.092962 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739efd9d-236e-43f0-9532-eeb721e38061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:59.093664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739efd9d-236e-43f0-9532-eeb721e38061 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:59.093950 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739efd9d-236e-43f0-9532-eeb721e38061 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:59.094283 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739efd9d-236e-43f0-9532-eeb721e38061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:59.095708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739efd9d-236e-43f0-9532-eeb721e38061 None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=89c6b2302f0d4de4a8c94b498362991f, user.id=5c26ce8b01664633a37c5e3b13519935) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:59.096028 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739efd9d-236e-43f0-9532-eeb721e38061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:59.097543 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739efd9d-236e-43f0-9532-eeb721e38061 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:59.110352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 43/94] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:58 2022] GET /identity/v3/role_assignments?user.id=5c26ce8b01664633a37c5e3b13519935&scope.project.id=89c6b2302f0d4de4a8c94b498362991f&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:59.111234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739efd9d-236e-43f0-9532-eeb721e38061 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:59.132817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4f275-1cc2-423b-b797-65d888d965d6 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:59.203215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974facb-5be1-408f-8b21-83f94cca9ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:59.204428 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974facb-5be1-408f-8b21-83f94cca9ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:59.204718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974facb-5be1-408f-8b21-83f94cca9ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:59.205000 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974facb-5be1-408f-8b21-83f94cca9ee2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:59.205880 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974facb-5be1-408f-8b21-83f94cca9ee2 None admin] RBAC: Adding query filter params (role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0, scope.project.id=d229605d5dbf4cdb8969b905797b8003, user.id=30b6406c9904428284345736fa549292) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:59.206194 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974facb-5be1-408f-8b21-83f94cca9ee2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:59.207707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974facb-5be1-408f-8b21-83f94cca9ee2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:59.218892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 52/95] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:58 2022] GET /identity/v3/role_assignments?user.id=30b6406c9904428284345736fa549292&scope.project.id=d229605d5dbf4cdb8969b905797b8003&role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:59.289875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739efd9d-236e-43f0-9532-eeb721e38061 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:59.342208 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dac26-5b2d-4d21-a048-841ce94c757f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:59.343116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dac26-5b2d-4d21-a048-841ce94c757f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:59.343399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dac26-5b2d-4d21-a048-841ce94c757f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:59.343678 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dac26-5b2d-4d21-a048-841ce94c757f None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:59.345050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dac26-5b2d-4d21-a048-841ce94c757f None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:59.346562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dac26-5b2d-4d21-a048-841ce94c757f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:59.348286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 44/96] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:14:59 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:59.354515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974facb-5be1-408f-8b21-83f94cca9ee2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:59.491160 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974facb-5be1-408f-8b21-83f94cca9ee2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:59.523273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:59.534860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17626904-08c9-4aeb-a7bd-94eaf7a830f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:59.535594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17626904-08c9-4aeb-a7bd-94eaf7a830f1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:59.535889 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17626904-08c9-4aeb-a7bd-94eaf7a830f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:59.536174 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17626904-08c9-4aeb-a7bd-94eaf7a830f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:59.537028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17626904-08c9-4aeb-a7bd-94eaf7a830f1 None admin] RBAC: Adding query filter params (role.id=930830d015f94e249715290654948151, scope.project.id=89c6b2302f0d4de4a8c94b498362991f, user.id=30b6406c9904428284345736fa549292) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:59.537365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17626904-08c9-4aeb-a7bd-94eaf7a830f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:59.538877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17626904-08c9-4aeb-a7bd-94eaf7a830f1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:59.550620 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 53/97] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:59 2022] GET /identity/v3/role_assignments?user.id=30b6406c9904428284345736fa549292&scope.project.id=89c6b2302f0d4de4a8c94b498362991f&role.id=930830d015f94e249715290654948151 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:00.130330 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27180-0067-4481-9e4a-36cde0e2b380 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:00.130968 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27180-0067-4481-9e4a-36cde0e2b380 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:00.130968 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27180-0067-4481-9e4a-36cde0e2b380 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:00.132262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 45/98] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:00.137657 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2a2e2-5236-441a-aec1-ac3739ba05d3 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:00.138173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2a2e2-5236-441a-aec1-ac3739ba05d3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:00.138320 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2a2e2-5236-441a-aec1-ac3739ba05d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:00.238882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d3f2a2e2-5236-441a-aec1-ac3739ba05d3 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:00.240190 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d3f2a2e2-5236-441a-aec1-ac3739ba05d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:00.328299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 54/99] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:00.360869 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec27180-0067-4481-9e4a-36cde0e2b380 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:00.417867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:00.495526 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec27180-0067-4481-9e4a-36cde0e2b380 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:00.543885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcc6cc-1216-49c6-a2c7-df0928c8d5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:00.544700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcc6cc-1216-49c6-a2c7-df0928c8d5cb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:00.544983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcc6cc-1216-49c6-a2c7-df0928c8d5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:00.545255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcc6cc-1216-49c6-a2c7-df0928c8d5cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:00.556865 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcc6cc-1216-49c6-a2c7-df0928c8d5cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:00.568931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-61dcc6cc-1216-49c6-a2c7-df0928c8d5cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:00.568931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:00.568931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:00.568931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:00.568931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:00.568931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:00.568931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:00.568931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:00.568931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:00.568931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:00.568931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:00.568931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:00.568931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:00.568931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:00.568931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:00.568931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:00.570976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:00.570976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:00.570976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:00.570976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:00.570976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:00.570976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:00.570976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:00.570976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:00.570976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:00.570976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:00.570976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:00.570976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:00.570976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:00.570976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:00.570976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:00.570976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:00.572836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:00.572836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:00.572836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:00.572836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:00.572836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:00.572836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:00.572836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:00.572836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:00.572836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:00.572836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:00.572836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:00.572836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:00.572836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 46/100] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:00.578422 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2a2e2-5236-441a-aec1-ac3739ba05d3 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:00.740813 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2a2e2-5236-441a-aec1-ac3739ba05d3 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:00.764255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:00.785532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f3dcd-870b-4975-b4cf-8528b4b70922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:00.786213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f3dcd-870b-4975-b4cf-8528b4b70922 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:00.786502 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f3dcd-870b-4975-b4cf-8528b4b70922 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:00.786784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f3dcd-870b-4975-b4cf-8528b4b70922 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:00.787536 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f3dcd-870b-4975-b4cf-8528b4b70922 None admin] RBAC: Adding query filter params (name=member) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:00.787844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f3dcd-870b-4975-b4cf-8528b4b70922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:00.789246 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f3dcd-870b-4975-b4cf-8528b4b70922 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:00.798060 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 55/101] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:00.803556 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcc6cc-1216-49c6-a2c7-df0928c8d5cb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:00.958384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcc6cc-1216-49c6-a2c7-df0928c8d5cb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:00.959995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:01.007167 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28840b47-462e-49bc-81e8-63fda83b69fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:01.008061 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28840b47-462e-49bc-81e8-63fda83b69fe None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:01.008346 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28840b47-462e-49bc-81e8-63fda83b69fe None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:01.008625 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28840b47-462e-49bc-81e8-63fda83b69fe None admin] PATH_INFO: `/v3/users/30b6406c9904428284345736fa549292` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:01.010965 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28840b47-462e-49bc-81e8-63fda83b69fe None admin] RBAC: Authorizing `identity:get_user(user_id=30b6406c9904428284345736fa549292)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:01.012435 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28840b47-462e-49bc-81e8-63fda83b69fe None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:01.014275 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 47/102] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:00 2022] GET /identity/v3/users/30b6406c9904428284345736fa549292 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:01.019937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f3dcd-870b-4975-b4cf-8528b4b70922 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:01.132372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f3dcd-870b-4975-b4cf-8528b4b70922 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:01.167753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d267e9-032f-4cbb-8fae-952d0e614b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:01.168623 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d267e9-032f-4cbb-8fae-952d0e614b2b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:01.168910 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d267e9-032f-4cbb-8fae-952d0e614b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:01.169193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d267e9-032f-4cbb-8fae-952d0e614b2b None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:01.170428 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d267e9-032f-4cbb-8fae-952d0e614b2b None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:01.172039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d267e9-032f-4cbb-8fae-952d0e614b2b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:01.174020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 56/103] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:01 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:01.179782 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28840b47-462e-49bc-81e8-63fda83b69fe None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:01.303696 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28840b47-462e-49bc-81e8-63fda83b69fe None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:01.339190 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd409d-0fe9-4bb1-a24e-bd95ce05f80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:01.340320 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd409d-0fe9-4bb1-a24e-bd95ce05f80a None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:01.340773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd409d-0fe9-4bb1-a24e-bd95ce05f80a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:01.341244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd409d-0fe9-4bb1-a24e-bd95ce05f80a None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f/users/30b6406c9904428284345736fa549292/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:01.343603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd409d-0fe9-4bb1-a24e-bd95ce05f80a None admin] RBAC: Authorizing `identity:create_grant(project_id=89c6b2302f0d4de4a8c94b498362991f, user_id=30b6406c9904428284345736fa549292, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:01.345252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd409d-0fe9-4bb1-a24e-bd95ce05f80a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:01.452080 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 48/104] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:15:01 2022] PUT /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f/users/30b6406c9904428284345736fa549292/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:15:01.918804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fa73d-59ec-44d3-931b-fe84412803a2 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:01.919479 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fa73d-59ec-44d3-931b-fe84412803a2 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:01.919966 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fa73d-59ec-44d3-931b-fe84412803a2 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:01.921694 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 57/105] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:01.927709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6ba7-ae8b-4b5a-bc69-ae8281c68a8a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:01.928242 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6ba7-ae8b-4b5a-bc69-ae8281c68a8a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:01.928733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6ba7-ae8b-4b5a-bc69-ae8281c68a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:01.950388 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-92fb6ba7-ae8b-4b5a-bc69-ae8281c68a8a None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:01.951906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-92fb6ba7-ae8b-4b5a-bc69-ae8281c68a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:01.981950 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:02.040005 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 49/106] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:02.083856 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fa73d-59ec-44d3-931b-fe84412803a2 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:02.152855 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:02.213603 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fa73d-59ec-44d3-931b-fe84412803a2 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:02.249565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd70fc-4e4d-4e9c-99b8-ad68ac0d8012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:02.250401 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd70fc-4e4d-4e9c-99b8-ad68ac0d8012 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:02.251365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd70fc-4e4d-4e9c-99b8-ad68ac0d8012 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:02.251654 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd70fc-4e4d-4e9c-99b8-ad68ac0d8012 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:02.252842 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd70fc-4e4d-4e9c-99b8-ad68ac0d8012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:02.254391 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd70fc-4e4d-4e9c-99b8-ad68ac0d8012 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:02.256087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 58/107] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:02.261710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb6ba7-ae8b-4b5a-bc69-ae8281c68a8a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:02.285442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4df58-8c49-446a-8041-40d31a71f661 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:02.285728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4df58-8c49-446a-8041-40d31a71f661 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:02.286010 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4df58-8c49-446a-8041-40d31a71f661 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:02.287378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 59/108] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:02.288441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1000a42-756e-4125-9d1d-19675b5b0715 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:02.288923 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1000a42-756e-4125-9d1d-19675b5b0715 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:02.289210 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1000a42-756e-4125-9d1d-19675b5b0715 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:02.290579 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 60/109] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:02.292449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d8808-0933-4b3e-885d-5b280d76430e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:02.292787 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d8808-0933-4b3e-885d-5b280d76430e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:02.293071 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d8808-0933-4b3e-885d-5b280d76430e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:02.330741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0e6d8808-0933-4b3e-885d-5b280d76430e None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:02.331952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0e6d8808-0933-4b3e-885d-5b280d76430e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:02.419889 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 61/110] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:15:02.423187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf30940-6177-455c-8b92-5e65b76f1fba None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:02.424701 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf30940-6177-455c-8b92-5e65b76f1fba None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:02.426431 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf30940-6177-455c-8b92-5e65b76f1fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:02.460616 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-cdf30940-6177-455c-8b92-5e65b76f1fba None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:02.463127 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb6ba7-ae8b-4b5a-bc69-ae8281c68a8a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:02.466663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cdf30940-6177-455c-8b92-5e65b76f1fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:02.527234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ec84a-4ebf-46f2-a197-d869839acbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:02.528448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ec84a-4ebf-46f2-a197-d869839acbf9 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:02.528971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ec84a-4ebf-46f2-a197-d869839acbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:02.529477 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ec84a-4ebf-46f2-a197-d869839acbf9 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:02.530402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ec84a-4ebf-46f2-a197-d869839acbf9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:02.532921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ec84a-4ebf-46f2-a197-d869839acbf9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:02.536564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:02.563898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 62/111] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:02.567596 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf30940-6177-455c-8b92-5e65b76f1fba None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:02.635275 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 50/112] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Jun 17 07:15:02 2022] POST /identity/v3/projects => generated 302 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:15:02.636872 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc898a-f916-42b2-b1e1-372fa1eadf52 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:02.637427 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc898a-f916-42b2-b1e1-372fa1eadf52 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:02.637531 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc898a-f916-42b2-b1e1-372fa1eadf52 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:02.638857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 51/113] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:02.643856 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc898a-f916-42b2-b1e1-372fa1eadf52 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:02.683488 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:02.714509 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf30940-6177-455c-8b92-5e65b76f1fba None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:02.764299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a200e-851a-440c-801a-f44ce4087453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:02.764299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a200e-851a-440c-801a-f44ce4087453 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:02.764299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a200e-851a-440c-801a-f44ce4087453 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:02.764299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a200e-851a-440c-801a-f44ce4087453 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:02.776215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a200e-851a-440c-801a-f44ce4087453 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:02.785287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-9a2a200e-851a-440c-801a-f44ce4087453 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:02.785287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:02.785287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:02.785287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:02.785287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:02.785287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:02.785287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:02.785287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:02.785287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:02.785287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:02.785287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:02.785287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:02.785287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:02.785287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:02.785287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:02.785287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:02.786272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:02.786272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:02.786272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:02.786272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:02.786272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:02.786272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:02.786272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:02.786272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:02.786272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:02.786272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:02.786272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:02.786272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:02.786272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:02.786272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:02.786272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:02.786272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:02.787059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:02.787059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:02.787059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:02.787059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:02.787059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:02.787059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:02.787059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:02.787059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:02.787059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:02.787059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:02.787059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:02.787059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:02.788623 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 63/114] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:15:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:02.788763 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1398d-6d3e-4a66-a08f-64e12592d42d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:02.789355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1398d-6d3e-4a66-a08f-64e12592d42d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:02.789355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1398d-6d3e-4a66-a08f-64e12592d42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:02.810692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-2de1398d-6d3e-4a66-a08f-64e12592d42d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:02.811936 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2de1398d-6d3e-4a66-a08f-64e12592d42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:02.849631 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:02.896600 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 64/115] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:02.905883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1398d-6d3e-4a66-a08f-64e12592d42d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:02.935886 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc898a-f916-42b2-b1e1-372fa1eadf52 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:02.983514 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab3d4b-8d45-4a16-86be-b6cdd4d67c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:02.984511 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab3d4b-8d45-4a16-86be-b6cdd4d67c12 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:02.985354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab3d4b-8d45-4a16-86be-b6cdd4d67c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:02.985860 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab3d4b-8d45-4a16-86be-b6cdd4d67c12 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:02.998432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab3d4b-8d45-4a16-86be-b6cdd4d67c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:03.007118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-bbab3d4b-8d45-4a16-86be-b6cdd4d67c12 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:03.007118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:03.007118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:03.007118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:03.007118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:03.007118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:03.007118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:03.007118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:03.007118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:03.007118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:03.007118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:03.007118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:03.007118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:03.007118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:03.007118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:03.007118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:03.009299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:03.009299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:03.009299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:03.009299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:03.009299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:03.009299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:03.009299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:03.009299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:03.009299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:03.009299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:03.009299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:03.009299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:03.009299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:03.009299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:03.009299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:03.009299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:03.011243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:03.011243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:03.011243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:03.011243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:03.011243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:03.011243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:03.011243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:03.011243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:03.011243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:03.011243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:03.011243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:03.011243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:03.011243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 52/116] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:03.011243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab3d4b-8d45-4a16-86be-b6cdd4d67c12 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:03.060373 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1398d-6d3e-4a66-a08f-64e12592d42d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:03.107333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:03.111688 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a119a16-ed37-400e-af2f-0e9882fd16df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:03.112369 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119a16-ed37-400e-af2f-0e9882fd16df None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:03.112652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119a16-ed37-400e-af2f-0e9882fd16df None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:03.112927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119a16-ed37-400e-af2f-0e9882fd16df None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:03.113737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a119a16-ed37-400e-af2f-0e9882fd16df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:03.114018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a119a16-ed37-400e-af2f-0e9882fd16df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:03.115433 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a119a16-ed37-400e-af2f-0e9882fd16df None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:03.125194 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 65/117] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:03.125945 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a119a16-ed37-400e-af2f-0e9882fd16df None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:03.148323 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab3d4b-8d45-4a16-86be-b6cdd4d67c12 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:03.167085 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:03.183290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc13812-edb6-45af-924a-0e32d9eaceae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:03.184472 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc13812-edb6-45af-924a-0e32d9eaceae None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:03.184599 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc13812-edb6-45af-924a-0e32d9eaceae None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:03.184782 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc13812-edb6-45af-924a-0e32d9eaceae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:03.197285 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc13812-edb6-45af-924a-0e32d9eaceae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:03.211428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9bc13812-edb6-45af-924a-0e32d9eaceae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:03.211428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:03.211428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:03.211428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:03.211428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:03.211428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:03.211428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:03.211428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:03.211428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:03.211428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:03.211428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:03.211428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:03.211428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:03.211428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:03.211428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:03.211428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:03.212342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:03.212342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:03.212342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:03.212342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:03.212342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:03.212342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:03.212342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:03.212342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:03.212342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:03.212342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:03.212342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:03.212342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:03.212342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:03.212342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:03.212342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:03.212342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:03.213603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:03.213603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:03.213603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:03.213603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:03.213603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:03.213603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:03.213603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:03.213603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:03.213603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:03.213603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:03.213603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:03.213603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:03.213603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 53/118] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:03.218731 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1c98d-b9fe-48dc-bf65-548748ab5ed5 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:03.219031 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1c98d-b9fe-48dc-bf65-548748ab5ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:03.220195 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1c98d-b9fe-48dc-bf65-548748ab5ed5 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:03.221704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 54/119] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:03.225846 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1c98d-b9fe-48dc-bf65-548748ab5ed5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:03.271179 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a119a16-ed37-400e-af2f-0e9882fd16df None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:03.310639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b5190-d09d-4a09-ab62-b636fdfe0aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:03.311469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b5190-d09d-4a09-ab62-b636fdfe0aeb None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:03.311581 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b5190-d09d-4a09-ab62-b636fdfe0aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:03.311784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b5190-d09d-4a09-ab62-b636fdfe0aeb None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:03.312545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b5190-d09d-4a09-ab62-b636fdfe0aeb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:03.312899 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b5190-d09d-4a09-ab62-b636fdfe0aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:03.314711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b5190-d09d-4a09-ab62-b636fdfe0aeb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:03.328273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 66/120] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:03.329550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b5190-d09d-4a09-ab62-b636fdfe0aeb None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:03.357759 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1c98d-b9fe-48dc-bf65-548748ab5ed5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:03.400911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:03.416050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae019b9c-bd0d-4b69-8a0a-e525715dea7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:03.421305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae019b9c-bd0d-4b69-8a0a-e525715dea7f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:03.421305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae019b9c-bd0d-4b69-8a0a-e525715dea7f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:03.421305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae019b9c-bd0d-4b69-8a0a-e525715dea7f None admin] PATH_INFO: `/v3/users/5c26ce8b01664633a37c5e3b13519935` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:03.421305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae019b9c-bd0d-4b69-8a0a-e525715dea7f None admin] RBAC: Authorizing `identity:get_user(user_id=5c26ce8b01664633a37c5e3b13519935)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:03.423292 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae019b9c-bd0d-4b69-8a0a-e525715dea7f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:03.425155 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 55/121] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:03 2022] GET /identity/v3/users/5c26ce8b01664633a37c5e3b13519935 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:03.426564 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25d46e-b036-408c-a689-079e6d9e1f5e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:03.427175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25d46e-b036-408c-a689-079e6d9e1f5e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:03.427592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25d46e-b036-408c-a689-079e6d9e1f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:03.435095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:03.446564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b5190-d09d-4a09-ab62-b636fdfe0aeb None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:03.454474 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3e25d46e-b036-408c-a689-079e6d9e1f5e None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:03.456293 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3e25d46e-b036-408c-a689-079e6d9e1f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:03.485731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51ea39-a5ba-47ea-89f2-1d032651d55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:03.486508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51ea39-a5ba-47ea-89f2-1d032651d55c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:03.486895 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51ea39-a5ba-47ea-89f2-1d032651d55c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:03.487313 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51ea39-a5ba-47ea-89f2-1d032651d55c None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:03.488152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51ea39-a5ba-47ea-89f2-1d032651d55c None admin] RBAC: Adding query filter params (name=member) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:03.488596 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51ea39-a5ba-47ea-89f2-1d032651d55c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:03.490345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51ea39-a5ba-47ea-89f2-1d032651d55c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:03.499973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 67/122] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:03.501413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51ea39-a5ba-47ea-89f2-1d032651d55c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:03.544912 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 56/123] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:03.550599 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25d46e-b036-408c-a689-079e6d9e1f5e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:03.628130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51ea39-a5ba-47ea-89f2-1d032651d55c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:03.681711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16068648-52a8-4b58-a8b0-5fe16a994248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:03.683356 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16068648-52a8-4b58-a8b0-5fe16a994248 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:03.684376 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16068648-52a8-4b58-a8b0-5fe16a994248 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:03.685002 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16068648-52a8-4b58-a8b0-5fe16a994248 None admin] PATH_INFO: `/v3/users/2cfa7e673552447293ddae6e53bbdff7` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:03.687149 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25d46e-b036-408c-a689-079e6d9e1f5e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:03.704714 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16068648-52a8-4b58-a8b0-5fe16a994248 None admin] RBAC: Authorizing `identity:get_user(user_id=2cfa7e673552447293ddae6e53bbdff7)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:03.706978 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16068648-52a8-4b58-a8b0-5fe16a994248 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:03.709377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 68/124] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:03 2022] GET /identity/v3/users/2cfa7e673552447293ddae6e53bbdff7 => generated 289 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:03.710381 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16068648-52a8-4b58-a8b0-5fe16a994248 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:03.725618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:03.727607 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:03.731258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b33ec-8f29-4968-bc3e-edb9f766e1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:03.732334 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b33ec-8f29-4968-bc3e-edb9f766e1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:03.732954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b33ec-8f29-4968-bc3e-edb9f766e1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:03.733066 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b33ec-8f29-4968-bc3e-edb9f766e1a5 None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:03.734570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b33ec-8f29-4968-bc3e-edb9f766e1a5 None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:03.737364 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b33ec-8f29-4968-bc3e-edb9f766e1a5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:03.741100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 57/125] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:03 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:03.741100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b33ec-8f29-4968-bc3e-edb9f766e1a5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:03.838648 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16068648-52a8-4b58-a8b0-5fe16a994248 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:03.851249 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b33ec-8f29-4968-bc3e-edb9f766e1a5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:03.883846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad7ddb-4518-4f6c-aa66-17b7efaca738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:03.885294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad7ddb-4518-4f6c-aa66-17b7efaca738 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:03.885868 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad7ddb-4518-4f6c-aa66-17b7efaca738 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:03.886393 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad7ddb-4518-4f6c-aa66-17b7efaca738 None admin] PATH_INFO: `/v3/users/30b6406c9904428284345736fa549292` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:03.887999 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad7ddb-4518-4f6c-aa66-17b7efaca738 None admin] RBAC: Authorizing `identity:get_user(user_id=30b6406c9904428284345736fa549292)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:03.888389 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d9a27-6c25-4687-ad22-369e48c4720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:03.889401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d9a27-6c25-4687-ad22-369e48c4720d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:03.889791 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d9a27-6c25-4687-ad22-369e48c4720d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:03.890123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad7ddb-4518-4f6c-aa66-17b7efaca738 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:03.890230 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d9a27-6c25-4687-ad22-369e48c4720d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:03.892452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 69/126] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:03 2022] GET /identity/v3/users/30b6406c9904428284345736fa549292 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:03.893670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad7ddb-4518-4f6c-aa66-17b7efaca738 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:03.902348 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d9a27-6c25-4687-ad22-369e48c4720d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:03.911268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a49d9a27-6c25-4687-ad22-369e48c4720d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:03.911268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:03.911268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:03.911268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:03.911268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:03.911268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:03.911268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:03.911268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:03.911268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:03.911268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:03.911268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:03.911268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:03.911268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:03.911268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:03.911268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:03.911268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:03.912402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:03.912402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:03.912402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:03.912402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:03.912402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:03.912402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:03.912402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:03.912402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:03.912402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:03.912402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:03.912402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:03.912402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:03.912402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:03.912402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:03.912402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:03.912402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:03.913374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:03.913374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:03.913374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:03.913374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:03.913374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:03.913374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:03.913374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:03.913374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:03.913374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:03.913374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:03.913374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:03.913374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:03.919763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 58/127] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:15:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:03.919763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d9a27-6c25-4687-ad22-369e48c4720d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:03.983195 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:03.990495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:04.013125 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad7ddb-4518-4f6c-aa66-17b7efaca738 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:04.029773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d9a27-6c25-4687-ad22-369e48c4720d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:04.049022 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1b0d9-1425-4f34-9bb2-3c496bec8fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:04.050103 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1b0d9-1425-4f34-9bb2-3c496bec8fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.050600 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1b0d9-1425-4f34-9bb2-3c496bec8fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.051076 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1b0d9-1425-4f34-9bb2-3c496bec8fc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.071309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f400058-9887-44be-ad2e-ef7f7167c5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:04.072323 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f400058-9887-44be-ad2e-ef7f7167c5ee None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.072613 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f400058-9887-44be-ad2e-ef7f7167c5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.073258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f400058-9887-44be-ad2e-ef7f7167c5ee None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f/users/5c26ce8b01664633a37c5e3b13519935/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.075161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f400058-9887-44be-ad2e-ef7f7167c5ee None admin] RBAC: Authorizing `identity:create_grant(project_id=89c6b2302f0d4de4a8c94b498362991f, user_id=5c26ce8b01664633a37c5e3b13519935, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:04.076667 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f400058-9887-44be-ad2e-ef7f7167c5ee None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:04.134069 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1b0d9-1425-4f34-9bb2-3c496bec8fc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:04.135581 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1b0d9-1425-4f34-9bb2-3c496bec8fc6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:04.163800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 59/128] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:15:03 2022] PUT /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f/users/5c26ce8b01664633a37c5e3b13519935/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:15:04.167604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f400058-9887-44be-ad2e-ef7f7167c5ee None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:04.251679 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:04.285276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f400058-9887-44be-ad2e-ef7f7167c5ee None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:04.287996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 70/129] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:04.290332 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1b0d9-1425-4f34-9bb2-3c496bec8fc6 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:04.308543 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:04.334162 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b26da3-a9bb-4709-8b6a-3802d12f93e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:04.335676 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b26da3-a9bb-4709-8b6a-3802d12f93e4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.336361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b26da3-a9bb-4709-8b6a-3802d12f93e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.337503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b26da3-a9bb-4709-8b6a-3802d12f93e4 None admin] PATH_INFO: `/v3/projects/d229605d5dbf4cdb8969b905797b8003` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.339263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b26da3-a9bb-4709-8b6a-3802d12f93e4 None admin] RBAC: Authorizing `identity:get_project(project_id=d229605d5dbf4cdb8969b905797b8003)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:04.342113 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b26da3-a9bb-4709-8b6a-3802d12f93e4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:04.344184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 60/130] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:04 2022] GET /identity/v3/projects/d229605d5dbf4cdb8969b905797b8003 => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:04.347737 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c4ee6-96a3-4229-aa72-e78843c02263 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.349851 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c4ee6-96a3-4229-aa72-e78843c02263 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.350346 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c4ee6-96a3-4229-aa72-e78843c02263 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.352597 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 61/131] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:04.353708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c4ee6-96a3-4229-aa72-e78843c02263 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:04.422775 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1b0d9-1425-4f34-9bb2-3c496bec8fc6 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:04.462296 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72342296-b73d-4d45-9e5b-d74f78fa3ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:04.463004 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72342296-b73d-4d45-9e5b-d74f78fa3ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.463347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72342296-b73d-4d45-9e5b-d74f78fa3ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.463630 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72342296-b73d-4d45-9e5b-d74f78fa3ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.464808 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72342296-b73d-4d45-9e5b-d74f78fa3ec1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:04.465312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72342296-b73d-4d45-9e5b-d74f78fa3ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:04.466871 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72342296-b73d-4d45-9e5b-d74f78fa3ec1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:04.478727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 71/132] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:04.480348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e415f-b2a4-4613-b400-97c661c0984a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.480641 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e415f-b2a4-4613-b400-97c661c0984a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.480923 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e415f-b2a4-4613-b400-97c661c0984a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.490342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c4ee6-96a3-4229-aa72-e78843c02263 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:04.503053 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-076e415f-b2a4-4613-b400-97c661c0984a None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:04.504673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-076e415f-b2a4-4613-b400-97c661c0984a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:04.530765 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b63443-2961-45fe-bc08-5f7cd25857d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:04.532749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b63443-2961-45fe-bc08-5f7cd25857d0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.533239 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b63443-2961-45fe-bc08-5f7cd25857d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.533811 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b63443-2961-45fe-bc08-5f7cd25857d0 None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.535345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b63443-2961-45fe-bc08-5f7cd25857d0 None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:04.537238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b63443-2961-45fe-bc08-5f7cd25857d0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:04.539396 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 62/133] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:04 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:04.540359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b63443-2961-45fe-bc08-5f7cd25857d0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:04.565716 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:04.583900 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 72/134] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:04.585165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e415f-b2a4-4613-b400-97c661c0984a None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:04.629254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:04.696075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b63443-2961-45fe-bc08-5f7cd25857d0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:04.715058 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e415f-b2a4-4613-b400-97c661c0984a None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:04.740892 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8603b3-3bf0-4530-96ec-8b8abe11b9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:04.741788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8603b3-3bf0-4530-96ec-8b8abe11b9aa None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.742074 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8603b3-3bf0-4530-96ec-8b8abe11b9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.742582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8603b3-3bf0-4530-96ec-8b8abe11b9aa None admin] PATH_INFO: `/v3/projects/d229605d5dbf4cdb8969b905797b8003/users/30b6406c9904428284345736fa549292/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.745340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8603b3-3bf0-4530-96ec-8b8abe11b9aa None admin] RBAC: Authorizing `identity:create_grant(project_id=d229605d5dbf4cdb8969b905797b8003, user_id=30b6406c9904428284345736fa549292, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:04.747472 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8603b3-3bf0-4530-96ec-8b8abe11b9aa None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:04.757294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e0954-91b5-447b-93bf-42890afd6ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:04.758493 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e0954-91b5-447b-93bf-42890afd6ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.758977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e0954-91b5-447b-93bf-42890afd6ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.759477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e0954-91b5-447b-93bf-42890afd6ae9 None admin] PATH_INFO: `/v3/users/30b6406c9904428284345736fa549292` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.760937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e0954-91b5-447b-93bf-42890afd6ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=30b6406c9904428284345736fa549292)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:04.762634 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e0954-91b5-447b-93bf-42890afd6ae9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:04.764779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 73/135] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:04 2022] GET /identity/v3/users/30b6406c9904428284345736fa549292 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:04.766018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e0954-91b5-447b-93bf-42890afd6ae9 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:04.811886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:04.834967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 63/136] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:15:04 2022] PUT /identity/v3/projects/d229605d5dbf4cdb8969b905797b8003/users/30b6406c9904428284345736fa549292/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:15:04.841803 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8603b3-3bf0-4530-96ec-8b8abe11b9aa None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:04.889984 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e0954-91b5-447b-93bf-42890afd6ae9 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:04.935248 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92391757-e5cd-41e0-a8b1-a8e80d2de2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:04.936576 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92391757-e5cd-41e0-a8b1-a8e80d2de2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.937056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92391757-e5cd-41e0-a8b1-a8e80d2de2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.937816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92391757-e5cd-41e0-a8b1-a8e80d2de2e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.939104 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92391757-e5cd-41e0-a8b1-a8e80d2de2e4 None admin] RBAC: Adding query filter params (role.id=66d59f53ac4c4817bc23b4588234e3ad, scope.project.id=89c6b2302f0d4de4a8c94b498362991f, user.id=2cfa7e673552447293ddae6e53bbdff7) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:04.940035 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92391757-e5cd-41e0-a8b1-a8e80d2de2e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:04.942114 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92391757-e5cd-41e0-a8b1-a8e80d2de2e4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:04.949172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 74/137] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:04 2022] GET /identity/v3/role_assignments?user.id=2cfa7e673552447293ddae6e53bbdff7&scope.project.id=89c6b2302f0d4de4a8c94b498362991f&role.id=66d59f53ac4c4817bc23b4588234e3ad => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:04.950818 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92391757-e5cd-41e0-a8b1-a8e80d2de2e4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:05.059646 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8603b3-3bf0-4530-96ec-8b8abe11b9aa None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:05.083514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92391757-e5cd-41e0-a8b1-a8e80d2de2e4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:05.085922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:05.092365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:05.127268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614bf7c-c26d-4e74-91ef-53a1ce2ff2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:05.128694 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614bf7c-c26d-4e74-91ef-53a1ce2ff2bc None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:05.129194 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614bf7c-c26d-4e74-91ef-53a1ce2ff2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:05.129691 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614bf7c-c26d-4e74-91ef-53a1ce2ff2bc None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:05.132878 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614bf7c-c26d-4e74-91ef-53a1ce2ff2bc None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:05.134894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614bf7c-c26d-4e74-91ef-53a1ce2ff2bc None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:05.137428 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 75/138] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:04 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:05.145611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614bf7c-c26d-4e74-91ef-53a1ce2ff2bc None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:05.149053 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77941011-a6a3-4d55-873c-b11f571b6f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:05.149773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77941011-a6a3-4d55-873c-b11f571b6f73 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:05.150064 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77941011-a6a3-4d55-873c-b11f571b6f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:05.150346 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77941011-a6a3-4d55-873c-b11f571b6f73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:05.180092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77941011-a6a3-4d55-873c-b11f571b6f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:05.193229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-77941011-a6a3-4d55-873c-b11f571b6f73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:05.193229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:05.193229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:05.193229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:05.193229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:05.193229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:05.193229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:05.193229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:05.193229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:05.193229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:05.193229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:05.193229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:05.193229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:05.193229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:05.193229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:05.193229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:05.194154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:05.194154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:05.194154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:05.194154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:05.194154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:05.194154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:05.194154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:05.194154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:05.194154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:05.194154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:05.194154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:05.194154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:05.194154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:05.194154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:05.194154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:05.194154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:05.194923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:05.194923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:05.194923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:05.194923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:05.194923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:05.194923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:05.194923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:05.194923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:05.194923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:05.194923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:05.194923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:05.194923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:05.194923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 64/139] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:05.206431 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77941011-a6a3-4d55-873c-b11f571b6f73 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:05.288563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614bf7c-c26d-4e74-91ef-53a1ce2ff2bc None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:05.330308 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77941011-a6a3-4d55-873c-b11f571b6f73 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:05.347087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bdbe0-663f-4f6c-8c9d-54405d7c5442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:05.348511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bdbe0-663f-4f6c-8c9d-54405d7c5442 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:05.348944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bdbe0-663f-4f6c-8c9d-54405d7c5442 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:05.349557 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bdbe0-663f-4f6c-8c9d-54405d7c5442 None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f/users/30b6406c9904428284345736fa549292/roles/930830d015f94e249715290654948151` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:05.357816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473bdbe0-663f-4f6c-8c9d-54405d7c5442 None admin] RBAC: Authorizing `identity:create_grant(project_id=89c6b2302f0d4de4a8c94b498362991f, user_id=30b6406c9904428284345736fa549292, role_id=930830d015f94e249715290654948151)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:05.359293 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473bdbe0-663f-4f6c-8c9d-54405d7c5442 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:05.383464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80549796-b6c7-404b-80f5-b9725302f0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:05.384533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549796-b6c7-404b-80f5-b9725302f0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:05.385009 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549796-b6c7-404b-80f5-b9725302f0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:05.385659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549796-b6c7-404b-80f5-b9725302f0a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:05.386621 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80549796-b6c7-404b-80f5-b9725302f0a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:05.387103 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80549796-b6c7-404b-80f5-b9725302f0a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:05.388724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80549796-b6c7-404b-80f5-b9725302f0a7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:05.398445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 65/140] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:05.400032 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f023-2425-4696-91f6-b75cbf60d340 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:05.400492 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f023-2425-4696-91f6-b75cbf60d340 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:05.400981 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f023-2425-4696-91f6-b75cbf60d340 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:05.402447 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 66/141] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:05.407328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820f023-2425-4696-91f6-b75cbf60d340 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:05.446286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:05.457751 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 76/142] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:15:05 2022] PUT /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f/users/30b6406c9904428284345736fa549292/roles/930830d015f94e249715290654948151 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:15:05.458948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa5d73-bf6d-4126-a619-fd9936e1225f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:05.459242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa5d73-bf6d-4126-a619-fd9936e1225f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:05.459520 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa5d73-bf6d-4126-a619-fd9936e1225f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:05.497162 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0caa5d73-bf6d-4126-a619-fd9936e1225f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:05.498514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0caa5d73-bf6d-4126-a619-fd9936e1225f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:05.527073 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820f023-2425-4696-91f6-b75cbf60d340 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:05.561911 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:05.603467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba8fd4-e381-49df-bc83-89fc6ebcaf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:05.605114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba8fd4-e381-49df-bc83-89fc6ebcaf98 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:05.605420 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba8fd4-e381-49df-bc83-89fc6ebcaf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:05.605695 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba8fd4-e381-49df-bc83-89fc6ebcaf98 None admin] PATH_INFO: `/v3/users/30b6406c9904428284345736fa549292` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:05.606955 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba8fd4-e381-49df-bc83-89fc6ebcaf98 None admin] RBAC: Authorizing `identity:get_user(user_id=30b6406c9904428284345736fa549292)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:05.608389 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba8fd4-e381-49df-bc83-89fc6ebcaf98 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:05.610411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 67/143] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:05 2022] GET /identity/v3/users/30b6406c9904428284345736fa549292 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:05.618754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba8fd4-e381-49df-bc83-89fc6ebcaf98 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:05.652321 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 77/144] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:05.715243 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa5d73-bf6d-4126-a619-fd9936e1225f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:05.795492 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba8fd4-e381-49df-bc83-89fc6ebcaf98 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:05.802527 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:05.836907 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa5d73-bf6d-4126-a619-fd9936e1225f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:05.877368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6657b6f-b2b4-4918-80fe-665abff248ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:05.878434 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6657b6f-b2b4-4918-80fe-665abff248ae None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:05.878862 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6657b6f-b2b4-4918-80fe-665abff248ae None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:05.879278 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6657b6f-b2b4-4918-80fe-665abff248ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:05.880623 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6657b6f-b2b4-4918-80fe-665abff248ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:05.882028 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c3212-dc58-43ad-9276-8e26139c1a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:05.882459 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6657b6f-b2b4-4918-80fe-665abff248ae None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:05.882703 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c3212-dc58-43ad-9276-8e26139c1a86 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:05.882993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c3212-dc58-43ad-9276-8e26139c1a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:05.883275 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c3212-dc58-43ad-9276-8e26139c1a86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:05.885033 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 78/145] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:05.891787 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6657b6f-b2b4-4918-80fe-665abff248ae None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:05.945387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:06.011662 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c3212-dc58-43ad-9276-8e26139c1a86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:06.013256 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c3212-dc58-43ad-9276-8e26139c1a86 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:06.026581 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6657b6f-b2b4-4918-80fe-665abff248ae None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:06.062944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b6e19-fde3-442d-b87e-ed05a27558dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:06.063992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b6e19-fde3-442d-b87e-ed05a27558dd None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:06.064462 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b6e19-fde3-442d-b87e-ed05a27558dd None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:06.064938 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b6e19-fde3-442d-b87e-ed05a27558dd None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:06.065865 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b6e19-fde3-442d-b87e-ed05a27558dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:06.067571 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b6e19-fde3-442d-b87e-ed05a27558dd None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:06.148928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 79/146] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:15:05 2022] POST /identity/v3/users => generated 283 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:15:06.153631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 68/147] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:06.160041 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b6e19-fde3-442d-b87e-ed05a27558dd None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:06.278869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:06.299720 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b6e19-fde3-442d-b87e-ed05a27558dd None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:06.341612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00ffdc-f646-49f1-b402-7692f024d5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:06.342788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00ffdc-f646-49f1-b402-7692f024d5aa None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:06.343251 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00ffdc-f646-49f1-b402-7692f024d5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:06.343692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00ffdc-f646-49f1-b402-7692f024d5aa None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:06.345682 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00ffdc-f646-49f1-b402-7692f024d5aa None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:06.347499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00ffdc-f646-49f1-b402-7692f024d5aa None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:06.349716 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 80/148] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:06 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:06.357503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c3212-dc58-43ad-9276-8e26139c1a86 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:06.362143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:06.465414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c3212-dc58-43ad-9276-8e26139c1a86 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:06.503108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef47a6-30c6-4f5b-839d-7ffd47f7eda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:06.503777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef47a6-30c6-4f5b-839d-7ffd47f7eda0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:06.504061 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef47a6-30c6-4f5b-839d-7ffd47f7eda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:06.504339 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef47a6-30c6-4f5b-839d-7ffd47f7eda0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:06.505177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef47a6-30c6-4f5b-839d-7ffd47f7eda0 None admin] RBAC: Adding query filter params (role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0, scope.project.id=89c6b2302f0d4de4a8c94b498362991f, user.id=30b6406c9904428284345736fa549292) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:06.505511 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef47a6-30c6-4f5b-839d-7ffd47f7eda0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:06.506962 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef47a6-30c6-4f5b-839d-7ffd47f7eda0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:06.513300 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 69/149] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:06 2022] GET /identity/v3/role_assignments?user.id=30b6406c9904428284345736fa549292&scope.project.id=89c6b2302f0d4de4a8c94b498362991f&role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:06.861217 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff3b4d-4321-436c-91b4-51720cd7f61b None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:06.861868 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff3b4d-4321-436c-91b4-51720cd7f61b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:06.862334 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff3b4d-4321-436c-91b4-51720cd7f61b None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:06.864139 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 81/150] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:06.869825 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cf5b1-dc8f-466a-98e6-4a0a76b86c49 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:06.870717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cf5b1-dc8f-466a-98e6-4a0a76b86c49 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:06.871187 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cf5b1-dc8f-466a-98e6-4a0a76b86c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:06.890597 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2d6cf5b1-dc8f-466a-98e6-4a0a76b86c49 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:06.892488 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2d6cf5b1-dc8f-466a-98e6-4a0a76b86c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:06.962412 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:06.968066 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 70/151] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:06.992127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff3b4d-4321-436c-91b4-51720cd7f61b None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:07.102651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff3b4d-4321-436c-91b4-51720cd7f61b None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:07.139160 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a851ae1-33da-4407-bfb6-6d5bc5899097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:07.139966 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a851ae1-33da-4407-bfb6-6d5bc5899097 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:07.140245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a851ae1-33da-4407-bfb6-6d5bc5899097 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:07.140578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a851ae1-33da-4407-bfb6-6d5bc5899097 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:07.152368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a851ae1-33da-4407-bfb6-6d5bc5899097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:07.161213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-6a851ae1-33da-4407-bfb6-6d5bc5899097 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:07.161213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:07.161213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:07.161213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:07.161213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:07.161213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:07.161213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:07.161213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:07.161213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:07.161213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:07.161213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:07.161213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:07.161213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:07.161213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:07.161213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:07.161213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:07.162165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:07.162165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:07.162165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:07.162165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:07.162165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:07.162165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:07.162165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:07.162165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:07.162165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:07.162165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:07.162165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:07.162165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:07.162165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:07.162165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:07.162165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:07.162165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:07.162950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:07.162950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:07.162950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:07.162950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:07.162950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:07.162950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:07.162950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:07.162950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:07.162950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:07.162950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:07.162950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:07.162950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:07.162950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 82/152] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:15:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:07.168733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cf5b1-dc8f-466a-98e6-4a0a76b86c49 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:07.272337 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cf5b1-dc8f-466a-98e6-4a0a76b86c49 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:07.307475 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2073c-3ace-484a-bd23-2cf74deb8ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:07.308152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2073c-3ace-484a-bd23-2cf74deb8ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:07.308428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2073c-3ace-484a-bd23-2cf74deb8ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:07.308698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2073c-3ace-484a-bd23-2cf74deb8ec2 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:07.309536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2073c-3ace-484a-bd23-2cf74deb8ec2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:07.309840 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2073c-3ace-484a-bd23-2cf74deb8ec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:07.311262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2073c-3ace-484a-bd23-2cf74deb8ec2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:07.320704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 71/153] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:07.326273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a851ae1-33da-4407-bfb6-6d5bc5899097 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:07.342436 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:07.434830 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a851ae1-33da-4407-bfb6-6d5bc5899097 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:07.472020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e508b4-2acf-4926-b690-835e5fdffaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:07.472895 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e508b4-2acf-4926-b690-835e5fdffaac None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:07.473172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e508b4-2acf-4926-b690-835e5fdffaac None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:07.473463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e508b4-2acf-4926-b690-835e5fdffaac None admin] PATH_INFO: `/v3/users/5c26ce8b01664633a37c5e3b13519935` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:07.474674 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e508b4-2acf-4926-b690-835e5fdffaac None admin] RBAC: Authorizing `identity:get_user(user_id=5c26ce8b01664633a37c5e3b13519935)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:07.476131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e508b4-2acf-4926-b690-835e5fdffaac None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:07.478098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 83/154] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:07 2022] GET /identity/v3/users/5c26ce8b01664633a37c5e3b13519935 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:07.486531 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2073c-3ace-484a-bd23-2cf74deb8ec2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:07.557881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:07.612320 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2073c-3ace-484a-bd23-2cf74deb8ec2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:07.660522 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed21c1-9fe5-46bb-8606-c382b47babfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:07.661177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed21c1-9fe5-46bb-8606-c382b47babfd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:07.661482 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed21c1-9fe5-46bb-8606-c382b47babfd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:07.661758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed21c1-9fe5-46bb-8606-c382b47babfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:07.755399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed21c1-9fe5-46bb-8606-c382b47babfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:07.756859 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed21c1-9fe5-46bb-8606-c382b47babfd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:07.830882 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:07.883966 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 72/155] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:07.889905 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e508b4-2acf-4926-b690-835e5fdffaac None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:07.928132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3d445-5797-4a59-a955-363fc02f2b4d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:07.928445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3d445-5797-4a59-a955-363fc02f2b4d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:07.928687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3d445-5797-4a59-a955-363fc02f2b4d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:07.930394 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 73/156] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:07.935603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f330d9-3a1d-4ee3-b3d4-3b1453f0d468 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:07.935886 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f330d9-3a1d-4ee3-b3d4-3b1453f0d468 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:07.936161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f330d9-3a1d-4ee3-b3d4-3b1453f0d468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:07.956718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-24f330d9-3a1d-4ee3-b3d4-3b1453f0d468 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:07.957930 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-24f330d9-3a1d-4ee3-b3d4-3b1453f0d468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:08.024076 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:08.059961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e508b4-2acf-4926-b690-835e5fdffaac None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:08.064286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 74/157] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:15:08.113899 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424980c-1929-4ba4-a03f-961f8464f2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:08.114716 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424980c-1929-4ba4-a03f-961f8464f2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.114994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424980c-1929-4ba4-a03f-961f8464f2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.115271 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424980c-1929-4ba4-a03f-961f8464f2d5 None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.116524 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424980c-1929-4ba4-a03f-961f8464f2d5 None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:08.118116 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424980c-1929-4ba4-a03f-961f8464f2d5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:08.119819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 84/158] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:07 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:08.126609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f330d9-3a1d-4ee3-b3d4-3b1453f0d468 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:08.150213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424980c-1929-4ba4-a03f-961f8464f2d5 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:08.287795 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:08.302225 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f330d9-3a1d-4ee3-b3d4-3b1453f0d468 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:08.313701 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424980c-1929-4ba4-a03f-961f8464f2d5 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:08.354968 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c973b-d2f5-4f2a-8180-f8f1e102d1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:08.355632 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c973b-d2f5-4f2a-8180-f8f1e102d1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.355910 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c973b-d2f5-4f2a-8180-f8f1e102d1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.356184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c973b-d2f5-4f2a-8180-f8f1e102d1f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.357014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c973b-d2f5-4f2a-8180-f8f1e102d1f1 None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=89c6b2302f0d4de4a8c94b498362991f, user.id=5c26ce8b01664633a37c5e3b13519935) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:08.357338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c973b-d2f5-4f2a-8180-f8f1e102d1f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:08.358775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c973b-d2f5-4f2a-8180-f8f1e102d1f1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:08.380193 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 75/159] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:08 2022] GET /identity/v3/role_assignments?user.id=5c26ce8b01664633a37c5e3b13519935&scope.project.id=89c6b2302f0d4de4a8c94b498362991f&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:08.381538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17050590-b567-4dcd-b434-592b1df1856d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.381826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17050590-b567-4dcd-b434-592b1df1856d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.382097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17050590-b567-4dcd-b434-592b1df1856d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.383649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 76/160] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:08.384838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b8731-25ff-4601-b4fe-f1d9bd396455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:08.386106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b8731-25ff-4601-b4fe-f1d9bd396455 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.386106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b8731-25ff-4601-b4fe-f1d9bd396455 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.386106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b8731-25ff-4601-b4fe-f1d9bd396455 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.394100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9c642-fa31-44d2-9766-035a86873a1c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.394674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9c642-fa31-44d2-9766-035a86873a1c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.395586 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9c642-fa31-44d2-9766-035a86873a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.415986 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b8731-25ff-4601-b4fe-f1d9bd396455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:08.424345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-7f4b8731-25ff-4601-b4fe-f1d9bd396455 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:08.424345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:08.424345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:08.424345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:08.424345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:08.424345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:08.424345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:08.424345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:08.424345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:08.424345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:08.424345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:08.424345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:08.424345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:08.424345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:08.424345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:08.424345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:08.425297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:08.425297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:08.425297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:08.425297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:08.425297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:08.425297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:08.425297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:08.425297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:08.425297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:08.425297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:08.425297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:08.425297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:08.425297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:08.425297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:08.425297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:08.425297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:08.427845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:08.427845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:08.427845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:08.427845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:08.427845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:08.427845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:08.427845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:08.427845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:08.427845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:08.427845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:08.427845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:08.427845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:08.427845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 85/161] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:08.431926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-53e9c642-fa31-44d2-9766-035a86873a1c None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:08.433133 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-53e9c642-fa31-44d2-9766-035a86873a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:08.436169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b8731-25ff-4601-b4fe-f1d9bd396455 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:08.456386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:08.548416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 77/162] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:08.558918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b8731-25ff-4601-b4fe-f1d9bd396455 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:08.584850 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9c642-fa31-44d2-9766-035a86873a1c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:08.598416 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7bf44-70bf-4bef-99d4-51522cad5407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:08.599386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7bf44-70bf-4bef-99d4-51522cad5407 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.599839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7bf44-70bf-4bef-99d4-51522cad5407 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.600284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7bf44-70bf-4bef-99d4-51522cad5407 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.601189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7bf44-70bf-4bef-99d4-51522cad5407 None admin] RBAC: Adding query filter params (name=member) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:08.601713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7bf44-70bf-4bef-99d4-51522cad5407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:08.603285 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7bf44-70bf-4bef-99d4-51522cad5407 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:08.613577 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 86/163] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:08.622663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7bf44-70bf-4bef-99d4-51522cad5407 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:08.712393 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:08.750875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7bf44-70bf-4bef-99d4-51522cad5407 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:08.777022 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:08.790409 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d8ad1-a5f3-42b7-aa53-bb274d3294c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:08.791847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d8ad1-a5f3-42b7-aa53-bb274d3294c9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.792467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d8ad1-a5f3-42b7-aa53-bb274d3294c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.792931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d8ad1-a5f3-42b7-aa53-bb274d3294c9 None admin] PATH_INFO: `/v3/users/30b6406c9904428284345736fa549292` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.794337 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d8ad1-a5f3-42b7-aa53-bb274d3294c9 None admin] RBAC: Authorizing `identity:get_user(user_id=30b6406c9904428284345736fa549292)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:08.796772 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d8ad1-a5f3-42b7-aa53-bb274d3294c9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:08.799682 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 87/164] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:08 2022] GET /identity/v3/users/30b6406c9904428284345736fa549292 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:08.801156 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9c642-fa31-44d2-9766-035a86873a1c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:08.805148 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d8ad1-a5f3-42b7-aa53-bb274d3294c9 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:08.858271 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab27b82-0836-4f88-87a3-76ed1571d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:08.858852 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab27b82-0836-4f88-87a3-76ed1571d002 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.859134 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab27b82-0836-4f88-87a3-76ed1571d002 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.859405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab27b82-0836-4f88-87a3-76ed1571d002 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.874313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab27b82-0836-4f88-87a3-76ed1571d002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:08.887151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8ab27b82-0836-4f88-87a3-76ed1571d002 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:08.887151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:08.887151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:08.887151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:08.887151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:08.887151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:08.887151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:08.887151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:08.887151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:08.887151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:08.887151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:08.887151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:08.887151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:08.887151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:08.887151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:08.887151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:08.888562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:08.888562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:08.888562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:08.888562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:08.888562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:08.888562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:08.888562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:08.888562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:08.888562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:08.888562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:08.888562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:08.888562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:08.888562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:08.888562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:08.888562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:08.888562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:08.889366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:08.889366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:08.889366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:08.889366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:08.889366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:08.889366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:08.889366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:08.889366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:08.889366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:08.889366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:08.889366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:08.889366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:08.893431 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 78/165] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:08.894803 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab27b82-0836-4f88-87a3-76ed1571d002 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:08.921874 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d8ad1-a5f3-42b7-aa53-bb274d3294c9 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:08.958754 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73c0a9-5e9b-4250-84a6-fed990ec9a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:08.959741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c0a9-5e9b-4250-84a6-fed990ec9a31 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.960224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c0a9-5e9b-4250-84a6-fed990ec9a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.960690 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c0a9-5e9b-4250-84a6-fed990ec9a31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.985064 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:09.037639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73c0a9-5e9b-4250-84a6-fed990ec9a31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:09.039457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73c0a9-5e9b-4250-84a6-fed990ec9a31 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:09.050829 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab27b82-0836-4f88-87a3-76ed1571d002 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:09.114051 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd71bb3-fc34-4d57-a008-03251bcd5d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:09.115361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd71bb3-fc34-4d57-a008-03251bcd5d35 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:09.115361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd71bb3-fc34-4d57-a008-03251bcd5d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:09.115361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd71bb3-fc34-4d57-a008-03251bcd5d35 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:09.116020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd71bb3-fc34-4d57-a008-03251bcd5d35 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:09.116327 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd71bb3-fc34-4d57-a008-03251bcd5d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:09.117756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd71bb3-fc34-4d57-a008-03251bcd5d35 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:09.132974 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 79/166] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:09.139630 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd71bb3-fc34-4d57-a008-03251bcd5d35 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:09.150848 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 88/167] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:09.153406 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:09.156827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73c0a9-5e9b-4250-84a6-fed990ec9a31 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:09.201712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:09.269946 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73c0a9-5e9b-4250-84a6-fed990ec9a31 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:09.307407 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0f672-385b-4af6-bd33-041ef55805ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:09.308885 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0f672-385b-4af6-bd33-041ef55805ef None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:09.309394 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0f672-385b-4af6-bd33-041ef55805ef None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:09.309939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0f672-385b-4af6-bd33-041ef55805ef None admin] PATH_INFO: `/v3/projects/d229605d5dbf4cdb8969b905797b8003` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:09.311358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0f672-385b-4af6-bd33-041ef55805ef None admin] RBAC: Authorizing `identity:get_project(project_id=d229605d5dbf4cdb8969b905797b8003)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:09.313355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0f672-385b-4af6-bd33-041ef55805ef None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:09.315649 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 89/168] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:09 2022] GET /identity/v3/projects/d229605d5dbf4cdb8969b905797b8003 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:09.315766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd71bb3-fc34-4d57-a008-03251bcd5d35 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:09.317276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205948d-b6da-4621-a420-b4174bdfed43 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:09.317858 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205948d-b6da-4621-a420-b4174bdfed43 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:09.318326 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205948d-b6da-4621-a420-b4174bdfed43 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:09.320047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 90/169] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:09.320929 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205948d-b6da-4621-a420-b4174bdfed43 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:09.371381 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98723155-fb17-4064-9397-2fcea7a7459a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:09.372272 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98723155-fb17-4064-9397-2fcea7a7459a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:09.372552 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98723155-fb17-4064-9397-2fcea7a7459a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:09.372830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98723155-fb17-4064-9397-2fcea7a7459a None admin] PATH_INFO: `/v3/users/2cfa7e673552447293ddae6e53bbdff7` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:09.378088 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98723155-fb17-4064-9397-2fcea7a7459a None admin] RBAC: Authorizing `identity:get_user(user_id=2cfa7e673552447293ddae6e53bbdff7)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:09.379574 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98723155-fb17-4064-9397-2fcea7a7459a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:09.381573 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 80/170] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:09 2022] GET /identity/v3/users/2cfa7e673552447293ddae6e53bbdff7 => generated 289 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:09.382781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5dd92-51db-42fb-ae13-131d2754f9d9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:09.383067 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5dd92-51db-42fb-ae13-131d2754f9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:09.383343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5dd92-51db-42fb-ae13-131d2754f9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:09.422458 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-44b5dd92-51db-42fb-ae13-131d2754f9d9 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:09.423683 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-44b5dd92-51db-42fb-ae13-131d2754f9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:09.434116 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205948d-b6da-4621-a420-b4174bdfed43 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:09.445275 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:09.471905 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80443f-3771-4762-b4f7-106dce37ce47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:09.472910 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80443f-3771-4762-b4f7-106dce37ce47 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:09.473368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80443f-3771-4762-b4f7-106dce37ce47 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:09.476350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80443f-3771-4762-b4f7-106dce37ce47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:09.476350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80443f-3771-4762-b4f7-106dce37ce47 None admin] RBAC: Adding query filter params (role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0, scope.project.id=d229605d5dbf4cdb8969b905797b8003, user.id=30b6406c9904428284345736fa549292) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:09.476350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80443f-3771-4762-b4f7-106dce37ce47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:09.477017 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80443f-3771-4762-b4f7-106dce37ce47 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:09.483858 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 91/171] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:09 2022] GET /identity/v3/role_assignments?user.id=30b6406c9904428284345736fa549292&scope.project.id=d229605d5dbf4cdb8969b905797b8003&role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:09.485096 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80443f-3771-4762-b4f7-106dce37ce47 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:09.548101 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 81/172] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:09.598431 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5dd92-51db-42fb-ae13-131d2754f9d9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:09.599742 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80443f-3771-4762-b4f7-106dce37ce47 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:09.601519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:09.637294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ff35d-735b-44f9-864c-999887f7e5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:09.638580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ff35d-735b-44f9-864c-999887f7e5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:09.639052 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ff35d-735b-44f9-864c-999887f7e5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:09.639515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ff35d-735b-44f9-864c-999887f7e5d3 None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:09.641282 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ff35d-735b-44f9-864c-999887f7e5d3 None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:09.642978 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ff35d-735b-44f9-864c-999887f7e5d3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:09.644894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 92/173] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:09 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:09.651464 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ff35d-735b-44f9-864c-999887f7e5d3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:09.764079 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:09.872621 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5dd92-51db-42fb-ae13-131d2754f9d9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:09.889016 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ff35d-735b-44f9-864c-999887f7e5d3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:09.927200 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85a129-ec05-4335-a8b1-a129abe08c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:09.928151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85a129-ec05-4335-a8b1-a129abe08c57 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:09.928435 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85a129-ec05-4335-a8b1-a129abe08c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:09.928822 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85a129-ec05-4335-a8b1-a129abe08c57 None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f/users/2cfa7e673552447293ddae6e53bbdff7/roles/66d59f53ac4c4817bc23b4588234e3ad` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:09.930972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85a129-ec05-4335-a8b1-a129abe08c57 None admin] RBAC: Authorizing `identity:create_grant(project_id=89c6b2302f0d4de4a8c94b498362991f, user_id=2cfa7e673552447293ddae6e53bbdff7, role_id=66d59f53ac4c4817bc23b4588234e3ad)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:09.932444 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85a129-ec05-4335-a8b1-a129abe08c57 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:09.935881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0875726-8ee1-435f-994c-6761f1c8160c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:09.936845 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0875726-8ee1-435f-994c-6761f1c8160c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:09.937130 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0875726-8ee1-435f-994c-6761f1c8160c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:09.937541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0875726-8ee1-435f-994c-6761f1c8160c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:09.957195 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0875726-8ee1-435f-994c-6761f1c8160c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:09.965739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d0875726-8ee1-435f-994c-6761f1c8160c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:09.965739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:09.965739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:09.965739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:09.965739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:09.965739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:09.965739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:09.965739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:09.965739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:09.965739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:09.965739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:09.965739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:09.965739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:09.965739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:09.965739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:09.965739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:09.966732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:09.966732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:09.966732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:09.966732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:09.966732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:09.966732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:09.966732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:09.966732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:09.966732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:09.966732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:09.966732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:09.966732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:09.966732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:09.966732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:09.966732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:09.966732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:09.967519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:09.967519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:09.967519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:09.967519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:09.967519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:09.967519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:09.967519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:09.967519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:09.967519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:09.967519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:09.967519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:09.967519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:09.967519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 82/174] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:15:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:09.973556 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0875726-8ee1-435f-994c-6761f1c8160c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:10.023231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 93/175] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:15:09 2022] PUT /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f/users/2cfa7e673552447293ddae6e53bbdff7/roles/66d59f53ac4c4817bc23b4588234e3ad => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:15:10.024569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a29b7-228a-4dd1-989c-899a6dcaf6f0 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:10.024859 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a29b7-228a-4dd1-989c-899a6dcaf6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:10.025173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a29b7-228a-4dd1-989c-899a6dcaf6f0 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:10.029870 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 94/176] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:10.036072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fad2e9-50cb-407d-9c8e-09d5260be4de None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:10.036385 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fad2e9-50cb-407d-9c8e-09d5260be4de None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:10.036653 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fad2e9-50cb-407d-9c8e-09d5260be4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:10.047502 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:10.067975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-66fad2e9-50cb-407d-9c8e-09d5260be4de None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:10.069195 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-66fad2e9-50cb-407d-9c8e-09d5260be4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:10.095270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0875726-8ee1-435f-994c-6761f1c8160c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:10.138530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9f140-17ef-456c-af42-38787a2a1c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:10.139137 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9f140-17ef-456c-af42-38787a2a1c22 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:10.139416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9f140-17ef-456c-af42-38787a2a1c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:10.139690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9f140-17ef-456c-af42-38787a2a1c22 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:10.140450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9f140-17ef-456c-af42-38787a2a1c22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:10.141059 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9f140-17ef-456c-af42-38787a2a1c22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:10.142854 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9f140-17ef-456c-af42-38787a2a1c22 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:10.153941 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 83/177] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:10.164200 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9f140-17ef-456c-af42-38787a2a1c22 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:10.215089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 95/178] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:10.250482 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fad2e9-50cb-407d-9c8e-09d5260be4de None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:10.289263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9f140-17ef-456c-af42-38787a2a1c22 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:10.322819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:10.323430 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:10.342086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8182c07-2934-4f40-a32d-bb3724ce3dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:10.342980 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8182c07-2934-4f40-a32d-bb3724ce3dae None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:10.343257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8182c07-2934-4f40-a32d-bb3724ce3dae None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:10.343641 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8182c07-2934-4f40-a32d-bb3724ce3dae None admin] PATH_INFO: `/v3/users/30b6406c9904428284345736fa549292` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:10.345672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8182c07-2934-4f40-a32d-bb3724ce3dae None admin] RBAC: Authorizing `identity:get_user(user_id=30b6406c9904428284345736fa549292)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:10.347244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8182c07-2934-4f40-a32d-bb3724ce3dae None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:10.348891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 84/179] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:10 2022] GET /identity/v3/users/30b6406c9904428284345736fa549292 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:10.354434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8182c07-2934-4f40-a32d-bb3724ce3dae None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:10.443902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fad2e9-50cb-407d-9c8e-09d5260be4de None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:10.504078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8182c07-2934-4f40-a32d-bb3724ce3dae None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:10.543080 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf0d7f-0910-4d99-8d91-fb812f09d0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:10.544044 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf0d7f-0910-4d99-8d91-fb812f09d0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:10.544328 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf0d7f-0910-4d99-8d91-fb812f09d0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:10.544600 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf0d7f-0910-4d99-8d91-fb812f09d0e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:10.548811 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba825b6f-9346-44d5-beee-8384f1d5df7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:10.549813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba825b6f-9346-44d5-beee-8384f1d5df7f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:10.550092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba825b6f-9346-44d5-beee-8384f1d5df7f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:10.550366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba825b6f-9346-44d5-beee-8384f1d5df7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:10.567746 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf0d7f-0910-4d99-8d91-fb812f09d0e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:10.584546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-9caf0d7f-0910-4d99-8d91-fb812f09d0e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:10.584546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:10.584546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:10.584546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:10.584546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:10.584546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:10.584546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:10.584546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:10.584546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:10.584546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:10.584546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:10.584546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:10.584546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:10.584546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:10.584546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:10.584546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:10.585505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:10.585505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:10.585505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:10.585505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:10.585505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:10.585505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:10.585505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:10.585505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:10.585505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:10.585505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:10.585505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:10.585505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:10.585505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:10.585505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:10.585505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:10.585505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:10.586312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:10.586312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:10.586312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:10.586312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:10.586312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:10.586312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:10.586312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:10.586312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:10.586312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:10.586312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:10.586312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:10.586312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:10.586312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 96/180] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:15:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:10.598029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf0d7f-0910-4d99-8d91-fb812f09d0e7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:10.621129 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:10.629315 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba825b6f-9346-44d5-beee-8384f1d5df7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:10.631277 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba825b6f-9346-44d5-beee-8384f1d5df7f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:10.770359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 85/181] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 07:15:10.778351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba825b6f-9346-44d5-beee-8384f1d5df7f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:10.796782 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:10.809724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf0d7f-0910-4d99-8d91-fb812f09d0e7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:10.866676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072f6a7-37e4-4904-b905-c7fde4d9e848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:10.867351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072f6a7-37e4-4904-b905-c7fde4d9e848 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:10.867642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072f6a7-37e4-4904-b905-c7fde4d9e848 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:10.868072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072f6a7-37e4-4904-b905-c7fde4d9e848 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:10.868660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072f6a7-37e4-4904-b905-c7fde4d9e848 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:10.868975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072f6a7-37e4-4904-b905-c7fde4d9e848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:10.870390 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072f6a7-37e4-4904-b905-c7fde4d9e848 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:10.889156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 97/182] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:10.897074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072f6a7-37e4-4904-b905-c7fde4d9e848 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:10.910865 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:10.919255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba825b6f-9346-44d5-beee-8384f1d5df7f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:10.957963 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251dc96-38e3-4359-83c5-390e89b3aaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:10.959873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251dc96-38e3-4359-83c5-390e89b3aaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:10.960343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251dc96-38e3-4359-83c5-390e89b3aaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:10.960820 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251dc96-38e3-4359-83c5-390e89b3aaa8 None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:10.962238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251dc96-38e3-4359-83c5-390e89b3aaa8 None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:10.963900 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251dc96-38e3-4359-83c5-390e89b3aaa8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:10.966273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 86/183] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:10 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:10.978451 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251dc96-38e3-4359-83c5-390e89b3aaa8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:11.049572 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072f6a7-37e4-4904-b905-c7fde4d9e848 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:11.085503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251dc96-38e3-4359-83c5-390e89b3aaa8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:11.088222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cabfb-432d-465f-95a5-e3d8a75a6549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:11.089169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cabfb-432d-465f-95a5-e3d8a75a6549 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.089477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cabfb-432d-465f-95a5-e3d8a75a6549 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.089748 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cabfb-432d-465f-95a5-e3d8a75a6549 None admin] PATH_INFO: `/v3/users/08c1e0a1a16948d186cf9b599c9b97c2` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.105303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cabfb-432d-465f-95a5-e3d8a75a6549 None admin] RBAC: Authorizing `identity:get_user(user_id=08c1e0a1a16948d186cf9b599c9b97c2)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:11.106926 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cabfb-432d-465f-95a5-e3d8a75a6549 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:11.113344 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 98/184] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:10 2022] GET /identity/v3/users/08c1e0a1a16948d186cf9b599c9b97c2 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:11.113344 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d89dcd-81c2-452d-979b-e26bbd9c6364 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.113344 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d89dcd-81c2-452d-979b-e26bbd9c6364 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.113344 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d89dcd-81c2-452d-979b-e26bbd9c6364 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.113344 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 99/185] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:11.113741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db977b-8468-433e-82e8-0f67c112226d None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.113913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db977b-8468-433e-82e8-0f67c112226d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.114189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db977b-8468-433e-82e8-0f67c112226d None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.115402 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 100/186] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:11.118112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db977b-8468-433e-82e8-0f67c112226d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:11.128758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536a8fb-927f-4b59-8ccb-27fc6514eedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:11.129450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536a8fb-927f-4b59-8ccb-27fc6514eedf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.129733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536a8fb-927f-4b59-8ccb-27fc6514eedf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.130008 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536a8fb-927f-4b59-8ccb-27fc6514eedf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.130457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:11.131040 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536a8fb-927f-4b59-8ccb-27fc6514eedf None admin] RBAC: Adding query filter params (role.id=930830d015f94e249715290654948151, scope.project.id=89c6b2302f0d4de4a8c94b498362991f, user.id=30b6406c9904428284345736fa549292) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:11.131151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536a8fb-927f-4b59-8ccb-27fc6514eedf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:11.132549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536a8fb-927f-4b59-8ccb-27fc6514eedf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:11.141743 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 87/187] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:10 2022] GET /identity/v3/role_assignments?user.id=30b6406c9904428284345736fa549292&scope.project.id=89c6b2302f0d4de4a8c94b498362991f&role.id=930830d015f94e249715290654948151 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:11.143412 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad98949-6da2-4ba1-906a-d8c0f3574e83 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.143706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad98949-6da2-4ba1-906a-d8c0f3574e83 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.143975 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad98949-6da2-4ba1-906a-d8c0f3574e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.167335 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bad98949-6da2-4ba1-906a-d8c0f3574e83 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:11.168761 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bad98949-6da2-4ba1-906a-d8c0f3574e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:11.203476 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:11.245887 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db977b-8468-433e-82e8-0f67c112226d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:11.282715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 88/188] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:11.285304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e19a8-3e4c-4e70-b98e-72ab43ff1366 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.285616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e19a8-3e4c-4e70-b98e-72ab43ff1366 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.285891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e19a8-3e4c-4e70-b98e-72ab43ff1366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.291818 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f67078-fd8b-411f-9c70-b80193818b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:11.292486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f67078-fd8b-411f-9c70-b80193818b74 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.292765 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f67078-fd8b-411f-9c70-b80193818b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.293041 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f67078-fd8b-411f-9c70-b80193818b74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.312413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-437e19a8-3e4c-4e70-b98e-72ab43ff1366 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:11.315353 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-437e19a8-3e4c-4e70-b98e-72ab43ff1366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:11.383212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f67078-fd8b-411f-9c70-b80193818b74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:11.384690 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f67078-fd8b-411f-9c70-b80193818b74 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:11.396670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:11.399219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 89/189] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:11.399797 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e19a8-3e4c-4e70-b98e-72ab43ff1366 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:11.494786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:11.510360 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e19a8-3e4c-4e70-b98e-72ab43ff1366 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:11.515901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 101/190] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:11.517289 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f67078-fd8b-411f-9c70-b80193818b74 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:11.552173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f0154-bac3-464d-a848-6b1ee27d279f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:11.552980 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f0154-bac3-464d-a848-6b1ee27d279f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.553264 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f0154-bac3-464d-a848-6b1ee27d279f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.553565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f0154-bac3-464d-a848-6b1ee27d279f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.554739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f0154-bac3-464d-a848-6b1ee27d279f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:11.556200 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f0154-bac3-464d-a848-6b1ee27d279f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:11.558035 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 90/191] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:11.558629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f0154-bac3-464d-a848-6b1ee27d279f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:11.626700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f67078-fd8b-411f-9c70-b80193818b74 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:11.636028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:11.663223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543355d-39e3-4cac-9188-f0cbcafd398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:11.664035 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543355d-39e3-4cac-9188-f0cbcafd398f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.664318 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543355d-39e3-4cac-9188-f0cbcafd398f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.664590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543355d-39e3-4cac-9188-f0cbcafd398f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.664716 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f0154-bac3-464d-a848-6b1ee27d279f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:11.676680 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543355d-39e3-4cac-9188-f0cbcafd398f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:11.684886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-f543355d-39e3-4cac-9188-f0cbcafd398f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:11.684886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:11.684886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:11.684886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:11.684886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:11.684886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:11.684886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:11.684886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:11.684886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:11.684886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:11.684886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:11.684886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:11.684886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:11.684886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:11.684886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:11.684886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:11.685943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:11.685943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:11.685943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:11.685943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:11.685943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:11.685943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:11.685943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:11.685943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:11.685943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:11.685943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:11.685943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:11.685943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:11.685943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:11.685943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:11.685943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:11.685943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:11.686726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:11.686726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:11.686726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:11.686726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:11.686726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:11.686726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:11.686726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:11.686726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:11.686726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:11.686726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:11.686726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:11.686726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:11.686726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 102/192] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:15:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:11.687392 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543355d-39e3-4cac-9188-f0cbcafd398f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:11.712205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0b4ca-c37d-455a-9702-2da1311d1c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:11.713214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0b4ca-c37d-455a-9702-2da1311d1c41 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.713545 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0b4ca-c37d-455a-9702-2da1311d1c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.713883 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0b4ca-c37d-455a-9702-2da1311d1c41 None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.715125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0b4ca-c37d-455a-9702-2da1311d1c41 None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:11.716645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0b4ca-c37d-455a-9702-2da1311d1c41 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:11.718350 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 91/193] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:11 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:11.718350 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0b4ca-c37d-455a-9702-2da1311d1c41 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:11.748321 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:11.797566 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543355d-39e3-4cac-9188-f0cbcafd398f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:11.826857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0b4ca-c37d-455a-9702-2da1311d1c41 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:11.834040 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44b4ca-7290-467f-b562-a39627cb08f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:11.834973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b4ca-7290-467f-b562-a39627cb08f7 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.834973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b4ca-7290-467f-b562-a39627cb08f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.835245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b4ca-7290-467f-b562-a39627cb08f7 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.835938 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44b4ca-7290-467f-b562-a39627cb08f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:11.837406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44b4ca-7290-467f-b562-a39627cb08f7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:11.862565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09587c-b50b-4524-aa9f-ac186480ac41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:11.863228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09587c-b50b-4524-aa9f-ac186480ac41 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.863505 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09587c-b50b-4524-aa9f-ac186480ac41 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.863773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09587c-b50b-4524-aa9f-ac186480ac41 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.864502 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09587c-b50b-4524-aa9f-ac186480ac41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:11.864801 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09587c-b50b-4524-aa9f-ac186480ac41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:11.866189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09587c-b50b-4524-aa9f-ac186480ac41 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:11.874193 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 92/194] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:11.874983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09587c-b50b-4524-aa9f-ac186480ac41 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:11.931299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 103/195] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:15:11 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:15:11.932467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44b4ca-7290-467f-b562-a39627cb08f7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:11.978939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:11.980711 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:11.999456 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09587c-b50b-4524-aa9f-ac186480ac41 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:12.039476 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd162a3-121e-482e-b5ea-02bb42a99499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:12.040530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd162a3-121e-482e-b5ea-02bb42a99499 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:12.041006 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd162a3-121e-482e-b5ea-02bb42a99499 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:12.041541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd162a3-121e-482e-b5ea-02bb42a99499 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:12.042656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd162a3-121e-482e-b5ea-02bb42a99499 None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=51ef9f86f53c47068be8821419cdd2c0, user.id=08c1e0a1a16948d186cf9b599c9b97c2) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:12.043165 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd162a3-121e-482e-b5ea-02bb42a99499 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:12.044796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd162a3-121e-482e-b5ea-02bb42a99499 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:12.052133 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 93/196] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:11 2022] GET /identity/v3/role_assignments?user.id=08c1e0a1a16948d186cf9b599c9b97c2&scope.project.id=51ef9f86f53c47068be8821419cdd2c0&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:12.092958 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44b4ca-7290-467f-b562-a39627cb08f7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:12.134244 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33551b-7547-47e6-86d6-cdcef04ff680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:12.135146 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33551b-7547-47e6-86d6-cdcef04ff680 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:12.135429 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33551b-7547-47e6-86d6-cdcef04ff680 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:12.135706 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33551b-7547-47e6-86d6-cdcef04ff680 None admin] PATH_INFO: `/v3/users/08c1e0a1a16948d186cf9b599c9b97c2` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:12.137030 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33551b-7547-47e6-86d6-cdcef04ff680 None admin] RBAC: Authorizing `identity:get_user(user_id=08c1e0a1a16948d186cf9b599c9b97c2)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:12.139723 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33551b-7547-47e6-86d6-cdcef04ff680 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:12.140902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 104/197] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:11 2022] GET /identity/v3/users/08c1e0a1a16948d186cf9b599c9b97c2 => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:12.147122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd162a3-121e-482e-b5ea-02bb42a99499 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:12.269289 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd162a3-121e-482e-b5ea-02bb42a99499 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:12.305845 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83e38e-d85a-49d5-8fe3-d2730ece3029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:12.306509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83e38e-d85a-49d5-8fe3-d2730ece3029 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:12.306788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83e38e-d85a-49d5-8fe3-d2730ece3029 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:12.307059 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83e38e-d85a-49d5-8fe3-d2730ece3029 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:12.327652 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:12.386617 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83e38e-d85a-49d5-8fe3-d2730ece3029 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:12.388096 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83e38e-d85a-49d5-8fe3-d2730ece3029 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:12.508738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 94/198] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:12.515425 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33551b-7547-47e6-86d6-cdcef04ff680 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:12.628125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759029b-81e2-45d2-8b59-4380009cb8da None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:12.628467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759029b-81e2-45d2-8b59-4380009cb8da None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:12.628671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759029b-81e2-45d2-8b59-4380009cb8da None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:12.630227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 95/199] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:15:12.635212 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe223c37-dcbb-4111-bfa2-1470dc9e4cdf None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:12.635748 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe223c37-dcbb-4111-bfa2-1470dc9e4cdf None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:12.636225 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe223c37-dcbb-4111-bfa2-1470dc9e4cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:12.654560 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:12.663339 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33551b-7547-47e6-86d6-cdcef04ff680 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:12.673629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-fe223c37-dcbb-4111-bfa2-1470dc9e4cdf None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:12.675088 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fe223c37-dcbb-4111-bfa2-1470dc9e4cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:12.708404 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfd2d9-3bc2-478a-be8d-227e5b0fab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:12.709593 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd2d9-3bc2-478a-be8d-227e5b0fab6e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:12.710015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd2d9-3bc2-478a-be8d-227e5b0fab6e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:12.710426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd2d9-3bc2-478a-be8d-227e5b0fab6e None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:12.711758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfd2d9-3bc2-478a-be8d-227e5b0fab6e None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:12.713524 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfd2d9-3bc2-478a-be8d-227e5b0fab6e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:12.715496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 105/200] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:12 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:12.725773 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfd2d9-3bc2-478a-be8d-227e5b0fab6e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:12.761691 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:12.808086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 96/201] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:12.864907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe223c37-dcbb-4111-bfa2-1470dc9e4cdf None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:12.913894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfd2d9-3bc2-478a-be8d-227e5b0fab6e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:12.962281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891c175-1f02-4f8e-81bf-4f506fb74770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:12.963277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891c175-1f02-4f8e-81bf-4f506fb74770 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:12.965500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891c175-1f02-4f8e-81bf-4f506fb74770 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:12.965957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891c175-1f02-4f8e-81bf-4f506fb74770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:12.966995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891c175-1f02-4f8e-81bf-4f506fb74770 None admin] RBAC: Adding query filter params (role.id=930830d015f94e249715290654948151, scope.project.id=51ef9f86f53c47068be8821419cdd2c0, user.id=08c1e0a1a16948d186cf9b599c9b97c2) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:12.968543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891c175-1f02-4f8e-81bf-4f506fb74770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:12.972097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891c175-1f02-4f8e-81bf-4f506fb74770 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:12.991070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 106/202] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:12 2022] GET /identity/v3/role_assignments?user.id=08c1e0a1a16948d186cf9b599c9b97c2&scope.project.id=51ef9f86f53c47068be8821419cdd2c0&role.id=930830d015f94e249715290654948151 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:13.045372 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe223c37-dcbb-4111-bfa2-1470dc9e4cdf None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:13.090274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58290c7c-62c9-4323-8a2f-5981adfb7c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:13.091433 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58290c7c-62c9-4323-8a2f-5981adfb7c96 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:13.091890 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58290c7c-62c9-4323-8a2f-5981adfb7c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:13.092334 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58290c7c-62c9-4323-8a2f-5981adfb7c96 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:13.105119 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58290c7c-62c9-4323-8a2f-5981adfb7c96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:13.113618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-58290c7c-62c9-4323-8a2f-5981adfb7c96 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:13.113618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:13.113618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:13.113618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:13.113618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:13.113618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:13.113618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:13.113618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:13.113618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:13.113618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:13.113618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:13.113618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:13.113618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:13.113618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:13.113618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:13.113618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:13.114581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:13.114581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:13.114581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:13.114581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:13.114581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:13.114581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:13.114581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:13.114581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:13.114581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:13.114581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:13.114581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:13.114581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:13.114581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:13.114581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:13.114581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:13.114581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:13.115450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:13.115450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:13.115450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:13.115450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:13.115450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:13.115450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:13.115450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:13.115450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:13.115450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:13.115450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:13.115450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:13.115450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:13.118096 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 97/203] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:13.124430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891c175-1f02-4f8e-81bf-4f506fb74770 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:13.236491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:13.341217 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891c175-1f02-4f8e-81bf-4f506fb74770 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:13.392141 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85a0b2-c9b4-42d8-97d0-055939b3dc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:13.392806 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85a0b2-c9b4-42d8-97d0-055939b3dc2e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:13.393083 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85a0b2-c9b4-42d8-97d0-055939b3dc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:13.393380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85a0b2-c9b4-42d8-97d0-055939b3dc2e None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:13.394128 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85a0b2-c9b4-42d8-97d0-055939b3dc2e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:13.394432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85a0b2-c9b4-42d8-97d0-055939b3dc2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:13.395829 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85a0b2-c9b4-42d8-97d0-055939b3dc2e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:13.409131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 107/204] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:13.414648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58290c7c-62c9-4323-8a2f-5981adfb7c96 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:13.491259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:13.588110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58290c7c-62c9-4323-8a2f-5981adfb7c96 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:13.633927 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207ba4f-bd5f-4b4d-8557-673799d62997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:13.634817 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207ba4f-bd5f-4b4d-8557-673799d62997 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:13.635104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207ba4f-bd5f-4b4d-8557-673799d62997 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:13.635378 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207ba4f-bd5f-4b4d-8557-673799d62997 None admin] PATH_INFO: `/v3/users/2cfa7e673552447293ddae6e53bbdff7` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:13.636607 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207ba4f-bd5f-4b4d-8557-673799d62997 None admin] RBAC: Authorizing `identity:get_user(user_id=2cfa7e673552447293ddae6e53bbdff7)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:13.638096 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207ba4f-bd5f-4b4d-8557-673799d62997 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:13.639945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 98/205] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:13 2022] GET /identity/v3/users/2cfa7e673552447293ddae6e53bbdff7 => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:13.646513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85a0b2-c9b4-42d8-97d0-055939b3dc2e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:13.806524 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:13.827929 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85a0b2-c9b4-42d8-97d0-055939b3dc2e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:13.874009 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e288a42-5918-49e4-8844-03b4994651f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:13.874658 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e288a42-5918-49e4-8844-03b4994651f1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:13.874959 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e288a42-5918-49e4-8844-03b4994651f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:13.875314 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e288a42-5918-49e4-8844-03b4994651f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:13.966575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e288a42-5918-49e4-8844-03b4994651f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:13.968036 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e288a42-5918-49e4-8844-03b4994651f1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:14.080092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:14.101008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 108/206] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:14.106391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207ba4f-bd5f-4b4d-8557-673799d62997 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:14.237002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207ba4f-bd5f-4b4d-8557-673799d62997 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:14.244661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:14.279713 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313fdba-f7f8-4b77-92b8-6095123f2e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:14.280892 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313fdba-f7f8-4b77-92b8-6095123f2e2c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:14.282182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313fdba-f7f8-4b77-92b8-6095123f2e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:14.282459 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313fdba-f7f8-4b77-92b8-6095123f2e2c None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:14.283749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313fdba-f7f8-4b77-92b8-6095123f2e2c None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:14.285194 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313fdba-f7f8-4b77-92b8-6095123f2e2c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:14.287239 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 99/207] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:14 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:14.293059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e288a42-5918-49e4-8844-03b4994651f1 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:14.404977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e288a42-5918-49e4-8844-03b4994651f1 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:14.444791 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6e36d-f1b3-4c0b-8c51-81ac002edcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:14.445485 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6e36d-f1b3-4c0b-8c51-81ac002edcf7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:14.445768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6e36d-f1b3-4c0b-8c51-81ac002edcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:14.446040 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6e36d-f1b3-4c0b-8c51-81ac002edcf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:14.446882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6e36d-f1b3-4c0b-8c51-81ac002edcf7 None admin] RBAC: Adding query filter params (role.id=66d59f53ac4c4817bc23b4588234e3ad, scope.project.id=89c6b2302f0d4de4a8c94b498362991f, user.id=2cfa7e673552447293ddae6e53bbdff7) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:14.447191 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6e36d-f1b3-4c0b-8c51-81ac002edcf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:14.448641 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6e36d-f1b3-4c0b-8c51-81ac002edcf7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:14.459385 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 109/208] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:14 2022] GET /identity/v3/role_assignments?user.id=2cfa7e673552447293ddae6e53bbdff7&scope.project.id=89c6b2302f0d4de4a8c94b498362991f&role.id=66d59f53ac4c4817bc23b4588234e3ad => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:14.804464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c5da4-ab6e-4f27-a3f7-2da3e7143bf4 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:14.804834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c5da4-ab6e-4f27-a3f7-2da3e7143bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:14.805014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c5da4-ab6e-4f27-a3f7-2da3e7143bf4 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:14.806712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 100/209] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:14.812088 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1abc3-bc7b-4dc7-9671-1bb3dd840301 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:14.813145 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1abc3-bc7b-4dc7-9671-1bb3dd840301 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:14.813145 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1abc3-bc7b-4dc7-9671-1bb3dd840301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:14.836097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-dad1abc3-bc7b-4dc7-9671-1bb3dd840301 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:14.837300 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dad1abc3-bc7b-4dc7-9671-1bb3dd840301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:14.871192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d3740-0d43-48a9-9d82-1a0f51241750 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:14.871510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d3740-0d43-48a9-9d82-1a0f51241750 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:14.871742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d3740-0d43-48a9-9d82-1a0f51241750 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:14.873420 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 101/210] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:15:14.878557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dfcd8-7535-4c5a-9eb1-1e9584eb6f64 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:14.878841 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dfcd8-7535-4c5a-9eb1-1e9584eb6f64 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:14.879119 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dfcd8-7535-4c5a-9eb1-1e9584eb6f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:14.900648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f94dfcd8-7535-4c5a-9eb1-1e9584eb6f64 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:14.901663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:14.902198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f94dfcd8-7535-4c5a-9eb1-1e9584eb6f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:14.923519 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 110/211] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:14.954316 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1abc3-bc7b-4dc7-9671-1bb3dd840301 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:15.009476 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 102/212] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:15:15.023232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dfcd8-7535-4c5a-9eb1-1e9584eb6f64 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:15.078746 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1abc3-bc7b-4dc7-9671-1bb3dd840301 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:15.118590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0684dd-f985-46a1-bd09-bee74e9c5cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:15.119673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0684dd-f985-46a1-bd09-bee74e9c5cbb None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:15.120278 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0684dd-f985-46a1-bd09-bee74e9c5cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:15.120631 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0684dd-f985-46a1-bd09-bee74e9c5cbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:15.132642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0684dd-f985-46a1-bd09-bee74e9c5cbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:15.136331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dfcd8-7535-4c5a-9eb1-1e9584eb6f64 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:15.138651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:15.141969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-6b0684dd-f985-46a1-bd09-bee74e9c5cbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:15.141969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:15.141969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:15.141969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:15.141969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:15.141969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:15.141969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:15.141969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:15.141969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:15.141969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:15.141969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:15.141969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:15.141969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:15.141969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:15.141969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:15.141969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:15.144951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:15.144951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:15.144951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:15.144951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:15.144951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:15.144951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:15.144951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:15.144951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:15.144951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:15.144951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:15.144951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:15.144951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:15.144951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:15.144951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:15.144951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:15.144951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:15.145788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:15.145788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:15.145788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:15.145788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:15.145788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:15.145788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:15.145788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:15.145788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:15.145788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:15.145788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:15.145788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:15.145788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:15.145788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 111/213] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:15.145788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56417dc4-7476-46e4-afc5-916ebef14d9e None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:15.146490 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56417dc4-7476-46e4-afc5-916ebef14d9e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:15.146490 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56417dc4-7476-46e4-afc5-916ebef14d9e None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:15.146612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 112/214] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:15.148634 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56417dc4-7476-46e4-afc5-916ebef14d9e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:15.198938 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53359b2-c162-49fb-a8e2-3eefec86a265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:15.199732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53359b2-c162-49fb-a8e2-3eefec86a265 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:15.200011 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53359b2-c162-49fb-a8e2-3eefec86a265 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:15.200280 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53359b2-c162-49fb-a8e2-3eefec86a265 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:15.204889 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:15.211672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53359b2-c162-49fb-a8e2-3eefec86a265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:15.219921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b53359b2-c162-49fb-a8e2-3eefec86a265 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:15.219921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:15.219921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:15.219921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:15.219921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:15.219921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:15.219921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:15.219921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:15.219921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:15.219921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:15.219921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:15.219921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:15.219921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:15.219921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:15.219921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:15.219921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:15.220848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:15.220848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:15.220848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:15.220848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:15.220848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:15.220848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:15.220848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:15.220848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:15.220848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:15.220848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:15.220848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:15.220848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:15.220848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:15.220848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:15.220848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:15.220848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:15.222019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:15.222019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:15.222019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:15.222019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:15.222019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:15.222019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:15.222019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:15.222019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:15.222019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:15.222019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:15.222019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:15.222019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:15.222019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 103/215] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:15:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:15.222916 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad695dc7-bb72-4fe8-8cee-2ff8280fc96d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:15.222916 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad695dc7-bb72-4fe8-8cee-2ff8280fc96d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:15.222916 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad695dc7-bb72-4fe8-8cee-2ff8280fc96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:15.240734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ad695dc7-bb72-4fe8-8cee-2ff8280fc96d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:15.241940 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ad695dc7-bb72-4fe8-8cee-2ff8280fc96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:15.273111 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56417dc4-7476-46e4-afc5-916ebef14d9e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:15.308888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 104/216] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:15.309065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c9c6c-8bdf-401e-a9bf-3a2a75270454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:15.309552 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad695dc7-bb72-4fe8-8cee-2ff8280fc96d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:15.318131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c9c6c-8bdf-401e-a9bf-3a2a75270454 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:15.318651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c9c6c-8bdf-401e-a9bf-3a2a75270454 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:15.319089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c9c6c-8bdf-401e-a9bf-3a2a75270454 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:15.319894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c9c6c-8bdf-401e-a9bf-3a2a75270454 None admin] RBAC: Adding query filter params (name=member) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:15.320207 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c9c6c-8bdf-401e-a9bf-3a2a75270454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:15.321773 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c9c6c-8bdf-401e-a9bf-3a2a75270454 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:15.332095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 113/217] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:15.337576 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c9c6c-8bdf-401e-a9bf-3a2a75270454 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:15.416930 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:15.428349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad695dc7-bb72-4fe8-8cee-2ff8280fc96d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:15.447847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c9c6c-8bdf-401e-a9bf-3a2a75270454 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:15.449395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:15.463130 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00b9fc-ae34-418e-97d5-d8a9dcb21211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:15.463724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00b9fc-ae34-418e-97d5-d8a9dcb21211 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:15.464002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00b9fc-ae34-418e-97d5-d8a9dcb21211 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:15.464277 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00b9fc-ae34-418e-97d5-d8a9dcb21211 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:15.465069 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00b9fc-ae34-418e-97d5-d8a9dcb21211 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:15.465408 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00b9fc-ae34-418e-97d5-d8a9dcb21211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:15.466800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00b9fc-ae34-418e-97d5-d8a9dcb21211 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:15.475620 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 105/218] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:15.476922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00b9fc-ae34-418e-97d5-d8a9dcb21211 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:15.481932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ad61c-c241-41ab-820a-b8e8cc7dc6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:15.482805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ad61c-c241-41ab-820a-b8e8cc7dc6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:15.483091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ad61c-c241-41ab-820a-b8e8cc7dc6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:15.483371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ad61c-c241-41ab-820a-b8e8cc7dc6e6 None admin] PATH_INFO: `/v3/users/805b868d5e8c49cfb51928d7307308c9` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:15.497112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ad61c-c241-41ab-820a-b8e8cc7dc6e6 None admin] RBAC: Authorizing `identity:get_user(user_id=805b868d5e8c49cfb51928d7307308c9)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:15.498606 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ad61c-c241-41ab-820a-b8e8cc7dc6e6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:15.500387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 114/219] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:15 2022] GET /identity/v3/users/805b868d5e8c49cfb51928d7307308c9 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:15.501622 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff876f57-c215-4c1f-9957-1538f5080325 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:15.501901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff876f57-c215-4c1f-9957-1538f5080325 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:15.502172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff876f57-c215-4c1f-9957-1538f5080325 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:15.503384 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 115/220] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:15.504065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff876f57-c215-4c1f-9957-1538f5080325 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:15.582686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00b9fc-ae34-418e-97d5-d8a9dcb21211 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:15.603413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff876f57-c215-4c1f-9957-1538f5080325 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:15.615779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da31e68-c07c-4d5f-ae60-a2e83f6a5442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:15.616575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da31e68-c07c-4d5f-ae60-a2e83f6a5442 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:15.616858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da31e68-c07c-4d5f-ae60-a2e83f6a5442 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:15.617132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da31e68-c07c-4d5f-ae60-a2e83f6a5442 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:15.618339 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da31e68-c07c-4d5f-ae60-a2e83f6a5442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:15.619796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da31e68-c07c-4d5f-ae60-a2e83f6a5442 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:15.621431 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 106/221] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:15.622198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da31e68-c07c-4d5f-ae60-a2e83f6a5442 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:15.639889 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d7ab3-6489-4083-9f54-c522726d1e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:15.641617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d7ab3-6489-4083-9f54-c522726d1e0e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:15.642067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d7ab3-6489-4083-9f54-c522726d1e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:15.642347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d7ab3-6489-4083-9f54-c522726d1e0e None admin] PATH_INFO: `/v3/users/08c1e0a1a16948d186cf9b599c9b97c2` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:15.643531 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d7ab3-6489-4083-9f54-c522726d1e0e None admin] RBAC: Authorizing `identity:get_user(user_id=08c1e0a1a16948d186cf9b599c9b97c2)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:15.644984 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d7ab3-6489-4083-9f54-c522726d1e0e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:15.646656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 116/222] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:15 2022] GET /identity/v3/users/08c1e0a1a16948d186cf9b599c9b97c2 => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:15.647317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:15.648063 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2ae9b-0264-482c-9820-da36e4fa1062 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:15.648063 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2ae9b-0264-482c-9820-da36e4fa1062 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:15.648343 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2ae9b-0264-482c-9820-da36e4fa1062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:15.664652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-21d2ae9b-0264-482c-9820-da36e4fa1062 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:15.665888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-21d2ae9b-0264-482c-9820-da36e4fa1062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:15.692330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:15.727927 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da31e68-c07c-4d5f-ae60-a2e83f6a5442 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:15.737488 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 117/223] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:15.753005 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2ae9b-0264-482c-9820-da36e4fa1062 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:15.763297 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bf560-0246-4ecf-9e9f-c1662a5fed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:15.763955 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bf560-0246-4ecf-9e9f-c1662a5fed55 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:15.764237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bf560-0246-4ecf-9e9f-c1662a5fed55 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:15.764515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bf560-0246-4ecf-9e9f-c1662a5fed55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:15.830584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bf560-0246-4ecf-9e9f-c1662a5fed55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:15.832053 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bf560-0246-4ecf-9e9f-c1662a5fed55 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:15.837363 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2ae9b-0264-482c-9820-da36e4fa1062 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:15.855689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:15.870752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e6adf-86e0-4cb7-80d4-6bf36751dfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:15.871414 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e6adf-86e0-4cb7-80d4-6bf36751dfd2 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:15.871697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e6adf-86e0-4cb7-80d4-6bf36751dfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:15.876759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e6adf-86e0-4cb7-80d4-6bf36751dfd2 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:15.876759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e6adf-86e0-4cb7-80d4-6bf36751dfd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:15.876759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e6adf-86e0-4cb7-80d4-6bf36751dfd2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:15.929089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 107/224] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:15.932964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bf560-0246-4ecf-9e9f-c1662a5fed55 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:15.964565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 118/225] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:15:15 2022] POST /identity/v3/users => generated 297 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:15:15.965425 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e6adf-86e0-4cb7-80d4-6bf36751dfd2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:15.984949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:16.042913 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bf560-0246-4ecf-9e9f-c1662a5fed55 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:16.072257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:16.084592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff6004-472c-4aac-8d5c-393cf110dfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:16.085562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff6004-472c-4aac-8d5c-393cf110dfb3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:16.085893 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff6004-472c-4aac-8d5c-393cf110dfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:16.086142 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff6004-472c-4aac-8d5c-393cf110dfb3 None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:16.087465 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff6004-472c-4aac-8d5c-393cf110dfb3 None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:16.088433 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e6adf-86e0-4cb7-80d4-6bf36751dfd2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:16.089000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff6004-472c-4aac-8d5c-393cf110dfb3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:16.096273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 108/226] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:15 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:16.096273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff6004-472c-4aac-8d5c-393cf110dfb3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:16.130391 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf915955-985c-4c12-835e-23b1d6092d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:16.131172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf915955-985c-4c12-835e-23b1d6092d9d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:16.131449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf915955-985c-4c12-835e-23b1d6092d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:16.131722 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf915955-985c-4c12-835e-23b1d6092d9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:16.143980 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf915955-985c-4c12-835e-23b1d6092d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:16.152081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-cf915955-985c-4c12-835e-23b1d6092d9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:16.152081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:16.152081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:16.152081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:16.152081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:16.152081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:16.152081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:16.152081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:16.152081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:16.152081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:16.152081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:16.152081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:16.152081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:16.152081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:16.152081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:16.152081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:16.153018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:16.153018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:16.153018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:16.153018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:16.153018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:16.153018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:16.153018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:16.153018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:16.153018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:16.153018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:16.153018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:16.153018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:16.153018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:16.153018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:16.153018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:16.153018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:16.153869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:16.153869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:16.153869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:16.153869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:16.153869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:16.153869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:16.153869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:16.153869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:16.153869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:16.153869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:16.153869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:16.153869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:16.153869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 119/227] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:15:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:16.154535 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf915955-985c-4c12-835e-23b1d6092d9d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:16.257125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff6004-472c-4aac-8d5c-393cf110dfb3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:16.264010 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:16.296539 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf915955-985c-4c12-835e-23b1d6092d9d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:16.311802 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5805a-3e24-4c7f-b4fe-f1d4268c230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:16.313812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5805a-3e24-4c7f-b4fe-f1d4268c230d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:16.314294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5805a-3e24-4c7f-b4fe-f1d4268c230d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:16.314566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5805a-3e24-4c7f-b4fe-f1d4268c230d None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:16.315898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5805a-3e24-4c7f-b4fe-f1d4268c230d None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:16.317769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5805a-3e24-4c7f-b4fe-f1d4268c230d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:16.319634 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 109/228] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:16 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:16.320229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5805a-3e24-4c7f-b4fe-f1d4268c230d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:16.339345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f26b79-d755-4b0b-afea-406279fbaedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:16.340839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f26b79-d755-4b0b-afea-406279fbaedd None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:16.341698 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f26b79-d755-4b0b-afea-406279fbaedd None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:16.341975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f26b79-d755-4b0b-afea-406279fbaedd None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0/users/08c1e0a1a16948d186cf9b599c9b97c2/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:16.344948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f26b79-d755-4b0b-afea-406279fbaedd None admin] RBAC: Authorizing `identity:create_grant(project_id=51ef9f86f53c47068be8821419cdd2c0, user_id=08c1e0a1a16948d186cf9b599c9b97c2, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:16.346469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f26b79-d755-4b0b-afea-406279fbaedd None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:16.391742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:16.402440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 120/229] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:15:16 2022] PUT /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0/users/08c1e0a1a16948d186cf9b599c9b97c2/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:15:16.403629 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f26b79-d755-4b0b-afea-406279fbaedd None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:16.442908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5805a-3e24-4c7f-b4fe-f1d4268c230d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:16.486721 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bcd37-2003-475b-84c2-170a040b9820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:16.487786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bcd37-2003-475b-84c2-170a040b9820 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:16.488278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bcd37-2003-475b-84c2-170a040b9820 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:16.488728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bcd37-2003-475b-84c2-170a040b9820 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:16.489702 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bcd37-2003-475b-84c2-170a040b9820 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:16.490187 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bcd37-2003-475b-84c2-170a040b9820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:16.491785 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bcd37-2003-475b-84c2-170a040b9820 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:16.501785 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 110/230] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:16.507338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bcd37-2003-475b-84c2-170a040b9820 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:16.544428 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f26b79-d755-4b0b-afea-406279fbaedd None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:16.599760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70d29b-9e14-4438-b426-ee2088c5e343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:16.600439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70d29b-9e14-4438-b426-ee2088c5e343 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:16.600724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70d29b-9e14-4438-b426-ee2088c5e343 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:16.601004 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70d29b-9e14-4438-b426-ee2088c5e343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:16.601941 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70d29b-9e14-4438-b426-ee2088c5e343 None admin] RBAC: Adding query filter params (role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0, scope.project.id=51ef9f86f53c47068be8821419cdd2c0, user.id=805b868d5e8c49cfb51928d7307308c9) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:16.602290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70d29b-9e14-4438-b426-ee2088c5e343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:16.606509 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70d29b-9e14-4438-b426-ee2088c5e343 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:16.608908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:16.617790 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 121/231] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:16 2022] GET /identity/v3/role_assignments?user.id=805b868d5e8c49cfb51928d7307308c9&scope.project.id=51ef9f86f53c47068be8821419cdd2c0&role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:16.685168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bcd37-2003-475b-84c2-170a040b9820 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:16.711977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:16.727884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913836b8-3719-433c-b77a-a24d68a841f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:16.728783 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913836b8-3719-433c-b77a-a24d68a841f3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:16.729064 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913836b8-3719-433c-b77a-a24d68a841f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:16.729360 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913836b8-3719-433c-b77a-a24d68a841f3 None admin] PATH_INFO: `/v3/users/08c1e0a1a16948d186cf9b599c9b97c2` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:16.730716 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913836b8-3719-433c-b77a-a24d68a841f3 None admin] RBAC: Authorizing `identity:get_user(user_id=08c1e0a1a16948d186cf9b599c9b97c2)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:16.732236 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913836b8-3719-433c-b77a-a24d68a841f3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:16.735749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 111/232] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:16 2022] GET /identity/v3/users/08c1e0a1a16948d186cf9b599c9b97c2 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:16.740468 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70d29b-9e14-4438-b426-ee2088c5e343 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:16.857210 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70d29b-9e14-4438-b426-ee2088c5e343 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:16.894761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d23580-db9d-4e13-86a7-678a0ed258e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:16.896008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d23580-db9d-4e13-86a7-678a0ed258e1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:16.896502 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d23580-db9d-4e13-86a7-678a0ed258e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:16.896972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d23580-db9d-4e13-86a7-678a0ed258e1 None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:16.898411 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d23580-db9d-4e13-86a7-678a0ed258e1 None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:16.900065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d23580-db9d-4e13-86a7-678a0ed258e1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:16.902019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 122/233] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:16 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:16.908186 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913836b8-3719-433c-b77a-a24d68a841f3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:17.055696 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913836b8-3719-433c-b77a-a24d68a841f3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:17.121029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318655fb-4d8e-4171-962e-46d788091e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:17.123061 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318655fb-4d8e-4171-962e-46d788091e26 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:17.123839 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318655fb-4d8e-4171-962e-46d788091e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:17.124621 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318655fb-4d8e-4171-962e-46d788091e26 None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0/users/08c1e0a1a16948d186cf9b599c9b97c2/roles/930830d015f94e249715290654948151` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:17.129316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318655fb-4d8e-4171-962e-46d788091e26 None admin] RBAC: Authorizing `identity:create_grant(project_id=51ef9f86f53c47068be8821419cdd2c0, user_id=08c1e0a1a16948d186cf9b599c9b97c2, role_id=930830d015f94e249715290654948151)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:17.132233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318655fb-4d8e-4171-962e-46d788091e26 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:17.232381 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 112/234] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:15:16 2022] PUT /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0/users/08c1e0a1a16948d186cf9b599c9b97c2/roles/930830d015f94e249715290654948151 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:15:18.553713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2c566-3188-4c6e-bdda-cb06a67ba339 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:18.554227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2c566-3188-4c6e-bdda-cb06a67ba339 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:18.554303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2c566-3188-4c6e-bdda-cb06a67ba339 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:18.555774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 123/235] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:18.561607 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7d3d2-f2f0-4250-ac58-e32535219820 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:18.562052 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7d3d2-f2f0-4250-ac58-e32535219820 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:18.562167 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7d3d2-f2f0-4250-ac58-e32535219820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:18.591711 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b2a7d3d2-f2f0-4250-ac58-e32535219820 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:18.592898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b2a7d3d2-f2f0-4250-ac58-e32535219820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:18.697723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:18.744886 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 113/236] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:18.799019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2c566-3188-4c6e-bdda-cb06a67ba339 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:18.857683 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ff85b-6ff6-4978-bb15-3ecce6220f3e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:18.858323 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ff85b-6ff6-4978-bb15-3ecce6220f3e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:18.858810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ff85b-6ff6-4978-bb15-3ecce6220f3e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:18.861553 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 114/237] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:18.866774 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db836bb9-4175-498f-8eb6-d5b961131774 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:18.867041 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db836bb9-4175-498f-8eb6-d5b961131774 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:18.867315 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db836bb9-4175-498f-8eb6-d5b961131774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:18.903250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:18.906442 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-db836bb9-4175-498f-8eb6-d5b961131774 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:18.907920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-db836bb9-4175-498f-8eb6-d5b961131774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:18.994527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2c566-3188-4c6e-bdda-cb06a67ba339 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:19.035830 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288db7a-7045-4353-9c56-452571471bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:19.037098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288db7a-7045-4353-9c56-452571471bee None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:19.037639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288db7a-7045-4353-9c56-452571471bee None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:19.038111 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288db7a-7045-4353-9c56-452571471bee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:19.050774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288db7a-7045-4353-9c56-452571471bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:19.059608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-7288db7a-7045-4353-9c56-452571471bee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:19.059608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:19.059608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:19.059608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:19.059608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:19.059608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:19.059608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:19.059608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:19.059608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:19.059608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:19.059608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:19.059608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:19.059608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:19.059608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:19.059608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:19.059608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:19.060510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:19.060510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:19.060510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:19.060510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:19.060510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:19.060510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:19.060510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:19.060510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:19.060510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:19.060510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:19.060510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:19.060510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:19.060510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:19.060510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:19.060510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:19.060510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:19.061286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:19.061286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:19.061286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:19.061286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:19.061286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:19.061286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:19.061286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:19.061286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:19.061286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:19.061286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:19.061286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:19.061286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:19.064330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 124/238] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:19.070105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288db7a-7045-4353-9c56-452571471bee None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:19.074958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 115/239] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:19.123478 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db836bb9-4175-498f-8eb6-d5b961131774 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:19.198050 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288db7a-7045-4353-9c56-452571471bee None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:19.226382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:19.236977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793a3ad-b56a-4840-a7ac-5f9710e162b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:19.237933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793a3ad-b56a-4840-a7ac-5f9710e162b5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:19.238499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793a3ad-b56a-4840-a7ac-5f9710e162b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:19.238987 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793a3ad-b56a-4840-a7ac-5f9710e162b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:19.240023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793a3ad-b56a-4840-a7ac-5f9710e162b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:19.240648 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793a3ad-b56a-4840-a7ac-5f9710e162b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:19.247563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793a3ad-b56a-4840-a7ac-5f9710e162b5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:19.267498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 125/240] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:19.273802 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793a3ad-b56a-4840-a7ac-5f9710e162b5 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:19.292263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db836bb9-4175-498f-8eb6-d5b961131774 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:19.311675 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:19.369315 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd74747-cc0f-440a-b984-bd8478e0b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:19.370143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd74747-cc0f-440a-b984-bd8478e0b050 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:19.370425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd74747-cc0f-440a-b984-bd8478e0b050 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:19.370690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd74747-cc0f-440a-b984-bd8478e0b050 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:19.371991 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd74747-cc0f-440a-b984-bd8478e0b050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:19.373474 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd74747-cc0f-440a-b984-bd8478e0b050 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:19.375388 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 116/241] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:19.382522 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd74747-cc0f-440a-b984-bd8478e0b050 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:19.451433 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793a3ad-b56a-4840-a7ac-5f9710e162b5 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:19.492609 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb2295-8b26-4153-a046-0c9786c8ab50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:19.493626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb2295-8b26-4153-a046-0c9786c8ab50 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:19.493907 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb2295-8b26-4153-a046-0c9786c8ab50 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:19.494180 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb2295-8b26-4153-a046-0c9786c8ab50 None admin] PATH_INFO: `/v3/users/24b6bdb2a1e84cf3b340134690e4ce8e` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:19.509955 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb2295-8b26-4153-a046-0c9786c8ab50 None admin] RBAC: Authorizing `identity:get_user(user_id=24b6bdb2a1e84cf3b340134690e4ce8e)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:19.510158 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd74747-cc0f-440a-b984-bd8478e0b050 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:19.511474 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb2295-8b26-4153-a046-0c9786c8ab50 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:19.513354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 126/242] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:19 2022] GET /identity/v3/users/24b6bdb2a1e84cf3b340134690e4ce8e => generated 297 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:19.514472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071937b-bf79-4405-b311-9c822f138879 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:19.514752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071937b-bf79-4405-b311-9c822f138879 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:19.515022 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071937b-bf79-4405-b311-9c822f138879 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:19.517162 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 127/243] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:19.518118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6f08f-ae3e-4da6-9257-a5ee6772e51f None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:19.518505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6f08f-ae3e-4da6-9257-a5ee6772e51f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:19.518778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6f08f-ae3e-4da6-9257-a5ee6772e51f None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:19.519976 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 128/244] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:19.523278 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6f08f-ae3e-4da6-9257-a5ee6772e51f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:19.554591 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c5285-3404-46dc-9ef2-8ad4de65bea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:19.555261 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c5285-3404-46dc-9ef2-8ad4de65bea0 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:19.555538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c5285-3404-46dc-9ef2-8ad4de65bea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:19.555809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c5285-3404-46dc-9ef2-8ad4de65bea0 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:19.556523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c5285-3404-46dc-9ef2-8ad4de65bea0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:19.557992 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c5285-3404-46dc-9ef2-8ad4de65bea0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:19.578423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:19.630563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6f08f-ae3e-4da6-9257-a5ee6772e51f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:19.656781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 117/245] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:15:19 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:15:19.661911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d4834-b1ec-4f87-b925-d008d42b1225 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:19.661911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d4834-b1ec-4f87-b925-d008d42b1225 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:19.661911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d4834-b1ec-4f87-b925-d008d42b1225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:19.680370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e38d4834-b1ec-4f87-b925-d008d42b1225 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:19.680370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e38d4834-b1ec-4f87-b925-d008d42b1225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:19.695155 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e234753-ef46-4e5c-9671-8d7b416e5c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:19.696421 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e234753-ef46-4e5c-9671-8d7b416e5c69 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:19.696792 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e234753-ef46-4e5c-9671-8d7b416e5c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:19.697065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e234753-ef46-4e5c-9671-8d7b416e5c69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:19.716358 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:19.764811 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 118/246] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:19.767362 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2fbab-4296-40b7-b274-32aae79e46c8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:19.767937 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2fbab-4296-40b7-b274-32aae79e46c8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:19.768384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2fbab-4296-40b7-b274-32aae79e46c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:19.794497 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-96a2fbab-4296-40b7-b274-32aae79e46c8 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:19.797879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-96a2fbab-4296-40b7-b274-32aae79e46c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:19.818888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e234753-ef46-4e5c-9671-8d7b416e5c69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:19.821012 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e234753-ef46-4e5c-9671-8d7b416e5c69 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:19.872412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:19.885467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 119/247] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:19.885467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2fbab-4296-40b7-b274-32aae79e46c8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:19.948438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 129/248] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:19.949119 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e234753-ef46-4e5c-9671-8d7b416e5c69 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:19.994806 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:20.003623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2fbab-4296-40b7-b274-32aae79e46c8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:20.045689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e495df-6bb5-442d-b524-0ac88ceb9004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:20.049276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e495df-6bb5-442d-b524-0ac88ceb9004 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:20.049721 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e495df-6bb5-442d-b524-0ac88ceb9004 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:20.053086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e495df-6bb5-442d-b524-0ac88ceb9004 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:20.069532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e234753-ef46-4e5c-9671-8d7b416e5c69 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:20.075256 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e495df-6bb5-442d-b524-0ac88ceb9004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:20.083789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-05e495df-6bb5-442d-b524-0ac88ceb9004 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:20.083789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:20.083789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:20.083789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:20.083789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:20.083789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:20.083789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:20.083789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:20.083789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:20.083789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:20.083789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:20.083789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:20.083789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:20.083789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:20.083789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:20.083789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:20.084699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:20.084699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:20.084699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:20.084699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:20.084699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:20.084699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:20.084699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:20.084699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:20.084699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:20.084699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:20.084699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:20.084699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:20.084699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:20.084699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:20.084699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:20.084699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:20.085649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:20.085649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:20.085649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:20.085649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:20.085649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:20.085649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:20.085649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:20.085649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:20.085649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:20.085649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:20.085649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:20.085649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:20.085649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 120/249] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:20.086300 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e495df-6bb5-442d-b524-0ac88ceb9004 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:20.119305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92014c40-b11f-4f8c-a5de-18732dd6fe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:20.120136 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92014c40-b11f-4f8c-a5de-18732dd6fe11 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:20.120423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92014c40-b11f-4f8c-a5de-18732dd6fe11 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:20.120704 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92014c40-b11f-4f8c-a5de-18732dd6fe11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:20.135009 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92014c40-b11f-4f8c-a5de-18732dd6fe11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:20.145483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-92014c40-b11f-4f8c-a5de-18732dd6fe11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:20.145483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:20.145483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:20.145483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:20.145483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:20.145483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:20.145483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:20.145483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:20.145483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:20.145483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:20.145483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:20.145483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:20.145483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:20.145483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:20.145483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:20.145483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:20.146439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:20.146439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:20.146439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:20.146439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:20.146439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:20.146439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:20.146439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:20.146439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:20.146439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:20.146439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:20.146439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:20.146439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:20.146439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:20.146439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:20.146439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:20.146439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:20.147239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:20.147239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:20.147239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:20.147239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:20.147239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:20.147239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:20.147239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:20.147239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:20.147239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:20.147239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:20.147239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:20.147239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:20.147239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 130/250] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:15:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:20.148388 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92014c40-b11f-4f8c-a5de-18732dd6fe11 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:20.160116 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:20.223876 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e495df-6bb5-442d-b524-0ac88ceb9004 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:20.269973 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21070717-2360-48b0-95a0-4357a4215a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:20.271138 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21070717-2360-48b0-95a0-4357a4215a11 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:20.271423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21070717-2360-48b0-95a0-4357a4215a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:20.271701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21070717-2360-48b0-95a0-4357a4215a11 None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:20.273080 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21070717-2360-48b0-95a0-4357a4215a11 None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:20.275227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21070717-2360-48b0-95a0-4357a4215a11 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:20.277970 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 121/251] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:20 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:20.278971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21070717-2360-48b0-95a0-4357a4215a11 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:20.283943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92014c40-b11f-4f8c-a5de-18732dd6fe11 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:20.311991 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:20.322844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27a06b-8a1a-4e6b-a035-3f4f6c5b796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:20.331814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27a06b-8a1a-4e6b-a035-3f4f6c5b796a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:20.331814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27a06b-8a1a-4e6b-a035-3f4f6c5b796a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:20.331814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27a06b-8a1a-4e6b-a035-3f4f6c5b796a None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:20.331814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27a06b-8a1a-4e6b-a035-3f4f6c5b796a None admin] RBAC: Adding query filter params (name=member) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:20.331814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27a06b-8a1a-4e6b-a035-3f4f6c5b796a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:20.331814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27a06b-8a1a-4e6b-a035-3f4f6c5b796a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:20.337795 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 131/252] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:20.339401 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1229e66-cbec-4dae-a6f3-ccb48b3bb5f2 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:20.339978 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1229e66-cbec-4dae-a6f3-ccb48b3bb5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:20.340461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1229e66-cbec-4dae-a6f3-ccb48b3bb5f2 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:20.342473 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 132/253] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:20.348205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1229e66-cbec-4dae-a6f3-ccb48b3bb5f2 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:20.406752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21070717-2360-48b0-95a0-4357a4215a11 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:20.441725 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:20.444924 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24429fa2-fe6c-439c-bf49-281a1350862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:20.445722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24429fa2-fe6c-439c-bf49-281a1350862d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:20.446075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24429fa2-fe6c-439c-bf49-281a1350862d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:20.446421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24429fa2-fe6c-439c-bf49-281a1350862d None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:20.447243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24429fa2-fe6c-439c-bf49-281a1350862d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:20.447619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24429fa2-fe6c-439c-bf49-281a1350862d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:20.449089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24429fa2-fe6c-439c-bf49-281a1350862d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:20.458588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 122/254] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:20.459524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24429fa2-fe6c-439c-bf49-281a1350862d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:20.477134 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1229e66-cbec-4dae-a6f3-ccb48b3bb5f2 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:20.515598 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675497d-13ae-43c9-abe8-bc414fb51913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:20.516887 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675497d-13ae-43c9-abe8-bc414fb51913 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:20.517179 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675497d-13ae-43c9-abe8-bc414fb51913 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:20.517505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675497d-13ae-43c9-abe8-bc414fb51913 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:20.518379 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675497d-13ae-43c9-abe8-bc414fb51913 None admin] RBAC: Adding query filter params (role.id=66d59f53ac4c4817bc23b4588234e3ad, scope.project.id=51ef9f86f53c47068be8821419cdd2c0, user.id=24b6bdb2a1e84cf3b340134690e4ce8e) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:20.519081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675497d-13ae-43c9-abe8-bc414fb51913 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:20.521639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675497d-13ae-43c9-abe8-bc414fb51913 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:20.528013 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 133/255] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:20 2022] GET /identity/v3/role_assignments?user.id=24b6bdb2a1e84cf3b340134690e4ce8e&scope.project.id=51ef9f86f53c47068be8821419cdd2c0&role.id=66d59f53ac4c4817bc23b4588234e3ad => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:20.529734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cdc9e-ed68-4899-bf76-f2b1f264fe69 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:20.530140 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cdc9e-ed68-4899-bf76-f2b1f264fe69 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:20.530574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cdc9e-ed68-4899-bf76-f2b1f264fe69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:20.563106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-924cdc9e-ed68-4899-bf76-f2b1f264fe69 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:20.564553 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-924cdc9e-ed68-4899-bf76-f2b1f264fe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:20.584771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:20.618899 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24429fa2-fe6c-439c-bf49-281a1350862d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:20.702029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fcf81-698a-464f-a8c6-4db6cd56eb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:20.703576 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fcf81-698a-464f-a8c6-4db6cd56eb77 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:20.703862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fcf81-698a-464f-a8c6-4db6cd56eb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:20.704142 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fcf81-698a-464f-a8c6-4db6cd56eb77 None admin] PATH_INFO: `/v3/users/805b868d5e8c49cfb51928d7307308c9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:20.709391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fcf81-698a-464f-a8c6-4db6cd56eb77 None admin] RBAC: Authorizing `identity:get_user(user_id=805b868d5e8c49cfb51928d7307308c9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:20.710880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fcf81-698a-464f-a8c6-4db6cd56eb77 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:20.718790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 123/256] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:20 2022] GET /identity/v3/users/805b868d5e8c49cfb51928d7307308c9 => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:20.719722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fcf81-698a-464f-a8c6-4db6cd56eb77 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:20.726403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 134/257] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:20.727273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924cdc9e-ed68-4899-bf76-f2b1f264fe69 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:20.846354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:20.867142 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fcf81-698a-464f-a8c6-4db6cd56eb77 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:20.921198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f8aa3-f201-4110-b7fc-658a42a93727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:20.922893 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f8aa3-f201-4110-b7fc-658a42a93727 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:20.923265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f8aa3-f201-4110-b7fc-658a42a93727 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:20.923542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f8aa3-f201-4110-b7fc-658a42a93727 None admin] PATH_INFO: `/v3/users/08c1e0a1a16948d186cf9b599c9b97c2` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:20.925297 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f8aa3-f201-4110-b7fc-658a42a93727 None admin] RBAC: Authorizing `identity:get_user(user_id=08c1e0a1a16948d186cf9b599c9b97c2)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:20.926944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f8aa3-f201-4110-b7fc-658a42a93727 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:20.929033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 124/258] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:20 2022] GET /identity/v3/users/08c1e0a1a16948d186cf9b599c9b97c2 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:20.929565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924cdc9e-ed68-4899-bf76-f2b1f264fe69 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:20.929832 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f8aa3-f201-4110-b7fc-658a42a93727 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:20.954536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:21.006782 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2b5e4-c2c6-49cd-854a-19fcd23e6aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:21.007662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2b5e4-c2c6-49cd-854a-19fcd23e6aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:21.007936 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2b5e4-c2c6-49cd-854a-19fcd23e6aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:21.008209 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2b5e4-c2c6-49cd-854a-19fcd23e6aa0 None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:21.009552 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2b5e4-c2c6-49cd-854a-19fcd23e6aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:21.012066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2b5e4-c2c6-49cd-854a-19fcd23e6aa0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:21.015687 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 135/259] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:20 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:21.016486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2b5e4-c2c6-49cd-854a-19fcd23e6aa0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:21.101303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f8aa3-f201-4110-b7fc-658a42a93727 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:21.142235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d886165-3a4e-4499-8a6d-965e0adf574d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:21.143119 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d886165-3a4e-4499-8a6d-965e0adf574d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:21.143400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d886165-3a4e-4499-8a6d-965e0adf574d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:21.143680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d886165-3a4e-4499-8a6d-965e0adf574d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:21.154755 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d886165-3a4e-4499-8a6d-965e0adf574d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:21.161768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2b5e4-c2c6-49cd-854a-19fcd23e6aa0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:21.163425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9d886165-3a4e-4499-8a6d-965e0adf574d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:21.163425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:21.163425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:21.163425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:21.163425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:21.163425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:21.163425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:21.163425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:21.163425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:21.163425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:21.163425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:21.163425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:21.163425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:21.163425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:21.163425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:21.163425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:21.164301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:21.164301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:21.164301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:21.164301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:21.164301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:21.164301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:21.164301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:21.164301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:21.164301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:21.164301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:21.164301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:21.164301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:21.164301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:21.164301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:21.164301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:21.164301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:21.165099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:21.165099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:21.165099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:21.165099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:21.165099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:21.165099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:21.165099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:21.165099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:21.165099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:21.165099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:21.165099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:21.165099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:21.165099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 125/260] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:15:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:21.173523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d886165-3a4e-4499-8a6d-965e0adf574d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:21.205451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:21.209208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441c636-e6d0-433d-a356-5cefad672390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:21.210109 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441c636-e6d0-433d-a356-5cefad672390 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:21.210554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441c636-e6d0-433d-a356-5cefad672390 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:21.210990 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441c636-e6d0-433d-a356-5cefad672390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:21.273635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:21.291908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d886165-3a4e-4499-8a6d-965e0adf574d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:21.327790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfc808-499e-43fd-b4d6-d86b19552f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:21.329575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfc808-499e-43fd-b4d6-d86b19552f14 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:21.329863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfc808-499e-43fd-b4d6-d86b19552f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:21.330145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfc808-499e-43fd-b4d6-d86b19552f14 None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0/users/805b868d5e8c49cfb51928d7307308c9/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:21.333347 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfc808-499e-43fd-b4d6-d86b19552f14 None admin] RBAC: Authorizing `identity:create_grant(project_id=51ef9f86f53c47068be8821419cdd2c0, user_id=805b868d5e8c49cfb51928d7307308c9, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:21.333706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfc808-499e-43fd-b4d6-d86b19552f14 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:21.358910 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441c636-e6d0-433d-a356-5cefad672390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:21.360817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441c636-e6d0-433d-a356-5cefad672390 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:21.451377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 126/261] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:15:21 2022] PUT /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0/users/805b868d5e8c49cfb51928d7307308c9/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:15:21.455610 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfc808-499e-43fd-b4d6-d86b19552f14 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:21.480491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 136/262] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:21.488429 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441c636-e6d0-433d-a356-5cefad672390 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:21.525759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:21.607677 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441c636-e6d0-433d-a356-5cefad672390 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:21.647707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58983ddf-0364-4604-be4c-bc9a80e51157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:21.649012 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58983ddf-0364-4604-be4c-bc9a80e51157 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:21.649289 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58983ddf-0364-4604-be4c-bc9a80e51157 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:21.649610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58983ddf-0364-4604-be4c-bc9a80e51157 None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:21.650940 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58983ddf-0364-4604-be4c-bc9a80e51157 None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:21.652585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58983ddf-0364-4604-be4c-bc9a80e51157 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:21.654918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 137/263] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:21 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:21.661682 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58983ddf-0364-4604-be4c-bc9a80e51157 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:21.778195 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58983ddf-0364-4604-be4c-bc9a80e51157 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:21.807074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:21.818829 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfc808-499e-43fd-b4d6-d86b19552f14 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:21.819622 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7a7fb-9899-4f51-aab6-6ff92cded1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:21.820460 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7a7fb-9899-4f51-aab6-6ff92cded1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:21.829783 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7a7fb-9899-4f51-aab6-6ff92cded1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:21.829783 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7a7fb-9899-4f51-aab6-6ff92cded1e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:21.829783 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7a7fb-9899-4f51-aab6-6ff92cded1e8 None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=51ef9f86f53c47068be8821419cdd2c0, user.id=08c1e0a1a16948d186cf9b599c9b97c2) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:21.829783 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7a7fb-9899-4f51-aab6-6ff92cded1e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:21.829783 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7a7fb-9899-4f51-aab6-6ff92cded1e8 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:21.834396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 138/264] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:21 2022] GET /identity/v3/role_assignments?user.id=08c1e0a1a16948d186cf9b599c9b97c2&scope.project.id=51ef9f86f53c47068be8821419cdd2c0&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:21.885108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f1a40-fed8-4a6a-a34a-b22b1c0c1c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:21.886007 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f1a40-fed8-4a6a-a34a-b22b1c0c1c16 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:21.886400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f1a40-fed8-4a6a-a34a-b22b1c0c1c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:21.886751 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f1a40-fed8-4a6a-a34a-b22b1c0c1c16 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:21.887592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f1a40-fed8-4a6a-a34a-b22b1c0c1c16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:21.887906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f1a40-fed8-4a6a-a34a-b22b1c0c1c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:21.889339 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f1a40-fed8-4a6a-a34a-b22b1c0c1c16 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:21.900455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 127/265] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:21.907121 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7a7fb-9899-4f51-aab6-6ff92cded1e8 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:22.048223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7a7fb-9899-4f51-aab6-6ff92cded1e8 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:22.085974 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e71c56-c5ae-4f3b-a939-0c752b7b3ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:22.087231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e71c56-c5ae-4f3b-a939-0c752b7b3ccf None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:22.087709 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e71c56-c5ae-4f3b-a939-0c752b7b3ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:22.088176 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e71c56-c5ae-4f3b-a939-0c752b7b3ccf None admin] PATH_INFO: `/v3/users/08c1e0a1a16948d186cf9b599c9b97c2` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:22.089667 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e71c56-c5ae-4f3b-a939-0c752b7b3ccf None admin] RBAC: Authorizing `identity:get_user(user_id=08c1e0a1a16948d186cf9b599c9b97c2)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:22.091243 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e71c56-c5ae-4f3b-a939-0c752b7b3ccf None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:22.093091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 139/266] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:21 2022] GET /identity/v3/users/08c1e0a1a16948d186cf9b599c9b97c2 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:22.098662 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f1a40-fed8-4a6a-a34a-b22b1c0c1c16 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:22.101894 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:22.229992 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f1a40-fed8-4a6a-a34a-b22b1c0c1c16 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:22.268486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac2755-972a-4751-ba10-e41b80f8374c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:22.269147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac2755-972a-4751-ba10-e41b80f8374c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:22.269454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac2755-972a-4751-ba10-e41b80f8374c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:22.269729 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac2755-972a-4751-ba10-e41b80f8374c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:22.342142 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac2755-972a-4751-ba10-e41b80f8374c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:22.343654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac2755-972a-4751-ba10-e41b80f8374c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:22.356101 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:22.446608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 128/267] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 07:15:22.452246 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e71c56-c5ae-4f3b-a939-0c752b7b3ccf None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:22.489918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:22.553795 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfce39-dc8e-4d92-9889-7a4ae9429288 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:22.554453 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfce39-dc8e-4d92-9889-7a4ae9429288 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:22.554945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfce39-dc8e-4d92-9889-7a4ae9429288 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:22.556626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 129/268] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:22.562678 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713344dc-09fc-45d9-84f8-e08930cb89bf None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:22.563307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713344dc-09fc-45d9-84f8-e08930cb89bf None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:22.563784 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713344dc-09fc-45d9-84f8-e08930cb89bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:22.583827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-713344dc-09fc-45d9-84f8-e08930cb89bf None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:22.585629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-713344dc-09fc-45d9-84f8-e08930cb89bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:22.619505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e71c56-c5ae-4f3b-a939-0c752b7b3ccf None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:22.669763 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ec870-7b58-4b64-bda5-ba5767054794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:22.671011 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ec870-7b58-4b64-bda5-ba5767054794 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:22.672023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ec870-7b58-4b64-bda5-ba5767054794 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:22.672495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ec870-7b58-4b64-bda5-ba5767054794 None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:22.673942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ec870-7b58-4b64-bda5-ba5767054794 None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:22.675612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ec870-7b58-4b64-bda5-ba5767054794 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:22.677874 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 140/269] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:22 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:22.679253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80ae60-18dd-4886-95ea-bab45216f0c7 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:22.679771 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80ae60-18dd-4886-95ea-bab45216f0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:22.680243 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80ae60-18dd-4886-95ea-bab45216f0c7 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:22.681713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 141/270] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:22.685472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80ae60-18dd-4886-95ea-bab45216f0c7 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:22.697267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 130/271] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:15:22.698765 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43408d3a-81ff-4517-9f5e-7716d15eaf1d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:22.699259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43408d3a-81ff-4517-9f5e-7716d15eaf1d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:22.699780 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43408d3a-81ff-4517-9f5e-7716d15eaf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:22.718150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-43408d3a-81ff-4517-9f5e-7716d15eaf1d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:22.720141 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-43408d3a-81ff-4517-9f5e-7716d15eaf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:22.755418 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:22.811154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 131/272] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:22.811154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43408d3a-81ff-4517-9f5e-7716d15eaf1d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:22.860908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:22.867260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80ae60-18dd-4886-95ea-bab45216f0c7 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:22.916609 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832af7c-9c8e-4b2a-8519-2c6a2eb6d561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:22.917569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832af7c-9c8e-4b2a-8519-2c6a2eb6d561 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:22.918023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832af7c-9c8e-4b2a-8519-2c6a2eb6d561 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:22.918466 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832af7c-9c8e-4b2a-8519-2c6a2eb6d561 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:22.920019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832af7c-9c8e-4b2a-8519-2c6a2eb6d561 None admin] RBAC: Adding query filter params (role.id=930830d015f94e249715290654948151, scope.project.id=51ef9f86f53c47068be8821419cdd2c0, user.id=08c1e0a1a16948d186cf9b599c9b97c2) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:22.920503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832af7c-9c8e-4b2a-8519-2c6a2eb6d561 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:22.922682 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832af7c-9c8e-4b2a-8519-2c6a2eb6d561 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:22.931485 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 142/273] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:22 2022] GET /identity/v3/role_assignments?user.id=08c1e0a1a16948d186cf9b599c9b97c2&scope.project.id=51ef9f86f53c47068be8821419cdd2c0&role.id=930830d015f94e249715290654948151 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:22.932452 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43408d3a-81ff-4517-9f5e-7716d15eaf1d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:22.932942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832af7c-9c8e-4b2a-8519-2c6a2eb6d561 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:22.973440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab07e2-66b3-40e2-be88-d3f27a463383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:22.974711 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab07e2-66b3-40e2-be88-d3f27a463383 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:22.975196 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab07e2-66b3-40e2-be88-d3f27a463383 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:22.975694 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab07e2-66b3-40e2-be88-d3f27a463383 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:22.988973 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab07e2-66b3-40e2-be88-d3f27a463383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:23.004934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-f2ab07e2-66b3-40e2-be88-d3f27a463383 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:23.004934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:23.004934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:23.004934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:23.004934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:23.004934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:23.004934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:23.004934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:23.004934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:23.004934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:23.004934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:23.004934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:23.004934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:23.004934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:23.004934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:23.004934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:23.006224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:23.006224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:23.006224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:23.006224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:23.006224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:23.006224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:23.006224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:23.006224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:23.006224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:23.006224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:23.006224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:23.006224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:23.006224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:23.006224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:23.006224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:23.006224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:23.007043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:23.007043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:23.007043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:23.007043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:23.007043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:23.007043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:23.007043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:23.007043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:23.007043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:23.007043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:23.007043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:23.007043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:23.009815 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 132/274] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:23.016786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab07e2-66b3-40e2-be88-d3f27a463383 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:23.051794 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:23.068155 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832af7c-9c8e-4b2a-8519-2c6a2eb6d561 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:23.111747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1a42-750d-4125-b99b-ff97044b7572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:23.112950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1a42-750d-4125-b99b-ff97044b7572 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:23.113472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1a42-750d-4125-b99b-ff97044b7572 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:23.113979 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1a42-750d-4125-b99b-ff97044b7572 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:23.115527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d1a42-750d-4125-b99b-ff97044b7572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:23.117203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d1a42-750d-4125-b99b-ff97044b7572 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:23.119285 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 143/275] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:23.137090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1a42-750d-4125-b99b-ff97044b7572 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:23.151509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab07e2-66b3-40e2-be88-d3f27a463383 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:23.203663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f9794-150f-4810-a890-f732617f53de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:23.204269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f9794-150f-4810-a890-f732617f53de None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:23.204548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f9794-150f-4810-a890-f732617f53de None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:23.204827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f9794-150f-4810-a890-f732617f53de None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:23.205625 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f9794-150f-4810-a890-f732617f53de None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:23.205930 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f9794-150f-4810-a890-f732617f53de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:23.207324 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f9794-150f-4810-a890-f732617f53de None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:23.214035 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:23.226775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 133/276] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:23.228148 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f9794-150f-4810-a890-f732617f53de None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:23.305197 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1a42-750d-4125-b99b-ff97044b7572 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:23.328814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:23.341982 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524cb70-cbad-4006-8d42-29015513f4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:23.342752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524cb70-cbad-4006-8d42-29015513f4a3 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:23.343353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524cb70-cbad-4006-8d42-29015513f4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:23.343567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524cb70-cbad-4006-8d42-29015513f4a3 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:23.344198 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524cb70-cbad-4006-8d42-29015513f4a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:23.345741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524cb70-cbad-4006-8d42-29015513f4a3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:23.345983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f9794-150f-4810-a890-f732617f53de None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:23.381170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eb2e5-1010-4b0f-bcf5-b4e5a390dc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:23.382112 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb2e5-1010-4b0f-bcf5-b4e5a390dc8e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:23.382390 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb2e5-1010-4b0f-bcf5-b4e5a390dc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:23.382656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb2e5-1010-4b0f-bcf5-b4e5a390dc8e None admin] PATH_INFO: `/v3/users/ef1ec34045884db69bf5282b44cf85b3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:23.396342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eb2e5-1010-4b0f-bcf5-b4e5a390dc8e None admin] RBAC: Authorizing `identity:get_user(user_id=ef1ec34045884db69bf5282b44cf85b3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:23.397943 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eb2e5-1010-4b0f-bcf5-b4e5a390dc8e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:23.399605 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 134/277] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:23 2022] GET /identity/v3/users/ef1ec34045884db69bf5282b44cf85b3 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:23.399605 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c034192-6946-467f-85c0-9e8c4ff0dc0c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:23.399605 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c034192-6946-467f-85c0-9e8c4ff0dc0c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:23.399605 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c034192-6946-467f-85c0-9e8c4ff0dc0c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:23.399605 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 135/278] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:23.405472 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c034192-6946-467f-85c0-9e8c4ff0dc0c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:23.415736 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 144/279] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:15:23 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:15:23.417628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee498d-4d1f-4973-bf15-5930be6dfbaa None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:23.418116 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee498d-4d1f-4973-bf15-5930be6dfbaa None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:23.418600 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee498d-4d1f-4973-bf15-5930be6dfbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:23.437827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-37ee498d-4d1f-4973-bf15-5930be6dfbaa None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:23.439444 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-37ee498d-4d1f-4973-bf15-5930be6dfbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:23.538481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 145/280] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:23.543032 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c034192-6946-467f-85c0-9e8c4ff0dc0c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:23.557296 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee498d-4d1f-4973-bf15-5930be6dfbaa None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:23.577380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:23.583707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33546622-a58d-4c8a-b08e-8940c9742826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:23.584479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33546622-a58d-4c8a-b08e-8940c9742826 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:23.584760 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33546622-a58d-4c8a-b08e-8940c9742826 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:23.585037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33546622-a58d-4c8a-b08e-8940c9742826 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:23.598607 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33546622-a58d-4c8a-b08e-8940c9742826 None admin] RBAC: Adding query filter params (role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0, user.id=ef1ec34045884db69bf5282b44cf85b3, scope.system=all) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:23.598607 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33546622-a58d-4c8a-b08e-8940c9742826 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:23.598607 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33546622-a58d-4c8a-b08e-8940c9742826 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:23.598607 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 136/281] 10.222.0.52 () {56 vars in 1308 bytes} [Fri Jun 17 07:15:23 2022] GET /identity/v3/role_assignments?user.id=ef1ec34045884db69bf5282b44cf85b3&scope.system=all&role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:23.688794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee498d-4d1f-4973-bf15-5930be6dfbaa None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:23.729912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f15ae6-c6b1-4800-970f-ea55191d5426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:23.730729 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f15ae6-c6b1-4800-970f-ea55191d5426 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:23.731059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f15ae6-c6b1-4800-970f-ea55191d5426 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:23.731343 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f15ae6-c6b1-4800-970f-ea55191d5426 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:23.743941 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f15ae6-c6b1-4800-970f-ea55191d5426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:23.752975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-d6f15ae6-c6b1-4800-970f-ea55191d5426 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:23.752975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:23.752975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:23.752975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:23.752975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:23.752975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:23.752975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:23.752975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:23.752975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:23.752975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:23.752975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:23.752975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:23.752975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:23.752975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:23.752975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:23.752975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:23.753948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:23.753948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:23.753948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:23.753948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:23.753948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:23.753948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:23.753948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:23.753948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:23.753948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:23.753948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:23.753948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:23.753948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:23.753948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:23.753948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:23.753948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:23.753948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:23.755443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:23.755443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:23.755443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:23.755443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:23.755443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:23.755443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:23.755443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:23.755443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:23.755443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:23.755443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:23.755443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:23.755443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:23.755443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 146/282] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:23.762214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33546622-a58d-4c8a-b08e-8940c9742826 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:23.772328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:23.876192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33546622-a58d-4c8a-b08e-8940c9742826 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:23.915290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17a6a3-efba-46a6-a302-f8313b0df737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:23.915966 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17a6a3-efba-46a6-a302-f8313b0df737 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:23.916243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17a6a3-efba-46a6-a302-f8313b0df737 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:23.916516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17a6a3-efba-46a6-a302-f8313b0df737 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:23.917259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17a6a3-efba-46a6-a302-f8313b0df737 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:23.917604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17a6a3-efba-46a6-a302-f8313b0df737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:23.918973 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17a6a3-efba-46a6-a302-f8313b0df737 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:23.931547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 137/283] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:23.937116 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f15ae6-c6b1-4800-970f-ea55191d5426 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:24.026600 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:24.052332 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f15ae6-c6b1-4800-970f-ea55191d5426 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:24.111620 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bebd1-9e83-43b5-9abb-b512d5c4c6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:24.112526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bebd1-9e83-43b5-9abb-b512d5c4c6ba None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:24.112806 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bebd1-9e83-43b5-9abb-b512d5c4c6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:24.113082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bebd1-9e83-43b5-9abb-b512d5c4c6ba None admin] PATH_INFO: `/v3/users/24b6bdb2a1e84cf3b340134690e4ce8e` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:24.114354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bebd1-9e83-43b5-9abb-b512d5c4c6ba None admin] RBAC: Authorizing `identity:get_user(user_id=24b6bdb2a1e84cf3b340134690e4ce8e)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:24.115816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bebd1-9e83-43b5-9abb-b512d5c4c6ba None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:24.118219 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 147/284] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:23 2022] GET /identity/v3/users/24b6bdb2a1e84cf3b340134690e4ce8e => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:24.123583 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17a6a3-efba-46a6-a302-f8313b0df737 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:24.199489 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:24.247247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17a6a3-efba-46a6-a302-f8313b0df737 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:24.298035 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ca48e-f6f6-4626-a973-d48720286611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:24.298910 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ca48e-f6f6-4626-a973-d48720286611 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:24.299191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ca48e-f6f6-4626-a973-d48720286611 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:24.299461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ca48e-f6f6-4626-a973-d48720286611 None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:24.300687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ca48e-f6f6-4626-a973-d48720286611 None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:24.302160 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ca48e-f6f6-4626-a973-d48720286611 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:24.304172 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 138/285] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:24 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:24.309508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bebd1-9e83-43b5-9abb-b512d5c4c6ba None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:24.474708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bebd1-9e83-43b5-9abb-b512d5c4c6ba None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:24.490939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05055c54-c0a1-42cf-91de-a703741e737f None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:24.491544 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05055c54-c0a1-42cf-91de-a703741e737f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:24.492036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05055c54-c0a1-42cf-91de-a703741e737f None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:24.497404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 139/286] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:24.504823 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261387d-c4bb-47b1-94ed-3db4c7ebf2a6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:24.505351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261387d-c4bb-47b1-94ed-3db4c7ebf2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:24.505838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261387d-c4bb-47b1-94ed-3db4c7ebf2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:24.520166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907c4f2-aa74-4043-874d-4b4c83679caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:24.521288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907c4f2-aa74-4043-874d-4b4c83679caa None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:24.521741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907c4f2-aa74-4043-874d-4b4c83679caa None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:24.522155 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907c4f2-aa74-4043-874d-4b4c83679caa None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0/users/24b6bdb2a1e84cf3b340134690e4ce8e/roles/66d59f53ac4c4817bc23b4588234e3ad` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:24.524708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907c4f2-aa74-4043-874d-4b4c83679caa None admin] RBAC: Authorizing `identity:create_grant(project_id=51ef9f86f53c47068be8821419cdd2c0, user_id=24b6bdb2a1e84cf3b340134690e4ce8e, role_id=66d59f53ac4c4817bc23b4588234e3ad)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:24.526321 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907c4f2-aa74-4043-874d-4b4c83679caa None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:24.538295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2261387d-c4bb-47b1-94ed-3db4c7ebf2a6 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:24.539816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2261387d-c4bb-47b1-94ed-3db4c7ebf2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:24.614828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 148/287] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:15:24 2022] PUT /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0/users/24b6bdb2a1e84cf3b340134690e4ce8e/roles/66d59f53ac4c4817bc23b4588234e3ad => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:15:24.623618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 140/288] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:15:24.676976 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907c4f2-aa74-4043-874d-4b4c83679caa None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:24.684642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:24.819383 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907c4f2-aa74-4043-874d-4b4c83679caa None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:24.864386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e2d65-36bd-4e28-872f-d88ef4a7342a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:24.865213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e2d65-36bd-4e28-872f-d88ef4a7342a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:24.865519 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e2d65-36bd-4e28-872f-d88ef4a7342a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:24.865795 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e2d65-36bd-4e28-872f-d88ef4a7342a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:24.883510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e2d65-36bd-4e28-872f-d88ef4a7342a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:24.892333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-b90e2d65-36bd-4e28-872f-d88ef4a7342a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:24.892333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:24.892333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:24.892333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:24.892333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:24.892333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:24.892333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:24.892333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:24.892333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:24.892333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:24.892333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:24.892333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:24.892333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:24.892333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:24.892333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:24.892333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:24.893291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:24.893291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:24.893291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:24.893291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:24.893291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:24.893291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:24.893291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:24.893291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:24.893291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:24.893291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:24.893291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:24.893291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:24.893291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:24.893291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:24.893291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:24.893291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:24.894172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:24.894172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:24.894172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:24.894172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:24.894172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:24.894172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:24.894172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:24.894172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:24.894172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:24.894172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:24.894172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:24.894172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:24.898090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 149/289] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:24.903976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261387d-c4bb-47b1-94ed-3db4c7ebf2a6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:24.978565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:25.018059 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261387d-c4bb-47b1-94ed-3db4c7ebf2a6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:25.070127 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdf7d5-11a4-4c48-9e2f-0c93f2bcd152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:25.071094 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdf7d5-11a4-4c48-9e2f-0c93f2bcd152 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:25.071565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdf7d5-11a4-4c48-9e2f-0c93f2bcd152 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:25.072015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdf7d5-11a4-4c48-9e2f-0c93f2bcd152 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:25.072939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdf7d5-11a4-4c48-9e2f-0c93f2bcd152 None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:25.073449 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdf7d5-11a4-4c48-9e2f-0c93f2bcd152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:25.074998 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdf7d5-11a4-4c48-9e2f-0c93f2bcd152 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:25.088666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 141/290] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:25.094716 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e2d65-36bd-4e28-872f-d88ef4a7342a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:25.244521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:25.293794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e2d65-36bd-4e28-872f-d88ef4a7342a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:25.344267 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cda1d5-3277-40ad-9a82-2a1dacf8c161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:25.345164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cda1d5-3277-40ad-9a82-2a1dacf8c161 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:25.345469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cda1d5-3277-40ad-9a82-2a1dacf8c161 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:25.345744 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cda1d5-3277-40ad-9a82-2a1dacf8c161 None admin] PATH_INFO: `/v3/users/805b868d5e8c49cfb51928d7307308c9` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:25.350042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cda1d5-3277-40ad-9a82-2a1dacf8c161 None admin] RBAC: Authorizing `identity:get_user(user_id=805b868d5e8c49cfb51928d7307308c9)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:25.351519 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cda1d5-3277-40ad-9a82-2a1dacf8c161 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:25.353485 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 150/291] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:25 2022] GET /identity/v3/users/805b868d5e8c49cfb51928d7307308c9 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:25.359454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdf7d5-11a4-4c48-9e2f-0c93f2bcd152 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:25.502100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdf7d5-11a4-4c48-9e2f-0c93f2bcd152 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:25.528992 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:25.537308 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78035a83-50bf-499e-a218-961f34f78674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:25.537983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78035a83-50bf-499e-a218-961f34f78674 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:25.538262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78035a83-50bf-499e-a218-961f34f78674 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:25.538534 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78035a83-50bf-499e-a218-961f34f78674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:25.623262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78035a83-50bf-499e-a218-961f34f78674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:25.624672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78035a83-50bf-499e-a218-961f34f78674 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:25.760374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 142/292] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:25.766301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cda1d5-3277-40ad-9a82-2a1dacf8c161 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:25.911885 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cda1d5-3277-40ad-9a82-2a1dacf8c161 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:25.942718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:25.952296 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bf6d3-9125-4ac2-abd7-09e534bef72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:25.953859 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bf6d3-9125-4ac2-abd7-09e534bef72c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:25.953859 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bf6d3-9125-4ac2-abd7-09e534bef72c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:25.954029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bf6d3-9125-4ac2-abd7-09e534bef72c None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:25.956598 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bf6d3-9125-4ac2-abd7-09e534bef72c None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:25.958085 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bf6d3-9125-4ac2-abd7-09e534bef72c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:25.967560 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 151/293] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:25 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:25.967677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78035a83-50bf-499e-a218-961f34f78674 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:26.016248 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:26.120269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78035a83-50bf-499e-a218-961f34f78674 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:26.150651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ceb3b6-d86d-4808-b56f-f5aa3f8f3777 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:26.151599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ceb3b6-d86d-4808-b56f-f5aa3f8f3777 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:26.152167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ceb3b6-d86d-4808-b56f-f5aa3f8f3777 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:26.158414 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 152/294] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:26.163580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09d125-3a8b-4445-afe5-ab0c6152b3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:26.164182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09d125-3a8b-4445-afe5-ab0c6152b3fd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:26.164464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09d125-3a8b-4445-afe5-ab0c6152b3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:26.164739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09d125-3a8b-4445-afe5-ab0c6152b3fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:26.165539 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d65cee-1850-4ed0-b326-06f0a797acea None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:26.165644 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09d125-3a8b-4445-afe5-ab0c6152b3fd None admin] RBAC: Adding query filter params (role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0, scope.project.id=51ef9f86f53c47068be8821419cdd2c0, user.id=805b868d5e8c49cfb51928d7307308c9) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:26.165966 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09d125-3a8b-4445-afe5-ab0c6152b3fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:26.166310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d65cee-1850-4ed0-b326-06f0a797acea None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:26.166896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d65cee-1850-4ed0-b326-06f0a797acea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:26.167461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09d125-3a8b-4445-afe5-ab0c6152b3fd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:26.174658 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 143/295] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:25 2022] GET /identity/v3/role_assignments?user.id=805b868d5e8c49cfb51928d7307308c9&scope.project.id=51ef9f86f53c47068be8821419cdd2c0&role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:26.199643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f1d65cee-1850-4ed0-b326-06f0a797acea None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:26.200949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f1d65cee-1850-4ed0-b326-06f0a797acea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:26.298960 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 153/296] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:15:26.346967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09d125-3a8b-4445-afe5-ab0c6152b3fd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:26.379423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93876f37-6631-4d36-8756-d0d88b7fee20 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:26.380065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93876f37-6631-4d36-8756-d0d88b7fee20 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:26.380543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93876f37-6631-4d36-8756-d0d88b7fee20 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:26.382467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 154/297] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:15:26.388255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a997d5-8007-4c72-931f-58bd9bf89229 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:26.388534 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a997d5-8007-4c72-931f-58bd9bf89229 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:26.388807 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a997d5-8007-4c72-931f-58bd9bf89229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:26.419184 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a8a997d5-8007-4c72-931f-58bd9bf89229 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:26.422732 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a8a997d5-8007-4c72-931f-58bd9bf89229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:26.501803 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:26.510844 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09d125-3a8b-4445-afe5-ab0c6152b3fd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:26.537762 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 155/298] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:15:26.548747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f64e1-af3a-4706-a0d9-55f57f34cc9a None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:26.549030 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f64e1-af3a-4706-a0d9-55f57f34cc9a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:26.549343 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f64e1-af3a-4706-a0d9-55f57f34cc9a None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:26.550976 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 156/299] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:15:26.556205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782277c-1d45-4ccd-9276-5265ee43008d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:26.556493 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782277c-1d45-4ccd-9276-5265ee43008d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:26.556761 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cfd81-8065-4d7d-a6cf-3c1080e82dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:26.556894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782277c-1d45-4ccd-9276-5265ee43008d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:26.557596 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cfd81-8065-4d7d-a6cf-3c1080e82dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:26.557879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cfd81-8065-4d7d-a6cf-3c1080e82dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:26.558152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cfd81-8065-4d7d-a6cf-3c1080e82dc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:26.571223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cfd81-8065-4d7d-a6cf-3c1080e82dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:26.576424 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a782277c-1d45-4ccd-9276-5265ee43008d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:26.577709 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a782277c-1d45-4ccd-9276-5265ee43008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:26.578952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5e8cfd81-8065-4d7d-a6cf-3c1080e82dc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:26.578952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:26.578952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:26.578952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:26.578952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:26.578952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:26.578952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:26.578952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:26.578952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:26.578952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:26.578952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:26.578952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:26.578952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:26.578952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:26.578952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:26.578952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:26.579826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:26.579826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:26.579826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:26.579826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:26.579826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:26.579826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:26.579826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:26.579826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:26.579826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:26.579826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:26.579826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:26.579826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:26.579826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:26.579826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:26.579826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:26.579826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:26.580636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:26.580636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:26.580636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:26.580636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:26.580636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:26.580636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:26.580636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:26.580636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:26.580636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:26.580636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:26.580636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:26.580636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:26.580636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 144/300] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:26.581297 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cfd81-8065-4d7d-a6cf-3c1080e82dc1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:26.655040 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:26.677276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 157/301] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:15:26.677276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782277c-1d45-4ccd-9276-5265ee43008d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:26.711445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cfd81-8065-4d7d-a6cf-3c1080e82dc1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:26.750204 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73dda9-ecd1-4ca8-85b6-fb0ebaf13096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:26.750985 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73dda9-ecd1-4ca8-85b6-fb0ebaf13096 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:26.751262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73dda9-ecd1-4ca8-85b6-fb0ebaf13096 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:26.751528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73dda9-ecd1-4ca8-85b6-fb0ebaf13096 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:26.761753 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73dda9-ecd1-4ca8-85b6-fb0ebaf13096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:26.770203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9c73dda9-ecd1-4ca8-85b6-fb0ebaf13096 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:26.770203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:26.770203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:26.770203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:26.770203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:26.770203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:26.770203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:26.770203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:26.770203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:26.770203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:26.770203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:26.770203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:26.770203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:26.770203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:26.770203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:26.770203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:26.771116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:26.771116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:26.771116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:26.771116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:26.771116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:26.771116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:26.771116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:26.771116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:26.771116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:26.771116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:26.771116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:26.771116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:26.771116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:26.771116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:26.771116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:26.771116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:26.771911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:26.771911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:26.771911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:26.771911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:26.771911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:26.771911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:26.771911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:26.771911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:26.771911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:26.771911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:26.771911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:26.771911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:26.771911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 145/302] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:26.772574 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73dda9-ecd1-4ca8-85b6-fb0ebaf13096 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:26.791513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:26.794968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782277c-1d45-4ccd-9276-5265ee43008d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:26.833799 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2f253-4c34-469f-a6c9-63cdc887c539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:26.834570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2f253-4c34-469f-a6c9-63cdc887c539 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:26.834856 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2f253-4c34-469f-a6c9-63cdc887c539 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:26.835137 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2f253-4c34-469f-a6c9-63cdc887c539 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:26.835889 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2f253-4c34-469f-a6c9-63cdc887c539 None admin] RBAC: Adding query filter params (name=member) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:26.836200 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2f253-4c34-469f-a6c9-63cdc887c539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:26.837615 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2f253-4c34-469f-a6c9-63cdc887c539 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:26.846292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 158/303] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:26.850722 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2f253-4c34-469f-a6c9-63cdc887c539 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:26.887766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73dda9-ecd1-4ca8-85b6-fb0ebaf13096 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:26.905646 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:26.923374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9892b9b-3d4a-4e3f-a444-ab55ebee9899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:26.924173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9892b9b-3d4a-4e3f-a444-ab55ebee9899 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:26.924460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9892b9b-3d4a-4e3f-a444-ab55ebee9899 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:26.924727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9892b9b-3d4a-4e3f-a444-ab55ebee9899 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:26.926080 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9892b9b-3d4a-4e3f-a444-ab55ebee9899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:26.927732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9892b9b-3d4a-4e3f-a444-ab55ebee9899 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:26.929522 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 146/304] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:26.930415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9892b9b-3d4a-4e3f-a444-ab55ebee9899 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:26.960701 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2f253-4c34-469f-a6c9-63cdc887c539 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:27.000366 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced10e1-4823-4131-b81f-5a89315c5a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:27.001381 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced10e1-4823-4131-b81f-5a89315c5a0e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:27.001870 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced10e1-4823-4131-b81f-5a89315c5a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:27.002435 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced10e1-4823-4131-b81f-5a89315c5a0e None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:27.003555 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced10e1-4823-4131-b81f-5a89315c5a0e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:27.004084 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced10e1-4823-4131-b81f-5a89315c5a0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:27.005691 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced10e1-4823-4131-b81f-5a89315c5a0e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:27.013573 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:27.017257 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 159/305] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:27.018408 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced10e1-4823-4131-b81f-5a89315c5a0e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:27.038137 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9892b9b-3d4a-4e3f-a444-ab55ebee9899 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:27.075478 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519d66d-c286-4f42-8039-d888301b3af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:27.076467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519d66d-c286-4f42-8039-d888301b3af5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:27.076754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519d66d-c286-4f42-8039-d888301b3af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:27.077024 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519d66d-c286-4f42-8039-d888301b3af5 None admin] PATH_INFO: `/v3/users/ef1ec34045884db69bf5282b44cf85b3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:27.078983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519d66d-c286-4f42-8039-d888301b3af5 None admin] RBAC: Authorizing `identity:get_user(user_id=ef1ec34045884db69bf5282b44cf85b3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:27.080430 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519d66d-c286-4f42-8039-d888301b3af5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:27.082082 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 147/306] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:26 2022] GET /identity/v3/users/ef1ec34045884db69bf5282b44cf85b3 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:27.087578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519d66d-c286-4f42-8039-d888301b3af5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:27.141462 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced10e1-4823-4131-b81f-5a89315c5a0e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:27.156816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:27.181773 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f292c-1a20-441b-bde8-833ba2800ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:27.182372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f292c-1a20-441b-bde8-833ba2800ed2 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:27.182775 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f292c-1a20-441b-bde8-833ba2800ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:27.183057 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f292c-1a20-441b-bde8-833ba2800ed2 None admin] PATH_INFO: `/v3/groups` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:27.183767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f292c-1a20-441b-bde8-833ba2800ed2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:27.185518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f292c-1a20-441b-bde8-833ba2800ed2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:27.197272 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519d66d-c286-4f42-8039-d888301b3af5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:27.231896 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9a065-8725-4b18-93bf-7b72ad64f957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:27.232774 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9a065-8725-4b18-93bf-7b72ad64f957 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:27.233057 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9a065-8725-4b18-93bf-7b72ad64f957 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:27.233367 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9a065-8725-4b18-93bf-7b72ad64f957 None admin] PATH_INFO: `/v3/users/4f77543a902849b49efce5b323ad5163` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:27.247483 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9a065-8725-4b18-93bf-7b72ad64f957 None admin] RBAC: Authorizing `identity:get_user(user_id=4f77543a902849b49efce5b323ad5163)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:27.248939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9a065-8725-4b18-93bf-7b72ad64f957 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:27.250739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 148/307] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:27 2022] GET /identity/v3/users/4f77543a902849b49efce5b323ad5163 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:27.251523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9a065-8725-4b18-93bf-7b72ad64f957 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:27.259541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:27.265681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 160/308] 10.222.0.52 () {60 vars in 1134 bytes} [Fri Jun 17 07:15:27 2022] POST /identity/v3/groups => generated 229 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:15:27.265681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4807c2e-f619-4f67-9fc8-28db78d8d7bc None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:27.265681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4807c2e-f619-4f67-9fc8-28db78d8d7bc None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:27.265681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4807c2e-f619-4f67-9fc8-28db78d8d7bc None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:27.266720 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 161/309] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:27.267395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4807c2e-f619-4f67-9fc8-28db78d8d7bc None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:27.376325 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9a065-8725-4b18-93bf-7b72ad64f957 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:27.391258 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4807c2e-f619-4f67-9fc8-28db78d8d7bc None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:27.420833 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3255f-d8b6-443e-b4fd-b3f07b1f4702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:27.423210 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3255f-d8b6-443e-b4fd-b3f07b1f4702 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:27.423496 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3255f-d8b6-443e-b4fd-b3f07b1f4702 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:27.423773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3255f-d8b6-443e-b4fd-b3f07b1f4702 None admin] PATH_INFO: `/v3/system/users/ef1ec34045884db69bf5282b44cf85b3/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:27.425351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3255f-d8b6-443e-b4fd-b3f07b1f4702 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ef1ec34045884db69bf5282b44cf85b3, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:27.426869 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3255f-d8b6-443e-b4fd-b3f07b1f4702 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:27.432341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e46ba5-803d-4f72-b7c7-5af103909637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:27.432943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e46ba5-803d-4f72-b7c7-5af103909637 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:27.433221 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e46ba5-803d-4f72-b7c7-5af103909637 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:27.433519 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e46ba5-803d-4f72-b7c7-5af103909637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:27.434353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e46ba5-803d-4f72-b7c7-5af103909637 None admin] RBAC: Adding query filter params (role.id=66d59f53ac4c4817bc23b4588234e3ad, user.id=4f77543a902849b49efce5b323ad5163, scope.system=all) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:27.434656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e46ba5-803d-4f72-b7c7-5af103909637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:27.436087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e46ba5-803d-4f72-b7c7-5af103909637 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:27.441836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 162/310] 10.222.0.52 () {56 vars in 1308 bytes} [Fri Jun 17 07:15:27 2022] GET /identity/v3/role_assignments?user.id=4f77543a902849b49efce5b323ad5163&scope.system=all&role.id=66d59f53ac4c4817bc23b4588234e3ad => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:27.443164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfd916-3c51-4742-bc7b-15a78cb8fc6e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:27.443453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfd916-3c51-4742-bc7b-15a78cb8fc6e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:27.443728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfd916-3c51-4742-bc7b-15a78cb8fc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:27.461844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c5bfd916-3c51-4742-bc7b-15a78cb8fc6e None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:27.463062 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c5bfd916-3c51-4742-bc7b-15a78cb8fc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:27.502565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:27.514293 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 149/311] 10.222.0.52 () {58 vars in 1334 bytes} [Fri Jun 17 07:15:27 2022] PUT /identity/v3/system/users/ef1ec34045884db69bf5282b44cf85b3/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:15:27.551781 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 163/312] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:27.576463 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3255f-d8b6-443e-b4fd-b3f07b1f4702 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:27.663222 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:27.699908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3255f-d8b6-443e-b4fd-b3f07b1f4702 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:27.736451 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223814d8-ec31-4aa9-95ee-df583468c74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:27.737312 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223814d8-ec31-4aa9-95ee-df583468c74e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:27.737685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223814d8-ec31-4aa9-95ee-df583468c74e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:27.737971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223814d8-ec31-4aa9-95ee-df583468c74e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:27.750264 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223814d8-ec31-4aa9-95ee-df583468c74e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:27.758309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-223814d8-ec31-4aa9-95ee-df583468c74e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:27.758309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:27.758309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:27.758309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:27.758309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:27.758309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:27.758309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:27.758309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:27.758309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:27.758309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:27.758309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:27.758309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:27.758309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:27.758309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:27.758309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:27.758309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:27.759184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:27.759184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:27.759184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:27.759184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:27.759184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:27.759184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:27.759184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:27.759184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:27.759184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:27.759184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:27.759184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:27.759184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:27.759184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:27.759184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:27.759184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:27.759184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:27.760414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:27.760414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:27.760414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:27.760414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:27.760414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:27.760414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:27.760414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:27.760414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:27.760414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:27.760414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:27.760414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:27.760414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:27.760414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 150/313] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:27.767219 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfd916-3c51-4742-bc7b-15a78cb8fc6e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:27.871855 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfd916-3c51-4742-bc7b-15a78cb8fc6e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:27.908286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26c5ed-9b27-4ea4-ab3e-d7cbaf382eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:27.908955 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26c5ed-9b27-4ea4-ab3e-d7cbaf382eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:27.909236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26c5ed-9b27-4ea4-ab3e-d7cbaf382eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:27.909555 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26c5ed-9b27-4ea4-ab3e-d7cbaf382eb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:27.910363 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26c5ed-9b27-4ea4-ab3e-d7cbaf382eb0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:27.910669 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26c5ed-9b27-4ea4-ab3e-d7cbaf382eb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:27.912111 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26c5ed-9b27-4ea4-ab3e-d7cbaf382eb0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:27.925930 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 164/314] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:27.931387 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223814d8-ec31-4aa9-95ee-df583468c74e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:28.039124 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223814d8-ec31-4aa9-95ee-df583468c74e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:28.069748 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:28.075785 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd4218-7334-4d86-8d7e-52dc043a762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:28.076911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd4218-7334-4d86-8d7e-52dc043a762a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:28.077445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd4218-7334-4d86-8d7e-52dc043a762a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:28.078037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd4218-7334-4d86-8d7e-52dc043a762a None admin] PATH_INFO: `/v3/users/24b6bdb2a1e84cf3b340134690e4ce8e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:28.079443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd4218-7334-4d86-8d7e-52dc043a762a None admin] RBAC: Authorizing `identity:get_user(user_id=24b6bdb2a1e84cf3b340134690e4ce8e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:28.081212 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd4218-7334-4d86-8d7e-52dc043a762a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:28.083296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 151/315] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:27 2022] GET /identity/v3/users/24b6bdb2a1e84cf3b340134690e4ce8e => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:28.089271 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26c5ed-9b27-4ea4-ab3e-d7cbaf382eb0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:28.121297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:28.194362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26c5ed-9b27-4ea4-ab3e-d7cbaf382eb0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:28.230934 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eca9f4-4366-4c93-b53e-a970df94170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:28.231581 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eca9f4-4366-4c93-b53e-a970df94170f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:28.231858 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eca9f4-4366-4c93-b53e-a970df94170f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:28.232126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eca9f4-4366-4c93-b53e-a970df94170f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:28.301624 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eca9f4-4366-4c93-b53e-a970df94170f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:28.303005 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eca9f4-4366-4c93-b53e-a970df94170f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:28.333707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:28.403232 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 165/316] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:28.409515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd4218-7334-4d86-8d7e-52dc043a762a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:28.516539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd4218-7334-4d86-8d7e-52dc043a762a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:28.555320 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d35e4c-c143-477e-8fea-212a0f94b92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:28.556132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d35e4c-c143-477e-8fea-212a0f94b92a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:28.556413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d35e4c-c143-477e-8fea-212a0f94b92a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:28.556686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d35e4c-c143-477e-8fea-212a0f94b92a None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:28.557966 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d35e4c-c143-477e-8fea-212a0f94b92a None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:28.559435 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d35e4c-c143-477e-8fea-212a0f94b92a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:28.561462 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 152/317] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:28 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:28.567788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eca9f4-4366-4c93-b53e-a970df94170f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:28.670237 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eca9f4-4366-4c93-b53e-a970df94170f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:28.699651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:28.706485 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0990b6-f263-4072-9b5e-8fe81ecd8b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:28.707163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0990b6-f263-4072-9b5e-8fe81ecd8b1d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:28.707445 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0990b6-f263-4072-9b5e-8fe81ecd8b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:28.707716 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0990b6-f263-4072-9b5e-8fe81ecd8b1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:28.708565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0990b6-f263-4072-9b5e-8fe81ecd8b1d None admin] RBAC: Adding query filter params (role.id=66d59f53ac4c4817bc23b4588234e3ad, scope.project.id=51ef9f86f53c47068be8821419cdd2c0, user.id=24b6bdb2a1e84cf3b340134690e4ce8e) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:28.708874 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0990b6-f263-4072-9b5e-8fe81ecd8b1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:28.710388 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0990b6-f263-4072-9b5e-8fe81ecd8b1d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:28.717281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 166/318] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:28 2022] GET /identity/v3/role_assignments?user.id=24b6bdb2a1e84cf3b340134690e4ce8e&scope.project.id=51ef9f86f53c47068be8821419cdd2c0&role.id=66d59f53ac4c4817bc23b4588234e3ad => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:29.581850 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ade8b-4afa-4f46-be84-d4d81f348bb2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:29.582370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ade8b-4afa-4f46-be84-d4d81f348bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:29.582370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ade8b-4afa-4f46-be84-d4d81f348bb2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:29.583792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 153/319] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:29.588896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dc64e-795b-4d33-824b-a65c94718494 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:29.589280 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dc64e-795b-4d33-824b-a65c94718494 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:29.589479 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dc64e-795b-4d33-824b-a65c94718494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:29.600888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329de77-74d8-44c0-8cb6-6a6c540e8f1c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:29.601179 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329de77-74d8-44c0-8cb6-6a6c540e8f1c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:29.601918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329de77-74d8-44c0-8cb6-6a6c540e8f1c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:29.603579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 154/320] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:29.606724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-2c1dc64e-795b-4d33-824b-a65c94718494 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:29.607964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2c1dc64e-795b-4d33-824b-a65c94718494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:29.608472 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae5bf3-55ba-4880-9a14-f9a5c7d637e7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:29.609351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae5bf3-55ba-4880-9a14-f9a5c7d637e7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:29.609645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae5bf3-55ba-4880-9a14-f9a5c7d637e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:29.629001 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b6ae5bf3-55ba-4880-9a14-f9a5c7d637e7 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:29.630169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b6ae5bf3-55ba-4880-9a14-f9a5c7d637e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:29.683138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 167/321] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:29.699540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:29.705568 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dc64e-795b-4d33-824b-a65c94718494 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:29.708210 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 155/322] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:15:29.731265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae5bf3-55ba-4880-9a14-f9a5c7d637e7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:29.813870 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dc64e-795b-4d33-824b-a65c94718494 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:29.833975 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae5bf3-55ba-4880-9a14-f9a5c7d637e7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:29.836780 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:29.847513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31703e1-367a-4117-8480-831cf3305531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:29.850876 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31703e1-367a-4117-8480-831cf3305531 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:29.850876 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31703e1-367a-4117-8480-831cf3305531 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:29.850876 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31703e1-367a-4117-8480-831cf3305531 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:29.850876 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31703e1-367a-4117-8480-831cf3305531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:29.851430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31703e1-367a-4117-8480-831cf3305531 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:29.853045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 168/323] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:29.854244 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaad1b-e78f-4440-909e-a09c824e15a5 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:29.854525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaad1b-e78f-4440-909e-a09c824e15a5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:29.854798 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaad1b-e78f-4440-909e-a09c824e15a5 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:29.856016 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 169/324] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:29.858759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaad1b-e78f-4440-909e-a09c824e15a5 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:29.873497 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ccd01-e07d-4b8e-9bcf-d3416aa73d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:29.874313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ccd01-e07d-4b8e-9bcf-d3416aa73d8d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:29.874623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ccd01-e07d-4b8e-9bcf-d3416aa73d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:29.874899 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ccd01-e07d-4b8e-9bcf-d3416aa73d8d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:29.885271 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ccd01-e07d-4b8e-9bcf-d3416aa73d8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:29.893533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8b1ccd01-e07d-4b8e-9bcf-d3416aa73d8d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:29.893533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:29.893533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:29.893533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:29.893533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:29.893533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:29.893533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:29.893533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:29.893533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:29.893533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:29.893533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:29.893533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:29.893533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:29.893533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:29.893533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:29.893533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:29.894540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:29.894540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:29.894540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:29.894540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:29.894540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:29.894540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:29.894540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:29.894540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:29.894540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:29.894540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:29.894540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:29.894540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:29.894540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:29.894540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:29.894540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:29.894540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:29.895338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:29.895338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:29.895338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:29.895338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:29.895338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:29.895338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:29.895338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:29.895338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:29.895338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:29.895338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:29.895338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:29.895338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:29.895338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 156/325] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:29.896006 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f846055-1fe9-4937-ba9a-6ae502436070 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:29.896320 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f846055-1fe9-4937-ba9a-6ae502436070 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:29.896658 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f846055-1fe9-4937-ba9a-6ae502436070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:29.913309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6f846055-1fe9-4937-ba9a-6ae502436070 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:29.914519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6f846055-1fe9-4937-ba9a-6ae502436070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:29.963939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:29.964696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaad1b-e78f-4440-909e-a09c824e15a5 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:29.980726 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 157/326] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:29.981567 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f846055-1fe9-4937-ba9a-6ae502436070 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:30.002155 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba23dc-d6fc-4e3b-bb72-9f1b913b5ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:30.002852 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba23dc-d6fc-4e3b-bb72-9f1b913b5ea0 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:30.003286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba23dc-d6fc-4e3b-bb72-9f1b913b5ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:30.003413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba23dc-d6fc-4e3b-bb72-9f1b913b5ea0 None admin] PATH_INFO: `/v3/groups` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:30.004078 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba23dc-d6fc-4e3b-bb72-9f1b913b5ea0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:30.005546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba23dc-d6fc-4e3b-bb72-9f1b913b5ea0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:30.085085 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f846055-1fe9-4937-ba9a-6ae502436070 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:30.085263 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 170/327] 10.222.0.52 () {60 vars in 1134 bytes} [Fri Jun 17 07:15:29 2022] POST /identity/v3/groups => generated 226 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:15:30.086565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba23dc-d6fc-4e3b-bb72-9f1b913b5ea0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:30.137889 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9db04-75a6-499d-b459-2381985a2f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:30.139069 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9db04-75a6-499d-b459-2381985a2f0a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:30.139331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9db04-75a6-499d-b459-2381985a2f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:30.139753 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9db04-75a6-499d-b459-2381985a2f0a None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:30.141524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9db04-75a6-499d-b459-2381985a2f0a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:30.141988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9db04-75a6-499d-b459-2381985a2f0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:30.144204 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9db04-75a6-499d-b459-2381985a2f0a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:30.162778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 158/328] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:30.162980 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:30.164008 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9db04-75a6-499d-b459-2381985a2f0a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:30.226744 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba23dc-d6fc-4e3b-bb72-9f1b913b5ea0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:30.244325 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:30.264814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f13fdb-156f-4a17-8eb7-6a3dc3e48de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:30.266215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f13fdb-156f-4a17-8eb7-6a3dc3e48de9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:30.266555 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f13fdb-156f-4a17-8eb7-6a3dc3e48de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:30.266887 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f13fdb-156f-4a17-8eb7-6a3dc3e48de9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:30.278565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f13fdb-156f-4a17-8eb7-6a3dc3e48de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:30.286989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-f8f13fdb-156f-4a17-8eb7-6a3dc3e48de9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:30.286989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:30.286989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:30.286989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:30.286989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:30.286989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:30.286989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:30.286989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:30.286989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:30.286989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:30.286989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:30.286989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:30.286989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:30.286989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:30.286989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:30.286989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:30.287883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:30.287883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:30.287883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:30.287883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:30.287883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:30.287883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:30.287883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:30.287883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:30.287883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:30.287883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:30.287883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:30.287883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:30.287883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:30.287883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:30.287883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:30.287883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:30.288666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:30.288666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:30.288666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:30.288666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:30.288666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:30.288666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:30.288666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:30.288666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:30.288666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:30.288666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:30.288666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:30.288666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:30.288666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 171/329] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:30.295837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f13fdb-156f-4a17-8eb7-6a3dc3e48de9 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:30.304996 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9db04-75a6-499d-b459-2381985a2f0a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:30.351661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43518a-f111-433a-8722-94a9a9cdabfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:30.352481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43518a-f111-433a-8722-94a9a9cdabfb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:30.352760 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43518a-f111-433a-8722-94a9a9cdabfb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:30.353031 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43518a-f111-433a-8722-94a9a9cdabfb None admin] PATH_INFO: `/v3/users/4f77543a902849b49efce5b323ad5163` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:30.354486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43518a-f111-433a-8722-94a9a9cdabfb None admin] RBAC: Authorizing `identity:get_user(user_id=4f77543a902849b49efce5b323ad5163)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:30.356074 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43518a-f111-433a-8722-94a9a9cdabfb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:30.358074 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 159/330] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:30 2022] GET /identity/v3/users/4f77543a902849b49efce5b323ad5163 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:30.365170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43518a-f111-433a-8722-94a9a9cdabfb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:30.419541 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f13fdb-156f-4a17-8eb7-6a3dc3e48de9 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:30.434570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:30.471679 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b51b97-5f59-419c-a96a-1e6cb2ee37ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:30.472354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b51b97-5f59-419c-a96a-1e6cb2ee37ac None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:30.472645 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b51b97-5f59-419c-a96a-1e6cb2ee37ac None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:30.472924 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b51b97-5f59-419c-a96a-1e6cb2ee37ac None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:30.473725 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b51b97-5f59-419c-a96a-1e6cb2ee37ac None admin] RBAC: Adding query filter params (name=member) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:30.474096 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b51b97-5f59-419c-a96a-1e6cb2ee37ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:30.475559 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b51b97-5f59-419c-a96a-1e6cb2ee37ac None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:30.486198 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 172/331] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:30.491574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b51b97-5f59-419c-a96a-1e6cb2ee37ac None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:30.493032 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43518a-f111-433a-8722-94a9a9cdabfb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:30.510265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:30.533560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c705315-c945-4b89-bab3-52e348daf855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:30.534447 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c705315-c945-4b89-bab3-52e348daf855 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:30.534729 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c705315-c945-4b89-bab3-52e348daf855 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:30.535010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c705315-c945-4b89-bab3-52e348daf855 None admin] PATH_INFO: `/v3/system/users/4f77543a902849b49efce5b323ad5163/roles/66d59f53ac4c4817bc23b4588234e3ad` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:30.536604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c705315-c945-4b89-bab3-52e348daf855 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4f77543a902849b49efce5b323ad5163, role_id=66d59f53ac4c4817bc23b4588234e3ad)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:30.538198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c705315-c945-4b89-bab3-52e348daf855 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:30.610638 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b51b97-5f59-419c-a96a-1e6cb2ee37ac None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:30.644866 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 160/332] 10.222.0.52 () {58 vars in 1334 bytes} [Fri Jun 17 07:15:30 2022] PUT /identity/v3/system/users/4f77543a902849b49efce5b323ad5163/roles/66d59f53ac4c4817bc23b4588234e3ad => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:15:30.654366 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325ea7f-a433-4dfb-a565-20e24ce15ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:30.655472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325ea7f-a433-4dfb-a565-20e24ce15ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:30.655785 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325ea7f-a433-4dfb-a565-20e24ce15ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:30.656087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325ea7f-a433-4dfb-a565-20e24ce15ea3 None admin] PATH_INFO: `/v3/users/ef1ec34045884db69bf5282b44cf85b3` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:30.657630 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325ea7f-a433-4dfb-a565-20e24ce15ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=ef1ec34045884db69bf5282b44cf85b3)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:30.659334 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325ea7f-a433-4dfb-a565-20e24ce15ea3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:30.661450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 173/333] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:30 2022] GET /identity/v3/users/ef1ec34045884db69bf5282b44cf85b3 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:30.667210 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c705315-c945-4b89-bab3-52e348daf855 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:30.785180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c705315-c945-4b89-bab3-52e348daf855 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:30.832095 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa1011-605d-4e3b-ab9d-bfc3f8f140f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:30.832847 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa1011-605d-4e3b-ab9d-bfc3f8f140f5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:30.833117 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa1011-605d-4e3b-ab9d-bfc3f8f140f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:30.833432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa1011-605d-4e3b-ab9d-bfc3f8f140f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:30.834331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa1011-605d-4e3b-ab9d-bfc3f8f140f5 None admin] RBAC: Adding query filter params (role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0, user.id=ef1ec34045884db69bf5282b44cf85b3, scope.system=all) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:30.836065 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa1011-605d-4e3b-ab9d-bfc3f8f140f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:30.836228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa1011-605d-4e3b-ab9d-bfc3f8f140f5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:30.849458 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 161/334] 10.222.0.52 () {56 vars in 1308 bytes} [Fri Jun 17 07:15:30 2022] GET /identity/v3/role_assignments?user.id=ef1ec34045884db69bf5282b44cf85b3&scope.system=all&role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:32.584062 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19bc33-85a3-4608-a9c3-35941098eb44 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:32.584610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19bc33-85a3-4608-a9c3-35941098eb44 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:32.584610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19bc33-85a3-4608-a9c3-35941098eb44 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:32.586268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 174/335] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:32.591846 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74217658-ed45-4d53-b430-6f3a5641e98f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:32.592257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74217658-ed45-4d53-b430-6f3a5641e98f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:32.592455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74217658-ed45-4d53-b430-6f3a5641e98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:32.618388 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-74217658-ed45-4d53-b430-6f3a5641e98f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:32.619599 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-74217658-ed45-4d53-b430-6f3a5641e98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:32.663034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:32.723423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 162/336] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:15:32.754889 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19bc33-85a3-4608-a9c3-35941098eb44 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:32.806210 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:32.873633 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19bc33-85a3-4608-a9c3-35941098eb44 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:32.910598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0fd3c-ead7-4289-8fa3-fd20fd5ad1a0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:32.910911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0fd3c-ead7-4289-8fa3-fd20fd5ad1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:32.911154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0fd3c-ead7-4289-8fa3-fd20fd5ad1a0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:32.912532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 163/337] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:15:32.915819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211b3b1-a0cc-48b5-9d77-e133f5783893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:32.916627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211b3b1-a0cc-48b5-9d77-e133f5783893 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:32.916906 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211b3b1-a0cc-48b5-9d77-e133f5783893 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:32.917181 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211b3b1-a0cc-48b5-9d77-e133f5783893 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:32.927770 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0e227-5f1d-466d-af97-acd72be5c29c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:32.928378 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0e227-5f1d-466d-af97-acd72be5c29c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:32.928873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0e227-5f1d-466d-af97-acd72be5c29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:32.929614 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211b3b1-a0cc-48b5-9d77-e133f5783893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:32.938341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-6211b3b1-a0cc-48b5-9d77-e133f5783893 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:32.938341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:32.938341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:32.938341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:32.938341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:32.938341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:32.938341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:32.938341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:32.938341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:32.938341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:32.938341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:32.938341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:32.938341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:32.938341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:32.938341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:32.938341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:32.939242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:32.939242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:32.939242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:32.939242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:32.939242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:32.939242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:32.939242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:32.939242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:32.939242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:32.939242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:32.939242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:32.939242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:32.939242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:32.939242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:32.939242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:32.939242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:32.940045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:32.940045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:32.940045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:32.940045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:32.940045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:32.940045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:32.940045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:32.940045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:32.940045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:32.940045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:32.940045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:32.940045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:32.949346 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 175/338] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:32.949346 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211b3b1-a0cc-48b5-9d77-e133f5783893 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:32.973412 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0fc0e227-5f1d-466d-af97-acd72be5c29c None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:32.974938 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0fc0e227-5f1d-466d-af97-acd72be5c29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:33.069834 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211b3b1-a0cc-48b5-9d77-e133f5783893 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:33.071390 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:33.120407 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17294b-597a-453f-9e23-fcde80cd0720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:33.121894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17294b-597a-453f-9e23-fcde80cd0720 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:33.122361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17294b-597a-453f-9e23-fcde80cd0720 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:33.122793 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17294b-597a-453f-9e23-fcde80cd0720 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:33.123749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17294b-597a-453f-9e23-fcde80cd0720 None admin] RBAC: Adding query filter params (name=member) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:33.124851 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17294b-597a-453f-9e23-fcde80cd0720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:33.126430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17294b-597a-453f-9e23-fcde80cd0720 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:33.138453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 176/339] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:33.144951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17294b-597a-453f-9e23-fcde80cd0720 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:33.172226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 164/340] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:33.206433 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0e227-5f1d-466d-af97-acd72be5c29c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:33.306452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17294b-597a-453f-9e23-fcde80cd0720 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:33.331853 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:33.336273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0e227-5f1d-466d-af97-acd72be5c29c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:33.357994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca3b21-d490-41db-b0cd-3c7a54c785ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:33.358724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca3b21-d490-41db-b0cd-3c7a54c785ac None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:33.359008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca3b21-d490-41db-b0cd-3c7a54c785ac None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:33.359289 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca3b21-d490-41db-b0cd-3c7a54c785ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:33.399579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39274e37-d4f5-4304-9fc9-7717a4174149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:33.399579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39274e37-d4f5-4304-9fc9-7717a4174149 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:33.399579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39274e37-d4f5-4304-9fc9-7717a4174149 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:33.399579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39274e37-d4f5-4304-9fc9-7717a4174149 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:33.415018 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39274e37-d4f5-4304-9fc9-7717a4174149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:33.430309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-39274e37-d4f5-4304-9fc9-7717a4174149 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:33.430309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:33.430309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:33.430309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:33.430309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:33.430309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:33.430309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:33.430309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:33.430309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:33.430309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:33.430309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:33.430309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:33.430309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:33.430309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:33.430309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:33.430309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:33.431461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:33.431461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:33.431461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:33.431461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:33.431461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:33.431461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:33.431461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:33.431461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:33.431461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:33.431461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:33.431461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:33.431461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:33.431461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:33.431461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:33.431461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:33.431461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:33.432432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:33.432432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:33.432432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:33.432432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:33.432432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:33.432432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:33.432432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:33.432432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:33.432432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:33.432432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:33.432432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:33.432432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:33.438644 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:33.438895 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 165/341] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:15:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:33.440443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39274e37-d4f5-4304-9fc9-7717a4174149 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:33.558172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca3b21-d490-41db-b0cd-3c7a54c785ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:33.559655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca3b21-d490-41db-b0cd-3c7a54c785ac None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:33.567202 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39274e37-d4f5-4304-9fc9-7717a4174149 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:33.605526 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bc8f9-1b3d-42c4-b28b-0a45375ff750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:33.606897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bc8f9-1b3d-42c4-b28b-0a45375ff750 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:33.607349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bc8f9-1b3d-42c4-b28b-0a45375ff750 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:33.607779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bc8f9-1b3d-42c4-b28b-0a45375ff750 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:33.609240 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bc8f9-1b3d-42c4-b28b-0a45375ff750 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:33.609808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bc8f9-1b3d-42c4-b28b-0a45375ff750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:33.611365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bc8f9-1b3d-42c4-b28b-0a45375ff750 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:33.620578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 166/342] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:33.626583 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bc8f9-1b3d-42c4-b28b-0a45375ff750 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:33.658334 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:33.735567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 177/343] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:33.742201 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca3b21-d490-41db-b0cd-3c7a54c785ac None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:33.790669 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bc8f9-1b3d-42c4-b28b-0a45375ff750 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:33.854623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e10b09-30e7-4bde-b87c-cd25c70a5158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:33.855281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e10b09-30e7-4bde-b87c-cd25c70a5158 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:33.855610 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e10b09-30e7-4bde-b87c-cd25c70a5158 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:33.855888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e10b09-30e7-4bde-b87c-cd25c70a5158 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:33.875353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:33.945489 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca3b21-d490-41db-b0cd-3c7a54c785ac None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:33.984639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e10b09-30e7-4bde-b87c-cd25c70a5158 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:33.986249 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e10b09-30e7-4bde-b87c-cd25c70a5158 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:34.009972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b84e94-c33a-48cb-93d4-083744159804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:34.009972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b84e94-c33a-48cb-93d4-083744159804 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:34.010268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b84e94-c33a-48cb-93d4-083744159804 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:34.010500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b84e94-c33a-48cb-93d4-083744159804 None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:34.011852 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b84e94-c33a-48cb-93d4-083744159804 None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:34.013799 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b84e94-c33a-48cb-93d4-083744159804 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:34.017438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 178/344] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:33 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:34.017671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:34.019040 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0a0dc-e135-4414-b1bf-ebbaf02ecd59 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:34.019446 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0a0dc-e135-4414-b1bf-ebbaf02ecd59 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:34.019823 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0a0dc-e135-4414-b1bf-ebbaf02ecd59 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:34.021522 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 179/345] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:34.023769 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e852af-de73-4c4c-bb81-8d81ddc20007 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:34.024058 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e852af-de73-4c4c-bb81-8d81ddc20007 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:34.024508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e852af-de73-4c4c-bb81-8d81ddc20007 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:34.026586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 180/346] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:34.031021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e852af-de73-4c4c-bb81-8d81ddc20007 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:34.113121 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 167/347] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:34.114566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a62c2-b9cc-49da-9087-b328aa22d2b6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:34.114860 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a62c2-b9cc-49da-9087-b328aa22d2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:34.115136 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a62c2-b9cc-49da-9087-b328aa22d2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:34.133443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d90a62c2-b9cc-49da-9087-b328aa22d2b6 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:34.134636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d90a62c2-b9cc-49da-9087-b328aa22d2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:34.162991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e852af-de73-4c4c-bb81-8d81ddc20007 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:34.197971 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:34.203590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cd8a5-0b0f-485b-a4ac-003e91432839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:34.204454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cd8a5-0b0f-485b-a4ac-003e91432839 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:34.204739 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cd8a5-0b0f-485b-a4ac-003e91432839 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:34.205019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cd8a5-0b0f-485b-a4ac-003e91432839 None admin] PATH_INFO: `/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:34.212097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cd8a5-0b0f-485b-a4ac-003e91432839 None admin] RBAC: Authorizing `identity:get_group(group_id=9ccc23ccfc7145e1abef8cbc395fab07)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:34.213682 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cd8a5-0b0f-485b-a4ac-003e91432839 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:34.215865 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 168/349] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:34.217372 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf79459-965f-4363-bb0b-25266057ab34 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:34.217667 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf79459-965f-4363-bb0b-25266057ab34 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:34.218481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf79459-965f-4363-bb0b-25266057ab34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:34.221098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 181/349] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Jun 17 07:15:34 2022] GET /identity/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:34.222015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cd8a5-0b0f-485b-a4ac-003e91432839 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:34.237070 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7cf79459-965f-4363-bb0b-25266057ab34 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:34.239287 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7cf79459-965f-4363-bb0b-25266057ab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:34.294376 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:34.319924 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 169/350] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:34.320926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf79459-965f-4363-bb0b-25266057ab34 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:34.345945 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cd8a5-0b0f-485b-a4ac-003e91432839 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:34.392545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83b3c0-f173-4687-975f-fc20d7c46736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:34.393572 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83b3c0-f173-4687-975f-fc20d7c46736 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:34.393929 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83b3c0-f173-4687-975f-fc20d7c46736 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:34.394494 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83b3c0-f173-4687-975f-fc20d7c46736 None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:34.395713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83b3c0-f173-4687-975f-fc20d7c46736 None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:34.397802 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83b3c0-f173-4687-975f-fc20d7c46736 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:34.400518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 182/351] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:34 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:34.401381 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83b3c0-f173-4687-975f-fc20d7c46736 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:34.463328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf79459-965f-4363-bb0b-25266057ab34 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:34.485680 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:34.508751 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f05f1-a7dc-4066-a686-1cd0371f4fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:34.509563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f05f1-a7dc-4066-a686-1cd0371f4fbf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:34.509850 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f05f1-a7dc-4066-a686-1cd0371f4fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:34.510179 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f05f1-a7dc-4066-a686-1cd0371f4fbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:34.511164 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f05f1-a7dc-4066-a686-1cd0371f4fbf None admin] RBAC: Adding query filter params (group.id=9ccc23ccfc7145e1abef8cbc395fab07, role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0, scope.project.id=89c6b2302f0d4de4a8c94b498362991f) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:34.511940 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f05f1-a7dc-4066-a686-1cd0371f4fbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:34.513683 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f05f1-a7dc-4066-a686-1cd0371f4fbf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:34.522313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 170/352] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Jun 17 07:15:34 2022] GET /identity/v3/role_assignments?group.id=9ccc23ccfc7145e1abef8cbc395fab07&scope.project.id=89c6b2302f0d4de4a8c94b498362991f&role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:34.523143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f05f1-a7dc-4066-a686-1cd0371f4fbf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:34.543133 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83b3c0-f173-4687-975f-fc20d7c46736 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:34.579045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:34.633105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c042a7c-c161-4be5-b6fd-bebe1947969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:34.633949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c042a7c-c161-4be5-b6fd-bebe1947969f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:34.634229 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c042a7c-c161-4be5-b6fd-bebe1947969f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:34.634504 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c042a7c-c161-4be5-b6fd-bebe1947969f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:34.646437 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f05f1-a7dc-4066-a686-1cd0371f4fbf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:34.666069 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c042a7c-c161-4be5-b6fd-bebe1947969f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:34.682374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-3c042a7c-c161-4be5-b6fd-bebe1947969f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:34.682374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:34.682374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:34.682374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:34.682374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:34.682374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:34.682374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:34.682374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:34.682374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:34.682374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:34.682374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:34.682374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:34.682374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:34.682374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:34.682374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:34.682374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:34.683500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:34.683500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:34.683500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:34.683500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:34.683500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:34.683500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:34.683500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:34.683500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:34.683500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:34.683500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:34.683500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:34.683500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:34.683500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:34.683500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:34.683500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:34.683500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:34.684438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:34.684438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:34.684438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:34.684438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:34.684438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:34.684438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:34.684438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:34.684438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:34.684438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:34.684438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:34.684438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:34.684438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:34.684438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 183/353] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:34.685623 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c042a7c-c161-4be5-b6fd-bebe1947969f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:34.707636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22a1c5-ae88-4870-93ad-d1a7cc67e590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:34.708741 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22a1c5-ae88-4870-93ad-d1a7cc67e590 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:34.709173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22a1c5-ae88-4870-93ad-d1a7cc67e590 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:34.709614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22a1c5-ae88-4870-93ad-d1a7cc67e590 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:34.729076 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22a1c5-ae88-4870-93ad-d1a7cc67e590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:34.737700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-3b22a1c5-ae88-4870-93ad-d1a7cc67e590 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:34.737700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:34.737700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:34.737700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:34.737700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:34.737700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:34.737700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:34.737700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:34.737700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:34.737700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:34.737700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:34.737700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:34.737700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:34.737700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:34.737700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:34.737700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:34.738857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:34.738857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:34.738857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:34.738857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:34.738857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:34.738857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:34.738857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:34.738857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:34.738857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:34.738857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:34.738857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:34.738857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:34.738857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:34.738857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:34.738857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:34.738857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:34.739858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:34.739858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:34.739858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:34.739858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:34.739858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:34.739858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:34.739858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:34.739858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:34.739858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:34.739858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:34.739858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:15:34.739858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:34.742150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 171/354] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:34.743183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22a1c5-ae88-4870-93ad-d1a7cc67e590 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:34.847886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c042a7c-c161-4be5-b6fd-bebe1947969f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:34.879236 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22a1c5-ae88-4870-93ad-d1a7cc67e590 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:34.881952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:34.885668 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:34.899348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1a86c-84f4-40d0-8e16-3494e4c99d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:34.900236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1a86c-84f4-40d0-8e16-3494e4c99d0f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:34.900515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1a86c-84f4-40d0-8e16-3494e4c99d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:34.900789 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1a86c-84f4-40d0-8e16-3494e4c99d0f None admin] PATH_INFO: `/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:34.902533 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1a86c-84f4-40d0-8e16-3494e4c99d0f None admin] RBAC: Authorizing `identity:get_group(group_id=9ccc23ccfc7145e1abef8cbc395fab07)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:34.903985 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1a86c-84f4-40d0-8e16-3494e4c99d0f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:34.906245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 184/355] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Jun 17 07:15:34 2022] GET /identity/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:34.912993 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2464ed-1d0f-4643-8b00-b09aa8cb4bdf None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:34.913273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2464ed-1d0f-4643-8b00-b09aa8cb4bdf None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:34.913688 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2464ed-1d0f-4643-8b00-b09aa8cb4bdf None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:34.915039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 185/356] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:34.915740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2464ed-1d0f-4643-8b00-b09aa8cb4bdf None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:34.929539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254f1eb-77af-4205-b8d6-d29f41f0b705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:34.931879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254f1eb-77af-4205-b8d6-d29f41f0b705 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:34.931879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254f1eb-77af-4205-b8d6-d29f41f0b705 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:34.931879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254f1eb-77af-4205-b8d6-d29f41f0b705 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:34.932215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254f1eb-77af-4205-b8d6-d29f41f0b705 None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:34.932666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254f1eb-77af-4205-b8d6-d29f41f0b705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:34.934379 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254f1eb-77af-4205-b8d6-d29f41f0b705 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:34.945474 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 172/357] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:34.951180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254f1eb-77af-4205-b8d6-d29f41f0b705 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:35.031119 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2464ed-1d0f-4643-8b00-b09aa8cb4bdf None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:35.067035 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d55f0c-59e0-4d20-b50c-12f58c934df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:35.067943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d55f0c-59e0-4d20-b50c-12f58c934df4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:35.068547 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d55f0c-59e0-4d20-b50c-12f58c934df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:35.068969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d55f0c-59e0-4d20-b50c-12f58c934df4 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:35.069155 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254f1eb-77af-4205-b8d6-d29f41f0b705 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:35.070043 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d55f0c-59e0-4d20-b50c-12f58c934df4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:35.070499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d55f0c-59e0-4d20-b50c-12f58c934df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:35.072019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d55f0c-59e0-4d20-b50c-12f58c934df4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:35.082243 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 186/358] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:35.083818 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bcab7-7086-4601-8b80-f652d9a4791d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:35.084476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bcab7-7086-4601-8b80-f652d9a4791d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:35.084945 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bcab7-7086-4601-8b80-f652d9a4791d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:35.103451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a64bcab7-7086-4601-8b80-f652d9a4791d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:35.105553 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a64bcab7-7086-4601-8b80-f652d9a4791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:35.111148 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346ccf3-7b0b-4020-b0f2-5ae8e1bfb462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:35.111948 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ccf3-7b0b-4020-b0f2-5ae8e1bfb462 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:35.112304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ccf3-7b0b-4020-b0f2-5ae8e1bfb462 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:35.112725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ccf3-7b0b-4020-b0f2-5ae8e1bfb462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:35.113723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346ccf3-7b0b-4020-b0f2-5ae8e1bfb462 None admin] RBAC: Adding query filter params (group.id=9ccc23ccfc7145e1abef8cbc395fab07, role.id=930830d015f94e249715290654948151, scope.project.id=89c6b2302f0d4de4a8c94b498362991f) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:35.114105 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346ccf3-7b0b-4020-b0f2-5ae8e1bfb462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:35.116386 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346ccf3-7b0b-4020-b0f2-5ae8e1bfb462 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:35.122974 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 173/359] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Jun 17 07:15:34 2022] GET /identity/v3/role_assignments?group.id=9ccc23ccfc7145e1abef8cbc395fab07&scope.project.id=89c6b2302f0d4de4a8c94b498362991f&role.id=930830d015f94e249715290654948151 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:35.124040 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346ccf3-7b0b-4020-b0f2-5ae8e1bfb462 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:35.195619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:35.216512 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:35.246301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 187/360] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:35.247183 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bcab7-7086-4601-8b80-f652d9a4791d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:35.305813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346ccf3-7b0b-4020-b0f2-5ae8e1bfb462 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:35.349164 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ef87a-78f6-4556-aa28-b6d000aa4295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:35.349860 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ef87a-78f6-4556-aa28-b6d000aa4295 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:35.350191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ef87a-78f6-4556-aa28-b6d000aa4295 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:35.350678 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ef87a-78f6-4556-aa28-b6d000aa4295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:35.430759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bcab7-7086-4601-8b80-f652d9a4791d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:35.439410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ef87a-78f6-4556-aa28-b6d000aa4295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:35.440908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ef87a-78f6-4556-aa28-b6d000aa4295 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:35.485547 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698ea79-0f95-412a-9909-4fe1938089ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:35.486790 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698ea79-0f95-412a-9909-4fe1938089ac None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:35.487265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698ea79-0f95-412a-9909-4fe1938089ac None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:35.487770 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698ea79-0f95-412a-9909-4fe1938089ac None admin] PATH_INFO: `/v3/users/4f77543a902849b49efce5b323ad5163` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:35.489547 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698ea79-0f95-412a-9909-4fe1938089ac None admin] RBAC: Authorizing `identity:get_user(user_id=4f77543a902849b49efce5b323ad5163)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:35.491223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698ea79-0f95-412a-9909-4fe1938089ac None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:35.494475 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:35.495085 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 188/361] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:35 2022] GET /identity/v3/users/4f77543a902849b49efce5b323ad5163 => generated 293 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:35.496123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698ea79-0f95-412a-9909-4fe1938089ac None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:35.563953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:35.569707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 174/362] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:35.571687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ce403-e642-48b1-9521-91a61020b487 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:35.572538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ce403-e642-48b1-9521-91a61020b487 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:35.573162 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ce403-e642-48b1-9521-91a61020b487 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:35.574920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 175/363] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:35.579756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ce403-e642-48b1-9521-91a61020b487 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:35.619003 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698ea79-0f95-412a-9909-4fe1938089ac None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:35.658683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7272ee-2c4e-4d6d-9a3c-ee205ae8e17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:35.659836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7272ee-2c4e-4d6d-9a3c-ee205ae8e17c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:35.660335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7272ee-2c4e-4d6d-9a3c-ee205ae8e17c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:35.660810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7272ee-2c4e-4d6d-9a3c-ee205ae8e17c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:35.687972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7272ee-2c4e-4d6d-9a3c-ee205ae8e17c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:35.696454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-8f7272ee-2c4e-4d6d-9a3c-ee205ae8e17c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:35.696454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:35.696454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:35.696454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:35.696454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:35.696454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:35.696454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:35.696454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:35.696454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:35.696454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:35.696454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:35.696454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:35.696454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:35.696454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:35.696454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:35.696454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:35.698061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:35.698061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:35.698061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:35.698061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:35.698061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:35.698061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:35.698061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:35.698061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:35.698061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:35.698061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:35.698061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:35.698061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:35.698061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:35.698061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:35.698061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:35.698061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:35.698920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:35.698920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:35.698920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:35.698920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:35.698920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:35.698920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:35.698920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:35.698920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:35.698920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:35.698920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:35.698920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:35.698920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:35.701129 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ce403-e642-48b1-9521-91a61020b487 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:35.702793 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 189/364] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:15:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:35.703844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7272ee-2c4e-4d6d-9a3c-ee205ae8e17c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:35.737294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:35.744236 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05100b36-18cb-4d2a-a46b-88b7188fdfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:35.744889 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05100b36-18cb-4d2a-a46b-88b7188fdfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:35.745197 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05100b36-18cb-4d2a-a46b-88b7188fdfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:35.746282 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05100b36-18cb-4d2a-a46b-88b7188fdfd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:35.751572 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05100b36-18cb-4d2a-a46b-88b7188fdfd7 None admin] RBAC: Adding query filter params (role.id=66d59f53ac4c4817bc23b4588234e3ad, user.id=4f77543a902849b49efce5b323ad5163, scope.system=all) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:35.751572 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05100b36-18cb-4d2a-a46b-88b7188fdfd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:35.751572 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05100b36-18cb-4d2a-a46b-88b7188fdfd7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:35.764537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 176/365] 10.222.0.52 () {56 vars in 1308 bytes} [Fri Jun 17 07:15:35 2022] GET /identity/v3/role_assignments?user.id=4f77543a902849b49efce5b323ad5163&scope.system=all&role.id=66d59f53ac4c4817bc23b4588234e3ad => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:35.766366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3a29b-4cb0-4162-b80d-cfff72cf19e5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:35.766649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3a29b-4cb0-4162-b80d-cfff72cf19e5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:35.766918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3a29b-4cb0-4162-b80d-cfff72cf19e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:35.791059 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-20e3a29b-4cb0-4162-b80d-cfff72cf19e5 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:35.792361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-20e3a29b-4cb0-4162-b80d-cfff72cf19e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:35.851373 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7272ee-2c4e-4d6d-9a3c-ee205ae8e17c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:35.877750 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:35.903905 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 177/366] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:35.904240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191c4f9-44a2-4ee4-8a7a-db4ce0530ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:35.905097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191c4f9-44a2-4ee4-8a7a-db4ce0530ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:35.905479 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191c4f9-44a2-4ee4-8a7a-db4ce0530ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:35.905837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3a29b-4cb0-4162-b80d-cfff72cf19e5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:35.905963 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191c4f9-44a2-4ee4-8a7a-db4ce0530ec7 None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:35.907669 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191c4f9-44a2-4ee4-8a7a-db4ce0530ec7 None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:35.911623 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191c4f9-44a2-4ee4-8a7a-db4ce0530ec7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:35.913089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 190/367] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:35 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:35.918816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191c4f9-44a2-4ee4-8a7a-db4ce0530ec7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:36.040781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3a29b-4cb0-4162-b80d-cfff72cf19e5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:36.060469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191c4f9-44a2-4ee4-8a7a-db4ce0530ec7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:36.066186 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:36.087509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9deb4-2a41-43c2-ae7a-fbc5369f2b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:36.088559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9deb4-2a41-43c2-ae7a-fbc5369f2b41 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:36.090523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9deb4-2a41-43c2-ae7a-fbc5369f2b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:36.090523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9deb4-2a41-43c2-ae7a-fbc5369f2b41 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:36.090523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9deb4-2a41-43c2-ae7a-fbc5369f2b41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:36.090523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9deb4-2a41-43c2-ae7a-fbc5369f2b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:36.092440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9deb4-2a41-43c2-ae7a-fbc5369f2b41 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:36.102888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 178/368] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:36.104106 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9deb4-2a41-43c2-ae7a-fbc5369f2b41 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:36.106027 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdbc6c-c108-4deb-ab2f-bd90f8bbdf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:36.106903 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdbc6c-c108-4deb-ab2f-bd90f8bbdf54 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:36.107163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdbc6c-c108-4deb-ab2f-bd90f8bbdf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:36.107434 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdbc6c-c108-4deb-ab2f-bd90f8bbdf54 None admin] PATH_INFO: `/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:36.109680 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdbc6c-c108-4deb-ab2f-bd90f8bbdf54 None admin] RBAC: Authorizing `identity:get_group(group_id=9ccc23ccfc7145e1abef8cbc395fab07)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:36.111761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdbc6c-c108-4deb-ab2f-bd90f8bbdf54 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:36.115362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 191/369] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Jun 17 07:15:35 2022] GET /identity/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:36.116142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdbc6c-c108-4deb-ab2f-bd90f8bbdf54 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:36.177042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:36.235616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9deb4-2a41-43c2-ae7a-fbc5369f2b41 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:36.237132 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdbc6c-c108-4deb-ab2f-bd90f8bbdf54 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:36.280103 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdd713-ecb0-4a14-b0c9-ad0e0f3bb780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:36.281900 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdd713-ecb0-4a14-b0c9-ad0e0f3bb780 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:36.282435 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdd713-ecb0-4a14-b0c9-ad0e0f3bb780 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:36.282915 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdd713-ecb0-4a14-b0c9-ad0e0f3bb780 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:36.283137 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb3b1a-04ed-4533-b3b0-20584b714c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:36.283797 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb3b1a-04ed-4533-b3b0-20584b714c64 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:36.284150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb3b1a-04ed-4533-b3b0-20584b714c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:36.284437 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb3b1a-04ed-4533-b3b0-20584b714c64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:36.298708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdd713-ecb0-4a14-b0c9-ad0e0f3bb780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:36.308331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-52bdd713-ecb0-4a14-b0c9-ad0e0f3bb780 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:36.308331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:36.308331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:36.308331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:36.308331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:36.308331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:36.308331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:36.308331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:36.308331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:36.308331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:36.308331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:36.308331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:36.308331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:36.308331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:36.308331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:36.308331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:36.309258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:36.309258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:36.309258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:36.309258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:36.309258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:36.309258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:36.309258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:36.309258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:36.309258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:36.309258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:36.309258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:36.309258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:36.309258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:36.309258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:36.309258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:36.309258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:36.310098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:36.310098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:36.310098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:36.310098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:36.310098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:36.310098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:36.310098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:36.310098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:36.310098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:36.310098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:36.310098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:36.310098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:36.312878 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 179/370] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:15:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:36.313926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdd713-ecb0-4a14-b0c9-ad0e0f3bb780 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:36.365182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:36.369452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb3b1a-04ed-4533-b3b0-20584b714c64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:36.371222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb3b1a-04ed-4533-b3b0-20584b714c64 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:36.434108 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:36.443060 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdd713-ecb0-4a14-b0c9-ad0e0f3bb780 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:36.482816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac24df-964a-4819-92da-a08f3d211bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:36.484001 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac24df-964a-4819-92da-a08f3d211bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:36.484602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac24df-964a-4819-92da-a08f3d211bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:36.485079 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac24df-964a-4819-92da-a08f3d211bd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:36.486147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac24df-964a-4819-92da-a08f3d211bd5 None admin] RBAC: Adding query filter params (group.id=9ccc23ccfc7145e1abef8cbc395fab07, role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0, scope.project.id=51ef9f86f53c47068be8821419cdd2c0) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:36.486863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac24df-964a-4819-92da-a08f3d211bd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:36.488648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac24df-964a-4819-92da-a08f3d211bd5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:36.496550 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 180/371] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Jun 17 07:15:36 2022] GET /identity/v3/role_assignments?group.id=9ccc23ccfc7145e1abef8cbc395fab07&scope.project.id=51ef9f86f53c47068be8821419cdd2c0&role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:36.497655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac24df-964a-4819-92da-a08f3d211bd5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:36.497981 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 192/372] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:36.511489 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb3b1a-04ed-4533-b3b0-20584b714c64 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:36.664222 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac24df-964a-4819-92da-a08f3d211bd5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:36.668344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:36.736278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270bab6-63bf-4c51-9107-b762fef1266b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:36.737021 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270bab6-63bf-4c51-9107-b762fef1266b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:36.737241 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270bab6-63bf-4c51-9107-b762fef1266b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:36.737545 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270bab6-63bf-4c51-9107-b762fef1266b None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:36.738301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270bab6-63bf-4c51-9107-b762fef1266b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:36.738608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270bab6-63bf-4c51-9107-b762fef1266b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:36.740008 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270bab6-63bf-4c51-9107-b762fef1266b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:36.753723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 181/373] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:36.756582 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb3b1a-04ed-4533-b3b0-20584b714c64 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:36.759825 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270bab6-63bf-4c51-9107-b762fef1266b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:36.806999 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fc62c-4d7e-4fa1-9767-616c2244502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:36.808160 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fc62c-4d7e-4fa1-9767-616c2244502c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:36.808438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fc62c-4d7e-4fa1-9767-616c2244502c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:36.808707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fc62c-4d7e-4fa1-9767-616c2244502c None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:36.814117 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fc62c-4d7e-4fa1-9767-616c2244502c None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:36.815618 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fc62c-4d7e-4fa1-9767-616c2244502c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:36.818393 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 193/374] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:36 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:36.824141 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fc62c-4d7e-4fa1-9767-616c2244502c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:36.849784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:36.958390 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fc62c-4d7e-4fa1-9767-616c2244502c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:36.970210 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270bab6-63bf-4c51-9107-b762fef1266b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:37.009312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a774359-bd6b-474f-9878-5b48e6c10cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:37.010558 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a774359-bd6b-474f-9878-5b48e6c10cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:37.011062 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a774359-bd6b-474f-9878-5b48e6c10cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:37.011549 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a774359-bd6b-474f-9878-5b48e6c10cc2 None admin] PATH_INFO: `/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:37.013598 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a774359-bd6b-474f-9878-5b48e6c10cc2 None admin] RBAC: Authorizing `identity:get_group(group_id=9ccc23ccfc7145e1abef8cbc395fab07)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:37.015764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a774359-bd6b-474f-9878-5b48e6c10cc2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:37.021661 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 194/375] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Jun 17 07:15:36 2022] GET /identity/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:37.024444 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a774359-bd6b-474f-9878-5b48e6c10cc2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:37.052437 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9ef81-9bbb-403f-8a33-5b0a1c35f9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:37.053530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9ef81-9bbb-403f-8a33-5b0a1c35f9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:37.056617 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9ef81-9bbb-403f-8a33-5b0a1c35f9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:37.057099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9ef81-9bbb-403f-8a33-5b0a1c35f9d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:37.132541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:37.176686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9ef81-9bbb-403f-8a33-5b0a1c35f9d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:37.180756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9ef81-9bbb-403f-8a33-5b0a1c35f9d7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:37.181663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:37.204011 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a774359-bd6b-474f-9878-5b48e6c10cc2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:37.286240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3341a-e450-479e-8ff9-58ecd96c0a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:37.286839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3341a-e450-479e-8ff9-58ecd96c0a8e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:37.287114 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3341a-e450-479e-8ff9-58ecd96c0a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:37.287391 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3341a-e450-479e-8ff9-58ecd96c0a8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:37.288236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3341a-e450-479e-8ff9-58ecd96c0a8e None admin] RBAC: Adding query filter params (group.id=9ccc23ccfc7145e1abef8cbc395fab07, role.id=930830d015f94e249715290654948151, scope.project.id=51ef9f86f53c47068be8821419cdd2c0) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:37.288534 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3341a-e450-479e-8ff9-58ecd96c0a8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:37.290016 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3341a-e450-479e-8ff9-58ecd96c0a8e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:37.300506 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 195/377] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Jun 17 07:15:37 2022] GET /identity/v3/role_assignments?group.id=9ccc23ccfc7145e1abef8cbc395fab07&scope.project.id=51ef9f86f53c47068be8821419cdd2c0&role.id=930830d015f94e249715290654948151 => generated 260 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:37.304909 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 182/377] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 07:15:37.306323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3341a-e450-479e-8ff9-58ecd96c0a8e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:37.336153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37a319-18b9-4c82-ba64-5d9e3b27a5d0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:37.336810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37a319-18b9-4c82-ba64-5d9e3b27a5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:37.337301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37a319-18b9-4c82-ba64-5d9e3b27a5d0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:37.339053 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 183/378] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:15:37.345026 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c793c65-fa0c-4790-9200-a089475d1f5e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:37.345641 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c793c65-fa0c-4790-9200-a089475d1f5e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:37.346137 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c793c65-fa0c-4790-9200-a089475d1f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:37.366089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2c793c65-fa0c-4790-9200-a089475d1f5e None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:37.367634 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2c793c65-fa0c-4790-9200-a089475d1f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:37.445405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:37.454359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 184/379] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:37.483075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c793c65-fa0c-4790-9200-a089475d1f5e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:37.571425 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3341a-e450-479e-8ff9-58ecd96c0a8e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:37.611061 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c793c65-fa0c-4790-9200-a089475d1f5e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:37.645268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfc81d-ba5d-48d8-9898-bb2bd0c9985e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:37.646864 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfc81d-ba5d-48d8-9898-bb2bd0c9985e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:37.647221 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfc81d-ba5d-48d8-9898-bb2bd0c9985e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:37.647568 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfc81d-ba5d-48d8-9898-bb2bd0c9985e None admin] PATH_INFO: `/v3/projects/be5f0ec6059e4393ac953e1a8c865e6d` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:37.649006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfc81d-ba5d-48d8-9898-bb2bd0c9985e None admin] RBAC: Authorizing `identity:get_project(project_id=be5f0ec6059e4393ac953e1a8c865e6d)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:37.651344 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfc81d-ba5d-48d8-9898-bb2bd0c9985e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:37.657424 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 196/380] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:37 2022] GET /identity/v3/projects/be5f0ec6059e4393ac953e1a8c865e6d => generated 344 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:37.660575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfc81d-ba5d-48d8-9898-bb2bd0c9985e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:37.668665 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc34c7a-5db6-4139-a7fb-9c35447ecc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:37.669518 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc34c7a-5db6-4139-a7fb-9c35447ecc63 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:37.669800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc34c7a-5db6-4139-a7fb-9c35447ecc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:37.670072 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc34c7a-5db6-4139-a7fb-9c35447ecc63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:37.683898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc34c7a-5db6-4139-a7fb-9c35447ecc63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:37.693999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-dbc34c7a-5db6-4139-a7fb-9c35447ecc63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:37.693999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:37.693999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:37.693999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:37.693999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:37.693999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:37.693999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:37.693999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:37.693999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:37.693999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:37.693999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:37.693999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:37.693999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:37.693999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:37.693999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:37.693999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:37.694929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:37.694929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:37.694929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:37.694929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:37.694929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:37.694929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:37.694929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:37.694929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:37.694929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:37.694929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:37.694929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:37.694929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:37.694929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:37.694929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:37.694929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:37.694929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:37.695745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:37.695745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:37.695745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:37.695745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:37.695745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:37.695745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:37.695745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:37.695745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:37.695745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:37.695745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:37.695745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:37.695745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:37.699138 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 185/381] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:37.702704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc34c7a-5db6-4139-a7fb-9c35447ecc63 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:37.723044 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:37.772657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:37.848542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc34c7a-5db6-4139-a7fb-9c35447ecc63 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:37.900274 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfc81d-ba5d-48d8-9898-bb2bd0c9985e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:37.913599 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbb9ed-d1b8-4b06-9551-bfe02dd554db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:37.914343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbb9ed-d1b8-4b06-9551-bfe02dd554db None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:37.914624 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbb9ed-d1b8-4b06-9551-bfe02dd554db None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:37.914896 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbb9ed-d1b8-4b06-9551-bfe02dd554db None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:37.915656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbb9ed-d1b8-4b06-9551-bfe02dd554db None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:37.915963 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbb9ed-d1b8-4b06-9551-bfe02dd554db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:37.917409 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbb9ed-d1b8-4b06-9551-bfe02dd554db None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:37.937486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 186/382] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:37.944804 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbb9ed-d1b8-4b06-9551-bfe02dd554db None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:37.981226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f257f34-68da-4af4-bfc8-deba5310305a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:37.982126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f257f34-68da-4af4-bfc8-deba5310305a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:37.982410 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f257f34-68da-4af4-bfc8-deba5310305a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:37.982674 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f257f34-68da-4af4-bfc8-deba5310305a None admin] PATH_INFO: `/v3/groups/d461eff1f04a474cb648ee77547a3b34` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:37.995824 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f257f34-68da-4af4-bfc8-deba5310305a None admin] RBAC: Authorizing `identity:get_group(group_id=d461eff1f04a474cb648ee77547a3b34)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:37.997300 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f257f34-68da-4af4-bfc8-deba5310305a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:38.003207 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 197/383] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Jun 17 07:15:37 2022] GET /identity/v3/groups/d461eff1f04a474cb648ee77547a3b34 => generated 229 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:38.004714 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedd2d0-cda7-41d8-99d0-7ca99b0d40ff None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:38.005000 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedd2d0-cda7-41d8-99d0-7ca99b0d40ff None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:38.005275 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedd2d0-cda7-41d8-99d0-7ca99b0d40ff None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:38.006942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 198/384] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:38.010216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedd2d0-cda7-41d8-99d0-7ca99b0d40ff None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:38.085610 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbb9ed-d1b8-4b06-9551-bfe02dd554db None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:38.107904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:38.127127 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da593033-af2e-4cab-aa7c-1916dc87a4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:38.127577 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:38.128827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da593033-af2e-4cab-aa7c-1916dc87a4cc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:38.129159 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da593033-af2e-4cab-aa7c-1916dc87a4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:38.129465 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da593033-af2e-4cab-aa7c-1916dc87a4cc None admin] PATH_INFO: `/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:38.130737 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da593033-af2e-4cab-aa7c-1916dc87a4cc None admin] RBAC: Authorizing `identity:get_group(group_id=9ccc23ccfc7145e1abef8cbc395fab07)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:38.132236 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da593033-af2e-4cab-aa7c-1916dc87a4cc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:38.134712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 187/385] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Jun 17 07:15:37 2022] GET /identity/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:38.135888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebdb02-0149-47b9-b69a-b241ff64e777 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:38.136168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebdb02-0149-47b9-b69a-b241ff64e777 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:38.136440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebdb02-0149-47b9-b69a-b241ff64e777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:38.154482 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9cebdb02-0149-47b9-b69a-b241ff64e777 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:38.155714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9cebdb02-0149-47b9-b69a-b241ff64e777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:38.161666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedd2d0-cda7-41d8-99d0-7ca99b0d40ff None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:38.215395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa720ea-9a16-4f17-8d1a-db4d7ddee550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:38.216287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa720ea-9a16-4f17-8d1a-db4d7ddee550 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:38.216592 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa720ea-9a16-4f17-8d1a-db4d7ddee550 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:38.216867 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa720ea-9a16-4f17-8d1a-db4d7ddee550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:38.219052 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa720ea-9a16-4f17-8d1a-db4d7ddee550 None admin] RBAC: Adding query filter params (group.id=d461eff1f04a474cb648ee77547a3b34, role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=be5f0ec6059e4393ac953e1a8c865e6d) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:38.219552 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa720ea-9a16-4f17-8d1a-db4d7ddee550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:38.221695 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa720ea-9a16-4f17-8d1a-db4d7ddee550 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:38.229664 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 199/386] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Jun 17 07:15:38 2022] GET /identity/v3/role_assignments?group.id=d461eff1f04a474cb648ee77547a3b34&scope.project.id=be5f0ec6059e4393ac953e1a8c865e6d&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:38.230747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa720ea-9a16-4f17-8d1a-db4d7ddee550 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:38.247845 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 188/387] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:38.283527 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebdb02-0149-47b9-b69a-b241ff64e777 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:38.357499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa720ea-9a16-4f17-8d1a-db4d7ddee550 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:38.402008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bad624-0ae1-4752-9d3a-0f253ea80af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:38.402858 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad624-0ae1-4752-9d3a-0f253ea80af9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:38.403405 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad624-0ae1-4752-9d3a-0f253ea80af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:38.403696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad624-0ae1-4752-9d3a-0f253ea80af9 None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:38.404963 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bad624-0ae1-4752-9d3a-0f253ea80af9 None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:38.407629 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bad624-0ae1-4752-9d3a-0f253ea80af9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:38.409851 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 200/388] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:38 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:38.415766 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bad624-0ae1-4752-9d3a-0f253ea80af9 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:38.438565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:38.482885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebdb02-0149-47b9-b69a-b241ff64e777 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:38.506769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:38.532592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851de70b-ab87-4c07-a04c-e61a2e9af163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:38.533724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851de70b-ab87-4c07-a04c-e61a2e9af163 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:38.534014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851de70b-ab87-4c07-a04c-e61a2e9af163 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:38.534293 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851de70b-ab87-4c07-a04c-e61a2e9af163 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:38.550850 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851de70b-ab87-4c07-a04c-e61a2e9af163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:38.555942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bad624-0ae1-4752-9d3a-0f253ea80af9 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:38.561891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-851de70b-ab87-4c07-a04c-e61a2e9af163 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:38.561891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:38.561891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:38.561891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:38.561891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:38.561891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:38.561891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:38.561891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:38.561891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:38.561891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:38.561891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:38.561891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:38.561891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:38.561891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:38.561891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:38.561891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:38.563111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:38.563111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:38.563111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:38.563111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:38.563111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:38.563111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:38.563111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:38.563111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:38.563111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:38.563111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:38.563111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:38.563111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:38.563111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:38.563111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:38.563111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:38.563111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:38.564904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:38.564904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:38.564904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:38.564904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:38.564904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:38.564904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:38.564904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:38.564904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:38.564904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:38.564904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:38.564904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:38.564904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:38.564904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 189/389] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:15:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:38.569136 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851de70b-ab87-4c07-a04c-e61a2e9af163 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:38.599208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3643aa6-60da-4294-bedb-f5cc09e87c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:38.600097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3643aa6-60da-4294-bedb-f5cc09e87c6b None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:38.600377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3643aa6-60da-4294-bedb-f5cc09e87c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:38.600645 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3643aa6-60da-4294-bedb-f5cc09e87c6b None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f/groups/9ccc23ccfc7145e1abef8cbc395fab07/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:38.602957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3643aa6-60da-4294-bedb-f5cc09e87c6b None admin] RBAC: Authorizing `identity:create_grant(project_id=89c6b2302f0d4de4a8c94b498362991f, group_id=9ccc23ccfc7145e1abef8cbc395fab07, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:38.604404 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3643aa6-60da-4294-bedb-f5cc09e87c6b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:38.704831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851de70b-ab87-4c07-a04c-e61a2e9af163 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:38.727621 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 201/390] 10.222.0.52 () {58 vars in 1442 bytes} [Fri Jun 17 07:15:38 2022] PUT /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f/groups/9ccc23ccfc7145e1abef8cbc395fab07/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:15:38.748659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f135e8-ecbe-446a-9d4c-41171160d01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:38.750067 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f135e8-ecbe-446a-9d4c-41171160d01c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:38.750359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f135e8-ecbe-446a-9d4c-41171160d01c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:38.750708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f135e8-ecbe-446a-9d4c-41171160d01c None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:38.751672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f135e8-ecbe-446a-9d4c-41171160d01c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:38.751984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f135e8-ecbe-446a-9d4c-41171160d01c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:38.753662 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f135e8-ecbe-446a-9d4c-41171160d01c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:38.763771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 190/391] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:38.769538 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3643aa6-60da-4294-bedb-f5cc09e87c6b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:38.854818 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:38.887840 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3643aa6-60da-4294-bedb-f5cc09e87c6b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:38.927489 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808abd61-ae1b-4dd4-802a-673e40970dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:38.928720 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808abd61-ae1b-4dd4-802a-673e40970dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:38.929197 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808abd61-ae1b-4dd4-802a-673e40970dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:38.929756 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808abd61-ae1b-4dd4-802a-673e40970dc8 None admin] PATH_INFO: `/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:38.931150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808abd61-ae1b-4dd4-802a-673e40970dc8 None admin] RBAC: Authorizing `identity:get_group(group_id=9ccc23ccfc7145e1abef8cbc395fab07)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:38.932883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808abd61-ae1b-4dd4-802a-673e40970dc8 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:38.935114 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 202/392] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Jun 17 07:15:38 2022] GET /identity/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:38.942277 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f135e8-ecbe-446a-9d4c-41171160d01c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:39.013613 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:39.089753 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f135e8-ecbe-446a-9d4c-41171160d01c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:39.133627 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51785a30-a0ce-48bb-9736-2ce7057b0eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:39.134497 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785a30-a0ce-48bb-9736-2ce7057b0eca None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:39.134781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785a30-a0ce-48bb-9736-2ce7057b0eca None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:39.135058 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785a30-a0ce-48bb-9736-2ce7057b0eca None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:39.136281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51785a30-a0ce-48bb-9736-2ce7057b0eca None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:39.137766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51785a30-a0ce-48bb-9736-2ce7057b0eca None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:39.140410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 191/393] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:38 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:39.145799 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808abd61-ae1b-4dd4-802a-673e40970dc8 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:39.272082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808abd61-ae1b-4dd4-802a-673e40970dc8 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:39.305461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ccda9-fe18-4909-adc4-57a7c54670ad None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:39.306083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ccda9-fe18-4909-adc4-57a7c54670ad None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:39.306567 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ccda9-fe18-4909-adc4-57a7c54670ad None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:39.308118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 192/394] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:39.310085 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81535918-7a6c-46e2-8dba-09374b9d39fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:39.310947 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81535918-7a6c-46e2-8dba-09374b9d39fc None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:39.311229 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81535918-7a6c-46e2-8dba-09374b9d39fc None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:39.312093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81535918-7a6c-46e2-8dba-09374b9d39fc None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f/groups/9ccc23ccfc7145e1abef8cbc395fab07/roles/930830d015f94e249715290654948151` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:39.317579 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81535918-7a6c-46e2-8dba-09374b9d39fc None admin] RBAC: Authorizing `identity:create_grant(project_id=89c6b2302f0d4de4a8c94b498362991f, group_id=9ccc23ccfc7145e1abef8cbc395fab07, role_id=930830d015f94e249715290654948151)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:39.319036 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81535918-7a6c-46e2-8dba-09374b9d39fc None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:39.323056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39f4ed-4416-40bd-8622-d9bdcba931dc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:39.323541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39f4ed-4416-40bd-8622-d9bdcba931dc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:39.323819 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39f4ed-4416-40bd-8622-d9bdcba931dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:39.347857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5d39f4ed-4416-40bd-8622-d9bdcba931dc None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:39.349034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5d39f4ed-4416-40bd-8622-d9bdcba931dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:39.404098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:39.412459 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 203/395] 10.222.0.52 () {58 vars in 1442 bytes} [Fri Jun 17 07:15:39 2022] PUT /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f/groups/9ccc23ccfc7145e1abef8cbc395fab07/roles/930830d015f94e249715290654948151 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:15:39.451086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 193/396] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:39.484901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81535918-7a6c-46e2-8dba-09374b9d39fc None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:39.639117 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81535918-7a6c-46e2-8dba-09374b9d39fc None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:39.679951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a1037-2194-4fb9-a670-3da6e47309d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:39.681546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a1037-2194-4fb9-a670-3da6e47309d5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:39.683619 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a1037-2194-4fb9-a670-3da6e47309d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:39.683619 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a1037-2194-4fb9-a670-3da6e47309d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:39.698950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a1037-2194-4fb9-a670-3da6e47309d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:39.711518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-b56a1037-2194-4fb9-a670-3da6e47309d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:39.711518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:39.711518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:39.711518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:39.711518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:39.711518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:39.711518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:39.711518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:39.711518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:39.711518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:39.711518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:39.711518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:39.711518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:39.711518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:39.711518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:39.711518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:39.712450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:39.712450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:39.712450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:39.712450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:39.712450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:39.712450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:39.712450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:39.712450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:39.712450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:39.712450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:39.712450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:39.712450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:39.712450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:39.712450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:39.712450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:39.712450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:39.713265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:39.713265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:39.713265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:39.713265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:39.713265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:39.713265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:39.713265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:39.713265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:39.713265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:39.713265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:39.713265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:39.713265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:39.713975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 204/397] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:39.720967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39f4ed-4416-40bd-8622-d9bdcba931dc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:39.790478 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:39.881498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39f4ed-4416-40bd-8622-d9bdcba931dc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:39.934518 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d38d1d-7f06-4eb6-b214-b9e6af782cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:39.935521 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d38d1d-7f06-4eb6-b214-b9e6af782cce None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:39.935997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d38d1d-7f06-4eb6-b214-b9e6af782cce None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:39.936641 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d38d1d-7f06-4eb6-b214-b9e6af782cce None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:39.937705 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d38d1d-7f06-4eb6-b214-b9e6af782cce None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:39.938210 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d38d1d-7f06-4eb6-b214-b9e6af782cce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:39.940611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d38d1d-7f06-4eb6-b214-b9e6af782cce None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:39.954130 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 194/398] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:39.962592 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a1037-2194-4fb9-a670-3da6e47309d5 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:40.074684 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:40.137477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a1037-2194-4fb9-a670-3da6e47309d5 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:40.200041 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324dc672-aab9-4738-a9a8-c676f85610fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:40.200904 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dc672-aab9-4738-a9a8-c676f85610fb None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:40.201185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dc672-aab9-4738-a9a8-c676f85610fb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:40.201484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dc672-aab9-4738-a9a8-c676f85610fb None admin] PATH_INFO: `/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:40.202938 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dc672-aab9-4738-a9a8-c676f85610fb None admin] RBAC: Authorizing `identity:get_group(group_id=9ccc23ccfc7145e1abef8cbc395fab07)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:40.204756 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dc672-aab9-4738-a9a8-c676f85610fb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:40.213472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 205/399] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Jun 17 07:15:39 2022] GET /identity/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:40.218440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d38d1d-7f06-4eb6-b214-b9e6af782cce None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:40.395672 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdda958-ce8e-4728-988d-fffe8249351c None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:40.396355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdda958-ce8e-4728-988d-fffe8249351c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:40.396947 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdda958-ce8e-4728-988d-fffe8249351c None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:40.403816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 206/400] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:40.406994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01c1a5-f74e-48e6-9103-b0fb5e7f539d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:40.407762 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01c1a5-f74e-48e6-9103-b0fb5e7f539d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:40.408461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01c1a5-f74e-48e6-9103-b0fb5e7f539d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:40.428821 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d38d1d-7f06-4eb6-b214-b9e6af782cce None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:40.437514 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:40.450730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-bb01c1a5-f74e-48e6-9103-b0fb5e7f539d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:40.453177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-bb01c1a5-f74e-48e6-9103-b0fb5e7f539d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:40.483007 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c27d1-bf9f-4561-b4d8-ac17149cfd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:40.484429 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c27d1-bf9f-4561-b4d8-ac17149cfd75 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:40.484906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c27d1-bf9f-4561-b4d8-ac17149cfd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:40.487548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c27d1-bf9f-4561-b4d8-ac17149cfd75 None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:40.490477 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c27d1-bf9f-4561-b4d8-ac17149cfd75 None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:40.491930 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c27d1-bf9f-4561-b4d8-ac17149cfd75 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:40.501437 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 195/401] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:40 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:40.511977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c27d1-bf9f-4561-b4d8-ac17149cfd75 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:40.553273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 207/402] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:40.578664 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01c1a5-f74e-48e6-9103-b0fb5e7f539d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:40.645588 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:40.681289 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c27d1-bf9f-4561-b4d8-ac17149cfd75 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:40.696447 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01c1a5-f74e-48e6-9103-b0fb5e7f539d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:40.744236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21361f87-8b61-4e95-90f9-13d66cbf495f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:40.745451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21361f87-8b61-4e95-90f9-13d66cbf495f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:40.745944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21361f87-8b61-4e95-90f9-13d66cbf495f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:40.746418 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21361f87-8b61-4e95-90f9-13d66cbf495f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:40.758421 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21361f87-8b61-4e95-90f9-13d66cbf495f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:40.771886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-21361f87-8b61-4e95-90f9-13d66cbf495f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:40.771886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:40.771886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:40.771886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:40.771886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:40.771886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:40.771886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:40.771886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:40.771886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:40.771886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:40.771886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:40.771886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:40.771886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:40.771886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:40.771886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:40.771886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:40.772788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:40.772788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:40.772788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:40.772788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:40.772788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:40.772788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:40.772788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:40.772788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:40.772788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:40.772788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:40.772788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:40.772788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:40.772788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:40.772788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:40.772788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:40.772788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:40.773628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:40.773628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:40.773628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:40.773628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:40.773628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:40.773628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:40.773628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:40.773628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:40.773628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:40.773628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:40.773628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:40.773628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:40.774770 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ae006-aab4-4bed-8e77-f70fdf5b5144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:40.775466 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ae006-aab4-4bed-8e77-f70fdf5b5144 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:40.775743 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ae006-aab4-4bed-8e77-f70fdf5b5144 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:40.776015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ae006-aab4-4bed-8e77-f70fdf5b5144 None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0/groups/9ccc23ccfc7145e1abef8cbc395fab07/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:40.777188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 208/403] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:15:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:40.778024 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ae006-aab4-4bed-8e77-f70fdf5b5144 None admin] RBAC: Authorizing `identity:create_grant(project_id=51ef9f86f53c47068be8821419cdd2c0, group_id=9ccc23ccfc7145e1abef8cbc395fab07, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:40.779470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ae006-aab4-4bed-8e77-f70fdf5b5144 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:40.786782 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21361f87-8b61-4e95-90f9-13d66cbf495f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:40.890687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 196/404] 10.222.0.52 () {58 vars in 1442 bytes} [Fri Jun 17 07:15:40 2022] PUT /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0/groups/9ccc23ccfc7145e1abef8cbc395fab07/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:15:40.912024 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21361f87-8b61-4e95-90f9-13d66cbf495f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:40.942544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:40.961283 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa54031-1afd-4f3a-80ff-caf22b21eb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:40.962153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa54031-1afd-4f3a-80ff-caf22b21eb8c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:40.962662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa54031-1afd-4f3a-80ff-caf22b21eb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:40.963159 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa54031-1afd-4f3a-80ff-caf22b21eb8c None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:40.964589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa54031-1afd-4f3a-80ff-caf22b21eb8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:40.965153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa54031-1afd-4f3a-80ff-caf22b21eb8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:40.966845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa54031-1afd-4f3a-80ff-caf22b21eb8c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:40.982632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 209/405] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:40.989899 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ae006-aab4-4bed-8e77-f70fdf5b5144 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:41.044149 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:41.137049 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ae006-aab4-4bed-8e77-f70fdf5b5144 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:41.182891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cd6c7-6710-428b-a367-59e8571cdfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:41.183777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cd6c7-6710-428b-a367-59e8571cdfdb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:41.184054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cd6c7-6710-428b-a367-59e8571cdfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:41.184362 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cd6c7-6710-428b-a367-59e8571cdfdb None admin] PATH_INFO: `/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:41.185620 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cd6c7-6710-428b-a367-59e8571cdfdb None admin] RBAC: Authorizing `identity:get_group(group_id=9ccc23ccfc7145e1abef8cbc395fab07)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:41.187904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cd6c7-6710-428b-a367-59e8571cdfdb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:41.190812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 197/406] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Jun 17 07:15:40 2022] GET /identity/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:41.196718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa54031-1afd-4f3a-80ff-caf22b21eb8c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:41.247571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539e9b6-2edb-4e76-be0e-5757fdda0c28 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:41.247876 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539e9b6-2edb-4e76-be0e-5757fdda0c28 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:41.248120 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539e9b6-2edb-4e76-be0e-5757fdda0c28 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:41.250583 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 198/407] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:15:41.258454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cbd1e-dbcc-462b-9353-5731e9e56c49 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:41.258850 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cbd1e-dbcc-462b-9353-5731e9e56c49 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:41.259282 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cbd1e-dbcc-462b-9353-5731e9e56c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:41.279380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6f1cbd1e-dbcc-462b-9353-5731e9e56c49 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:41.280995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6f1cbd1e-dbcc-462b-9353-5731e9e56c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:41.322873 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa54031-1afd-4f3a-80ff-caf22b21eb8c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:41.365613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eb51e-2bc8-4c8a-bdbd-f8d4e8807629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:41.366825 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eb51e-2bc8-4c8a-bdbd-f8d4e8807629 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:41.367317 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eb51e-2bc8-4c8a-bdbd-f8d4e8807629 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:41.367779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eb51e-2bc8-4c8a-bdbd-f8d4e8807629 None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:41.369993 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53eb51e-2bc8-4c8a-bdbd-f8d4e8807629 None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:41.371614 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53eb51e-2bc8-4c8a-bdbd-f8d4e8807629 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:41.375032 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 210/408] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:41 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:41.383420 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eb51e-2bc8-4c8a-bdbd-f8d4e8807629 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:41.410166 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 199/409] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:41.449817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:41.467412 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cbd1e-dbcc-462b-9353-5731e9e56c49 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:41.505267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:41.521494 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eb51e-2bc8-4c8a-bdbd-f8d4e8807629 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:41.556650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d9e2c-b7a3-4021-b083-ab22ce00d6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:41.557943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d9e2c-b7a3-4021-b083-ab22ce00d6b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:41.558474 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d9e2c-b7a3-4021-b083-ab22ce00d6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:41.558938 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d9e2c-b7a3-4021-b083-ab22ce00d6b4 None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0/groups/9ccc23ccfc7145e1abef8cbc395fab07/roles/930830d015f94e249715290654948151` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:41.561968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d9e2c-b7a3-4021-b083-ab22ce00d6b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=51ef9f86f53c47068be8821419cdd2c0, group_id=9ccc23ccfc7145e1abef8cbc395fab07, role_id=930830d015f94e249715290654948151)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:41.564830 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d9e2c-b7a3-4021-b083-ab22ce00d6b4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:41.616064 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cbd1e-dbcc-462b-9353-5731e9e56c49 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:41.653204 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 211/410] 10.222.0.52 () {58 vars in 1442 bytes} [Fri Jun 17 07:15:41 2022] PUT /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0/groups/9ccc23ccfc7145e1abef8cbc395fab07/roles/930830d015f94e249715290654948151 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:15:41.660984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5481f3-4c29-43b0-ae86-d517730c6f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:41.662327 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5481f3-4c29-43b0-ae86-d517730c6f0b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:41.662809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5481f3-4c29-43b0-ae86-d517730c6f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:41.663278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5481f3-4c29-43b0-ae86-d517730c6f0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:41.688775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5481f3-4c29-43b0-ae86-d517730c6f0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:41.697448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-fb5481f3-4c29-43b0-ae86-d517730c6f0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:41.697448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:41.697448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:41.697448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:41.697448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:41.697448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:41.697448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:41.697448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:41.697448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:41.697448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:41.697448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:41.697448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:41.697448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:41.697448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:41.697448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:41.697448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:41.698421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:41.698421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:41.698421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:41.698421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:41.698421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:41.698421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:41.698421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:41.698421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:41.698421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:41.698421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:41.698421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:41.698421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:41.698421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:41.698421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:41.698421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:41.698421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:41.699286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:41.699286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:41.699286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:41.699286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:41.699286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:41.699286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:41.699286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:41.699286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:41.699286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:41.699286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:41.699286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:41.699286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:41.701788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 200/411] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:15:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:41.708203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d9e2c-b7a3-4021-b083-ab22ce00d6b4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:41.836908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d9e2c-b7a3-4021-b083-ab22ce00d6b4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:41.850255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:41.890479 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac60444-2d8c-4b6f-a4cf-7e701d8168f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:41.891089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac60444-2d8c-4b6f-a4cf-7e701d8168f5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:41.891369 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac60444-2d8c-4b6f-a4cf-7e701d8168f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:41.891642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac60444-2d8c-4b6f-a4cf-7e701d8168f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:41.892401 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac60444-2d8c-4b6f-a4cf-7e701d8168f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:41.892966 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac60444-2d8c-4b6f-a4cf-7e701d8168f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:41.894444 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac60444-2d8c-4b6f-a4cf-7e701d8168f5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:41.903745 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 212/412] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:41.909213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5481f3-4c29-43b0-ae86-d517730c6f0b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:42.009774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad13f21-7c24-44ca-8dc7-ad61e9bc3a53 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:42.010101 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad13f21-7c24-44ca-8dc7-ad61e9bc3a53 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:42.010311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad13f21-7c24-44ca-8dc7-ad61e9bc3a53 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:42.012048 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 213/413] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:42.017119 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d554cf-d733-4844-9a09-c78d47fbf79d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:42.017678 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d554cf-d733-4844-9a09-c78d47fbf79d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:42.018148 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d554cf-d733-4844-9a09-c78d47fbf79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:42.036441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-71d554cf-d733-4844-9a09-c78d47fbf79d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:42.038163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-71d554cf-d733-4844-9a09-c78d47fbf79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:42.040884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:42.066470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5481f3-4c29-43b0-ae86-d517730c6f0b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:42.129819 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c681385-5eb9-4159-9c81-95d21c985a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:42.131134 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c681385-5eb9-4159-9c81-95d21c985a82 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:42.131646 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c681385-5eb9-4159-9c81-95d21c985a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:42.132631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c681385-5eb9-4159-9c81-95d21c985a82 None admin] PATH_INFO: `/v3/groups/d461eff1f04a474cb648ee77547a3b34` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:42.134377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c681385-5eb9-4159-9c81-95d21c985a82 None admin] RBAC: Authorizing `identity:get_group(group_id=d461eff1f04a474cb648ee77547a3b34)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:42.136209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c681385-5eb9-4159-9c81-95d21c985a82 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:42.138751 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 201/414] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Jun 17 07:15:41 2022] GET /identity/v3/groups/d461eff1f04a474cb648ee77547a3b34 => generated 229 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:42.144827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c681385-5eb9-4159-9c81-95d21c985a82 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:42.162642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 214/415] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:42.199127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d554cf-d733-4844-9a09-c78d47fbf79d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:42.328167 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c681385-5eb9-4159-9c81-95d21c985a82 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:42.360212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:42.363968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d554cf-d733-4844-9a09-c78d47fbf79d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:42.381124 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d992307-e1e6-4570-abfa-24696bf0431f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:42.382747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d992307-e1e6-4570-abfa-24696bf0431f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:42.383243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d992307-e1e6-4570-abfa-24696bf0431f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:42.383710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d992307-e1e6-4570-abfa-24696bf0431f None admin] PATH_INFO: `/v3/projects/be5f0ec6059e4393ac953e1a8c865e6d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:42.385646 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d992307-e1e6-4570-abfa-24696bf0431f None admin] RBAC: Authorizing `identity:get_project(project_id=be5f0ec6059e4393ac953e1a8c865e6d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:42.387747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d992307-e1e6-4570-abfa-24696bf0431f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:42.390995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 202/416] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:42 2022] GET /identity/v3/projects/be5f0ec6059e4393ac953e1a8c865e6d => generated 344 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:42.396786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a3380-74f5-4908-ba0f-4a2c5e764784 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:42.396786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a3380-74f5-4908-ba0f-4a2c5e764784 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:42.396786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a3380-74f5-4908-ba0f-4a2c5e764784 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:42.396786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 203/417] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:42.402222 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a3380-74f5-4908-ba0f-4a2c5e764784 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:42.421369 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac0ead-88bb-46a2-b4ff-31a5155679b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:42.421369 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac0ead-88bb-46a2-b4ff-31a5155679b2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:42.421369 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac0ead-88bb-46a2-b4ff-31a5155679b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:42.421369 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac0ead-88bb-46a2-b4ff-31a5155679b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:42.432782 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac0ead-88bb-46a2-b4ff-31a5155679b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:42.434402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:42.441463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-1bac0ead-88bb-46a2-b4ff-31a5155679b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:42.441463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:42.441463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:42.441463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:42.441463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:42.441463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:42.441463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:42.441463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:42.441463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:42.441463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:42.441463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:42.441463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:42.441463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:42.441463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:42.441463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:42.441463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:42.442564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:42.442564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:42.442564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:42.442564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:42.442564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:42.442564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:42.442564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:42.442564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:42.442564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:42.442564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:42.442564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:42.442564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:42.442564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:42.442564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:42.442564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:42.442564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:42.443528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:42.443528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:42.443528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:42.443528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:42.443528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:42.443528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:42.443528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:42.443528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:42.443528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:42.443528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:42.443528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:42.443528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:42.443528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 215/418] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:42.444488 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f1b7e-1dde-47ea-b9e6-d3f3e7c045d1 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:42.444588 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f1b7e-1dde-47ea-b9e6-d3f3e7c045d1 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:42.444872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f1b7e-1dde-47ea-b9e6-d3f3e7c045d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:42.463656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-664f1b7e-1dde-47ea-b9e6-d3f3e7c045d1 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:42.465098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-664f1b7e-1dde-47ea-b9e6-d3f3e7c045d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:42.529129 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a3380-74f5-4908-ba0f-4a2c5e764784 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:42.539202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 216/419] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:42.547747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f1b7e-1dde-47ea-b9e6-d3f3e7c045d1 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:42.567872 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af793c0f-a5dd-422a-a59b-e6e1fc55b918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:42.569065 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af793c0f-a5dd-422a-a59b-e6e1fc55b918 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:42.569577 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af793c0f-a5dd-422a-a59b-e6e1fc55b918 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:42.570039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af793c0f-a5dd-422a-a59b-e6e1fc55b918 None admin] PATH_INFO: `/v3/projects/be5f0ec6059e4393ac953e1a8c865e6d/groups/d461eff1f04a474cb648ee77547a3b34/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:42.579002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af793c0f-a5dd-422a-a59b-e6e1fc55b918 None admin] RBAC: Authorizing `identity:create_grant(project_id=be5f0ec6059e4393ac953e1a8c865e6d, group_id=d461eff1f04a474cb648ee77547a3b34, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:42.582222 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af793c0f-a5dd-422a-a59b-e6e1fc55b918 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:42.660988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 204/420] 10.222.0.52 () {58 vars in 1442 bytes} [Fri Jun 17 07:15:42 2022] PUT /identity/v3/projects/be5f0ec6059e4393ac953e1a8c865e6d/groups/d461eff1f04a474cb648ee77547a3b34/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:15:42.661834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af793c0f-a5dd-422a-a59b-e6e1fc55b918 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:42.671388 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:42.687254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f1b7e-1dde-47ea-b9e6-d3f3e7c045d1 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:42.734969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4d21d-01a2-41aa-9b52-7ed655c9ffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:42.736484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4d21d-01a2-41aa-9b52-7ed655c9ffc4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:42.737029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4d21d-01a2-41aa-9b52-7ed655c9ffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:42.737505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4d21d-01a2-41aa-9b52-7ed655c9ffc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:42.738451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4d21d-01a2-41aa-9b52-7ed655c9ffc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:42.738892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4d21d-01a2-41aa-9b52-7ed655c9ffc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:42.740432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4d21d-01a2-41aa-9b52-7ed655c9ffc4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:42.752846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 217/421] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:42.758861 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4d21d-01a2-41aa-9b52-7ed655c9ffc4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:42.845710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:42.882877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4d21d-01a2-41aa-9b52-7ed655c9ffc4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:42.898065 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af793c0f-a5dd-422a-a59b-e6e1fc55b918 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:42.925884 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02736d84-0196-4c5b-b0ca-615467737eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:42.926935 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02736d84-0196-4c5b-b0ca-615467737eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:42.927430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02736d84-0196-4c5b-b0ca-615467737eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:42.927932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02736d84-0196-4c5b-b0ca-615467737eb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:42.951695 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:42.964623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf4fa1-5dc5-468b-8180-16335b750436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:42.968123 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf4fa1-5dc5-468b-8180-16335b750436 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:42.968123 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf4fa1-5dc5-468b-8180-16335b750436 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:42.968123 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf4fa1-5dc5-468b-8180-16335b750436 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:42.981054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf4fa1-5dc5-468b-8180-16335b750436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:42.993663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-7bdf4fa1-5dc5-468b-8180-16335b750436 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:42.993663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:42.993663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:42.993663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:42.993663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:42.993663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:42.993663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:42.993663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:42.993663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:42.993663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:42.993663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:42.993663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:42.993663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:42.993663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:42.993663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:42.993663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:42.994816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:42.994816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:42.994816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:42.994816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:42.994816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:42.994816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:42.994816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:42.994816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:42.994816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:42.994816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:42.994816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:42.994816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:42.994816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:42.994816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:42.994816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:42.994816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:42.995643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:42.995643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:42.995643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:42.995643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:42.995643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:42.995643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:42.995643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:42.995643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:42.995643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:42.995643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:42.995643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:42.995643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:42.997396 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 205/422] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:15:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:43.002871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf4fa1-5dc5-468b-8180-16335b750436 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:43.012992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02736d84-0196-4c5b-b0ca-615467737eb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:43.015236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02736d84-0196-4c5b-b0ca-615467737eb4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:43.144638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf4fa1-5dc5-468b-8180-16335b750436 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:43.180521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 218/423] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:43.185574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02736d84-0196-4c5b-b0ca-615467737eb4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:43.185895 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c8601-ab01-4a2a-aab5-ce6e926833f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:43.187441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c8601-ab01-4a2a-aab5-ce6e926833f5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:43.187727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c8601-ab01-4a2a-aab5-ce6e926833f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:43.187996 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c8601-ab01-4a2a-aab5-ce6e926833f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:43.188761 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c8601-ab01-4a2a-aab5-ce6e926833f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:43.189079 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c8601-ab01-4a2a-aab5-ce6e926833f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:43.193263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c8601-ab01-4a2a-aab5-ce6e926833f5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:43.206063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 206/424] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:43.207514 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c8601-ab01-4a2a-aab5-ce6e926833f5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:43.220161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:43.334844 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c8601-ab01-4a2a-aab5-ce6e926833f5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:43.341470 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:43.382725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66caba5-f238-4a74-8fcb-f06b49f5c155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:43.383803 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66caba5-f238-4a74-8fcb-f06b49f5c155 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:43.384319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66caba5-f238-4a74-8fcb-f06b49f5c155 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:43.384797 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66caba5-f238-4a74-8fcb-f06b49f5c155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:43.412507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02736d84-0196-4c5b-b0ca-615467737eb4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:43.470255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0da9c4-d11e-41e3-a25e-2e2698514baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:43.471069 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0da9c4-d11e-41e3-a25e-2e2698514baa None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:43.471357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0da9c4-d11e-41e3-a25e-2e2698514baa None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:43.471636 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0da9c4-d11e-41e3-a25e-2e2698514baa None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:43.472961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0da9c4-d11e-41e3-a25e-2e2698514baa None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:43.474481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0da9c4-d11e-41e3-a25e-2e2698514baa None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:43.476520 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 219/425] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:43 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:43.482683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0da9c4-d11e-41e3-a25e-2e2698514baa None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:43.522085 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66caba5-f238-4a74-8fcb-f06b49f5c155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:43.523820 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66caba5-f238-4a74-8fcb-f06b49f5c155 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:43.525801 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:43.598787 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0da9c4-d11e-41e3-a25e-2e2698514baa None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:43.620733 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:43.636402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 207/426] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:43.637793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d73efc-8336-49ac-b8ca-2515b4f36e6d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:43.638060 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d73efc-8336-49ac-b8ca-2515b4f36e6d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:43.638338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d73efc-8336-49ac-b8ca-2515b4f36e6d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:43.639056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa24dd4-32a6-4913-bf14-89aa1d26e7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:43.640493 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 208/427] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:43.641317 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa24dd4-32a6-4913-bf14-89aa1d26e7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:43.641603 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa24dd4-32a6-4913-bf14-89aa1d26e7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:43.641884 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa24dd4-32a6-4913-bf14-89aa1d26e7e7 None admin] PATH_INFO: `/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:43.642694 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d73efc-8336-49ac-b8ca-2515b4f36e6d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:43.643108 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa24dd4-32a6-4913-bf14-89aa1d26e7e7 None admin] RBAC: Authorizing `identity:get_group(group_id=9ccc23ccfc7145e1abef8cbc395fab07)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:43.644704 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa24dd4-32a6-4913-bf14-89aa1d26e7e7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:43.646914 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 220/428] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Jun 17 07:15:43 2022] GET /identity/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:43.649139 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98be56-2982-4548-998c-f1dc11da913d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:43.649461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98be56-2982-4548-998c-f1dc11da913d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:43.649738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98be56-2982-4548-998c-f1dc11da913d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:43.671198 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-cf98be56-2982-4548-998c-f1dc11da913d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:43.672621 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cf98be56-2982-4548-998c-f1dc11da913d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:43.757397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 221/429] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:43.758590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98be56-2982-4548-998c-f1dc11da913d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:43.782938 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d73efc-8336-49ac-b8ca-2515b4f36e6d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:43.785514 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:43.832448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c4b31-3e7c-47b6-bf18-74b01f9e1eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:43.833873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c4b31-3e7c-47b6-bf18-74b01f9e1eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:43.834761 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c4b31-3e7c-47b6-bf18-74b01f9e1eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:43.835500 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c4b31-3e7c-47b6-bf18-74b01f9e1eb8 None admin] PATH_INFO: `/v3/projects/89c6b2302f0d4de4a8c94b498362991f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:43.837034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c4b31-3e7c-47b6-bf18-74b01f9e1eb8 None admin] RBAC: Authorizing `identity:get_project(project_id=89c6b2302f0d4de4a8c94b498362991f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:43.839427 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c4b31-3e7c-47b6-bf18-74b01f9e1eb8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:43.842136 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 209/430] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:43 2022] GET /identity/v3/projects/89c6b2302f0d4de4a8c94b498362991f => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:43.844699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c4b31-3e7c-47b6-bf18-74b01f9e1eb8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:43.879726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98be56-2982-4548-998c-f1dc11da913d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:43.903145 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:43.921892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0e0f0-f85e-4c98-9485-d547b0e9a6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:43.922751 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0e0f0-f85e-4c98-9485-d547b0e9a6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:43.923123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0e0f0-f85e-4c98-9485-d547b0e9a6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:43.929238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0e0f0-f85e-4c98-9485-d547b0e9a6f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:43.929238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0e0f0-f85e-4c98-9485-d547b0e9a6f1 None admin] RBAC: Adding query filter params (group.id=9ccc23ccfc7145e1abef8cbc395fab07, role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0, scope.project.id=89c6b2302f0d4de4a8c94b498362991f) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:43.929238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0e0f0-f85e-4c98-9485-d547b0e9a6f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:43.929238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0e0f0-f85e-4c98-9485-d547b0e9a6f1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:43.933785 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 222/431] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Jun 17 07:15:43 2022] GET /identity/v3/role_assignments?group.id=9ccc23ccfc7145e1abef8cbc395fab07&scope.project.id=89c6b2302f0d4de4a8c94b498362991f&role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:43.934273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0e0f0-f85e-4c98-9485-d547b0e9a6f1 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:43.970482 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c4b31-3e7c-47b6-bf18-74b01f9e1eb8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:44.010922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54accbf-cb97-43f0-bc8f-63583f93301e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:44.012008 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54accbf-cb97-43f0-bc8f-63583f93301e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:44.012581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54accbf-cb97-43f0-bc8f-63583f93301e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:44.013031 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54accbf-cb97-43f0-bc8f-63583f93301e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:44.025941 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54accbf-cb97-43f0-bc8f-63583f93301e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:44.035150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c54accbf-cb97-43f0-bc8f-63583f93301e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:44.035150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:44.035150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:44.035150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:44.035150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:44.035150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:44.035150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:44.035150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:44.035150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:44.035150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:44.035150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:44.035150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:44.035150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:44.035150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:44.035150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:44.035150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:44.036078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:44.036078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:44.036078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:44.036078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:44.036078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:44.036078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:44.036078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:44.036078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:44.036078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:44.036078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:44.036078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:44.036078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:44.036078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:44.036078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:44.036078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:44.036078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:44.036885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:44.036885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:44.036885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:44.036885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:44.036885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:44.036885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:44.036885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:44.036885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:44.036885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:44.036885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:44.036885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:15:44.036885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:44.039529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 210/432] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:44.047005 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54accbf-cb97-43f0-bc8f-63583f93301e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:44.055817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0e0f0-f85e-4c98-9485-d547b0e9a6f1 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:44.103013 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90103bf7-719d-4596-8423-6192a32b1133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:44.104129 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90103bf7-719d-4596-8423-6192a32b1133 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:44.105867 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90103bf7-719d-4596-8423-6192a32b1133 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:44.106134 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90103bf7-719d-4596-8423-6192a32b1133 None admin] PATH_INFO: `/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:44.108899 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90103bf7-719d-4596-8423-6192a32b1133 None admin] RBAC: Authorizing `identity:get_group(group_id=9ccc23ccfc7145e1abef8cbc395fab07)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:44.110954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90103bf7-719d-4596-8423-6192a32b1133 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:44.114536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:44.117299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 223/433] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Jun 17 07:15:43 2022] GET /identity/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:44.126412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90103bf7-719d-4596-8423-6192a32b1133 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:44.212614 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:44.218142 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54accbf-cb97-43f0-bc8f-63583f93301e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:44.263012 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25004c6-a1eb-4d05-994f-203ec1862400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:44.263655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25004c6-a1eb-4d05-994f-203ec1862400 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:44.263940 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25004c6-a1eb-4d05-994f-203ec1862400 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:44.264215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25004c6-a1eb-4d05-994f-203ec1862400 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:44.265271 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25004c6-a1eb-4d05-994f-203ec1862400 None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:44.265661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25004c6-a1eb-4d05-994f-203ec1862400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:44.267052 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25004c6-a1eb-4d05-994f-203ec1862400 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:44.276229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 211/434] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:15:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:44.280115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90103bf7-719d-4596-8423-6192a32b1133 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:44.282176 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25004c6-a1eb-4d05-994f-203ec1862400 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:44.327468 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683e3f8-aa2e-4ba2-9d31-4f61544e32e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:44.328148 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683e3f8-aa2e-4ba2-9d31-4f61544e32e7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:44.328429 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683e3f8-aa2e-4ba2-9d31-4f61544e32e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:44.328730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683e3f8-aa2e-4ba2-9d31-4f61544e32e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:44.330715 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683e3f8-aa2e-4ba2-9d31-4f61544e32e7 None admin] RBAC: Adding query filter params (group.id=9ccc23ccfc7145e1abef8cbc395fab07, role.id=930830d015f94e249715290654948151, scope.project.id=89c6b2302f0d4de4a8c94b498362991f) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:44.331036 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683e3f8-aa2e-4ba2-9d31-4f61544e32e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:44.332717 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683e3f8-aa2e-4ba2-9d31-4f61544e32e7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:44.341932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 224/435] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Jun 17 07:15:44 2022] GET /identity/v3/role_assignments?group.id=9ccc23ccfc7145e1abef8cbc395fab07&scope.project.id=89c6b2302f0d4de4a8c94b498362991f&role.id=930830d015f94e249715290654948151 => generated 611 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:44.400663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaed3b-f40f-4169-9911-f447ef13caee None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:44.400852 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:44.400933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaed3b-f40f-4169-9911-f447ef13caee None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:44.401652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaed3b-f40f-4169-9911-f447ef13caee None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:44.403334 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 225/436] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:15:44.409592 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88b228-22c0-4b9b-a6a2-7254b5261b2a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:44.409896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88b228-22c0-4b9b-a6a2-7254b5261b2a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:44.410145 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88b228-22c0-4b9b-a6a2-7254b5261b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:44.411879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25004c6-a1eb-4d05-994f-203ec1862400 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:44.429413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6b88b228-22c0-4b9b-a6a2-7254b5261b2a None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:44.430637 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6b88b228-22c0-4b9b-a6a2-7254b5261b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:44.452777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6060b-9665-4b54-aa8c-f15249d73fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:44.453476 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6060b-9665-4b54-aa8c-f15249d73fea None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:44.453759 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6060b-9665-4b54-aa8c-f15249d73fea None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:44.454036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6060b-9665-4b54-aa8c-f15249d73fea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:44.522131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 226/437] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:44.541191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6060b-9665-4b54-aa8c-f15249d73fea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:44.542721 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6060b-9665-4b54-aa8c-f15249d73fea None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:44.545721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88b228-22c0-4b9b-a6a2-7254b5261b2a None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:44.613696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:44.673644 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:44.686835 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 212/438] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:44.692855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6060b-9665-4b54-aa8c-f15249d73fea None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:44.694025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88b228-22c0-4b9b-a6a2-7254b5261b2a None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:44.742203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3b561-1de7-4ead-bbc6-9fbd3533ce45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:44.742203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3b561-1de7-4ead-bbc6-9fbd3533ce45 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:44.742203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3b561-1de7-4ead-bbc6-9fbd3533ce45 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:44.742551 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3b561-1de7-4ead-bbc6-9fbd3533ce45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:44.756978 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3b561-1de7-4ead-bbc6-9fbd3533ce45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:44.767937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-ecb3b561-1de7-4ead-bbc6-9fbd3533ce45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:44.767937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:44.767937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:44.767937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:44.767937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:44.767937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:44.767937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:44.767937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:44.767937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:44.767937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:44.767937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:44.767937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:44.767937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:44.767937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:44.767937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:44.767937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:44.769068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:44.769068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:44.769068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:44.769068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:44.769068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:44.769068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:44.769068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:44.769068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:44.769068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:44.769068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:44.769068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:44.769068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:44.769068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:44.769068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:44.769068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:44.769068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:44.770074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:44.770074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:44.770074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:44.770074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:44.770074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:44.770074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:44.770074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:44.770074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:44.770074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:44.770074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:44.770074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:44.770074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:44.770074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 227/439] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:15:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:44.775470 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3b561-1de7-4ead-bbc6-9fbd3533ce45 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:44.828623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6060b-9665-4b54-aa8c-f15249d73fea None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:44.877870 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885b97b-e2f7-4f5a-8243-839e5ddfff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:44.879117 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885b97b-e2f7-4f5a-8243-839e5ddfff67 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:44.879398 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885b97b-e2f7-4f5a-8243-839e5ddfff67 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:44.879671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885b97b-e2f7-4f5a-8243-839e5ddfff67 None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:44.880875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885b97b-e2f7-4f5a-8243-839e5ddfff67 None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:44.882692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885b97b-e2f7-4f5a-8243-839e5ddfff67 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:44.884634 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 213/440] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:44 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:44.890547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885b97b-e2f7-4f5a-8243-839e5ddfff67 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:44.909569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3b561-1de7-4ead-bbc6-9fbd3533ce45 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:44.913136 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:44.961137 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca2e6c-c2de-483e-916e-a2212bd2e5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:44.961925 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca2e6c-c2de-483e-916e-a2212bd2e5de None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:44.962212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca2e6c-c2de-483e-916e-a2212bd2e5de None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:44.962495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca2e6c-c2de-483e-916e-a2212bd2e5de None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:44.962860 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:44.963252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca2e6c-c2de-483e-916e-a2212bd2e5de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:44.963562 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca2e6c-c2de-483e-916e-a2212bd2e5de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:44.964977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca2e6c-c2de-483e-916e-a2212bd2e5de None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:44.973788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 228/441] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:44.979384 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca2e6c-c2de-483e-916e-a2212bd2e5de None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:45.011219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885b97b-e2f7-4f5a-8243-839e5ddfff67 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:45.053811 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa670006-0257-43df-af11-1fdba844eb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:45.054594 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa670006-0257-43df-af11-1fdba844eb09 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:45.054880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa670006-0257-43df-af11-1fdba844eb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:45.055157 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa670006-0257-43df-af11-1fdba844eb09 None admin] PATH_INFO: `/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:45.056355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa670006-0257-43df-af11-1fdba844eb09 None admin] RBAC: Authorizing `identity:get_group(group_id=9ccc23ccfc7145e1abef8cbc395fab07)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:45.057859 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa670006-0257-43df-af11-1fdba844eb09 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:45.059473 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 214/442] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Jun 17 07:15:44 2022] GET /identity/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:45.065636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa670006-0257-43df-af11-1fdba844eb09 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:45.104446 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca2e6c-c2de-483e-916e-a2212bd2e5de None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:45.140847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612a115-52b7-4c57-b42d-85718c036b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:45.141526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612a115-52b7-4c57-b42d-85718c036b06 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:45.141814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612a115-52b7-4c57-b42d-85718c036b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:45.142094 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612a115-52b7-4c57-b42d-85718c036b06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:45.174338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa670006-0257-43df-af11-1fdba844eb09 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:45.178157 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:45.203734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:45.211220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d321d65-79c3-4cd0-8a6b-0ed6f1869663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:45.211876 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d321d65-79c3-4cd0-8a6b-0ed6f1869663 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:45.212162 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d321d65-79c3-4cd0-8a6b-0ed6f1869663 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:45.212436 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d321d65-79c3-4cd0-8a6b-0ed6f1869663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:45.213265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d321d65-79c3-4cd0-8a6b-0ed6f1869663 None admin] RBAC: Adding query filter params (group.id=9ccc23ccfc7145e1abef8cbc395fab07, role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0, scope.project.id=51ef9f86f53c47068be8821419cdd2c0) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:45.213603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d321d65-79c3-4cd0-8a6b-0ed6f1869663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:45.215037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d321d65-79c3-4cd0-8a6b-0ed6f1869663 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:45.215927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0612a115-52b7-4c57-b42d-85718c036b06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:45.218188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0612a115-52b7-4c57-b42d-85718c036b06 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:45.221943 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 215/443] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Jun 17 07:15:45 2022] GET /identity/v3/role_assignments?group.id=9ccc23ccfc7145e1abef8cbc395fab07&scope.project.id=51ef9f86f53c47068be8821419cdd2c0&role.id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:45.333360 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 229/444] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:45.335628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70add3-f5e2-48e7-a897-d0ab41478cbe None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:45.335990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70add3-f5e2-48e7-a897-d0ab41478cbe None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:45.336337 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70add3-f5e2-48e7-a897-d0ab41478cbe None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:45.340963 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 216/445] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:45.341151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612a115-52b7-4c57-b42d-85718c036b06 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:45.343843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9bdcf-c50b-4f6e-aea4-ae9d95e93fa0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:45.344128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9bdcf-c50b-4f6e-aea4-ae9d95e93fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:45.344405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9bdcf-c50b-4f6e-aea4-ae9d95e93fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:45.367211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-81b9bdcf-c50b-4f6e-aea4-ae9d95e93fa0 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:45.368576 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-81b9bdcf-c50b-4f6e-aea4-ae9d95e93fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:45.421692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:45.450221 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 217/446] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:15:45.466413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612a115-52b7-4c57-b42d-85718c036b06 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:45.474355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9bdcf-c50b-4f6e-aea4-ae9d95e93fa0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:45.507840 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9871e7d-5248-4eb7-8e06-81a647c2f1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:45.508711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9871e7d-5248-4eb7-8e06-81a647c2f1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:45.508990 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9871e7d-5248-4eb7-8e06-81a647c2f1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:45.509262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9871e7d-5248-4eb7-8e06-81a647c2f1d3 None admin] PATH_INFO: `/v3/projects/51ef9f86f53c47068be8821419cdd2c0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:45.510878 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9871e7d-5248-4eb7-8e06-81a647c2f1d3 None admin] RBAC: Authorizing `identity:get_project(project_id=51ef9f86f53c47068be8821419cdd2c0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:45.512362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9871e7d-5248-4eb7-8e06-81a647c2f1d3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:45.514134 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 230/447] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:45 2022] GET /identity/v3/projects/51ef9f86f53c47068be8821419cdd2c0 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:45.520142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9871e7d-5248-4eb7-8e06-81a647c2f1d3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:45.599324 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9bdcf-c50b-4f6e-aea4-ae9d95e93fa0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:45.623054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:45.631026 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9871e7d-5248-4eb7-8e06-81a647c2f1d3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:45.636498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1858cb-551b-4653-8e56-ec7a1f3e1fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:45.636498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1858cb-551b-4653-8e56-ec7a1f3e1fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:45.636498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1858cb-551b-4653-8e56-ec7a1f3e1fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:45.636498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1858cb-551b-4653-8e56-ec7a1f3e1fe8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:45.647205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1858cb-551b-4653-8e56-ec7a1f3e1fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:45.654781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8e1858cb-551b-4653-8e56-ec7a1f3e1fe8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:45.654781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:45.654781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:45.654781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:45.654781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:45.654781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:45.654781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:45.654781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:45.654781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:45.654781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:45.654781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:45.654781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:45.654781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:45.654781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:45.654781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:45.654781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:45.656549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:45.656549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:45.656549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:45.656549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:45.656549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:45.656549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:45.656549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:45.656549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:45.656549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:45.656549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:45.656549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:45.656549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:45.656549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:45.656549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:45.656549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:45.656549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:45.657385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:45.657385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:45.657385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:45.657385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:45.657385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:45.657385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:45.657385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:45.657385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:45.657385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:45.657385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:45.657385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:45.657385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:45.657385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 218/448] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:15:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:45.662987 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1858cb-551b-4653-8e56-ec7a1f3e1fe8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:45.670923 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7dad7-09a4-4d53-b033-2af60ecb0e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:45.672564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7dad7-09a4-4d53-b033-2af60ecb0e50 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:45.672854 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7dad7-09a4-4d53-b033-2af60ecb0e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:45.673134 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7dad7-09a4-4d53-b033-2af60ecb0e50 None admin] PATH_INFO: `/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:45.674461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7dad7-09a4-4d53-b033-2af60ecb0e50 None admin] RBAC: Authorizing `identity:get_group(group_id=9ccc23ccfc7145e1abef8cbc395fab07)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:45.675928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7dad7-09a4-4d53-b033-2af60ecb0e50 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:45.680155 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 231/449] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Jun 17 07:15:45 2022] GET /identity/v3/groups/9ccc23ccfc7145e1abef8cbc395fab07 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:45.683393 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7dad7-09a4-4d53-b033-2af60ecb0e50 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:45.686397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:45.767684 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1858cb-551b-4653-8e56-ec7a1f3e1fe8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:45.783353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7dad7-09a4-4d53-b033-2af60ecb0e50 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:45.800299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79a639-af72-41b0-95f1-8bc19f519dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:45.800967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79a639-af72-41b0-95f1-8bc19f519dae None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:45.801249 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79a639-af72-41b0-95f1-8bc19f519dae None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:45.801556 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79a639-af72-41b0-95f1-8bc19f519dae None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:45.802300 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79a639-af72-41b0-95f1-8bc19f519dae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:45.802609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79a639-af72-41b0-95f1-8bc19f519dae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:45.803981 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79a639-af72-41b0-95f1-8bc19f519dae None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:45.812524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 219/450] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:45.817655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb604dee-32b7-45d6-affc-2ebea3f43e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:45.818138 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79a639-af72-41b0-95f1-8bc19f519dae None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:45.818316 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb604dee-32b7-45d6-affc-2ebea3f43e52 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:45.818600 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb604dee-32b7-45d6-affc-2ebea3f43e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:45.818883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb604dee-32b7-45d6-affc-2ebea3f43e52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:45.819708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb604dee-32b7-45d6-affc-2ebea3f43e52 None admin] RBAC: Adding query filter params (group.id=9ccc23ccfc7145e1abef8cbc395fab07, role.id=930830d015f94e249715290654948151, scope.project.id=51ef9f86f53c47068be8821419cdd2c0) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:45.820019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb604dee-32b7-45d6-affc-2ebea3f43e52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:45.821475 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb604dee-32b7-45d6-affc-2ebea3f43e52 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:45.827466 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 232/451] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Jun 17 07:15:45 2022] GET /identity/v3/role_assignments?group.id=9ccc23ccfc7145e1abef8cbc395fab07&scope.project.id=51ef9f86f53c47068be8821419cdd2c0&role.id=930830d015f94e249715290654948151 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:45.865660 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:45.924744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79a639-af72-41b0-95f1-8bc19f519dae None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:45.959915 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f1e1d-10d9-4f8f-9e49-736167cb3fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:45.960574 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f1e1d-10d9-4f8f-9e49-736167cb3fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:45.960859 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f1e1d-10d9-4f8f-9e49-736167cb3fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:45.961134 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f1e1d-10d9-4f8f-9e49-736167cb3fa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:46.032043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f1e1d-10d9-4f8f-9e49-736167cb3fa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:46.033532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f1e1d-10d9-4f8f-9e49-736167cb3fa5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:46.078016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:46.133869 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 220/452] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 07:15:46.140402 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb604dee-32b7-45d6-affc-2ebea3f43e52 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:46.206545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:46.240040 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb604dee-32b7-45d6-affc-2ebea3f43e52 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:46.272873 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a4454-45fa-4efb-acb7-91b18bfe007e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:46.273746 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a4454-45fa-4efb-acb7-91b18bfe007e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:46.274031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a4454-45fa-4efb-acb7-91b18bfe007e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:46.274307 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a4454-45fa-4efb-acb7-91b18bfe007e None admin] PATH_INFO: `/v3/projects/be5f0ec6059e4393ac953e1a8c865e6d` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:46.275477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a4454-45fa-4efb-acb7-91b18bfe007e None admin] RBAC: Authorizing `identity:get_project(project_id=be5f0ec6059e4393ac953e1a8c865e6d)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:46.276917 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a4454-45fa-4efb-acb7-91b18bfe007e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:46.278625 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 233/453] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:46 2022] GET /identity/v3/projects/be5f0ec6059e4393ac953e1a8c865e6d => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:46.284163 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f1e1d-10d9-4f8f-9e49-736167cb3fa5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:46.380089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f1e1d-10d9-4f8f-9e49-736167cb3fa5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:46.412754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8faa8-0d19-4e06-8a43-3d1311961f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:46.413560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8faa8-0d19-4e06-8a43-3d1311961f85 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:46.413841 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8faa8-0d19-4e06-8a43-3d1311961f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:46.414111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8faa8-0d19-4e06-8a43-3d1311961f85 None admin] PATH_INFO: `/v3/groups/d461eff1f04a474cb648ee77547a3b34` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:46.415265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8faa8-0d19-4e06-8a43-3d1311961f85 None admin] RBAC: Authorizing `identity:get_group(group_id=d461eff1f04a474cb648ee77547a3b34)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:46.416701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8faa8-0d19-4e06-8a43-3d1311961f85 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:46.418305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 221/454] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Jun 17 07:15:46 2022] GET /identity/v3/groups/d461eff1f04a474cb648ee77547a3b34 => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:46.425598 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a4454-45fa-4efb-acb7-91b18bfe007e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:46.522247 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a4454-45fa-4efb-acb7-91b18bfe007e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:46.554675 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4635a-0982-46f9-af48-b55e434b7f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:46.555310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4635a-0982-46f9-af48-b55e434b7f69 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:46.555590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4635a-0982-46f9-af48-b55e434b7f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:46.555861 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4635a-0982-46f9-af48-b55e434b7f69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:46.556670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4635a-0982-46f9-af48-b55e434b7f69 None admin] RBAC: Adding query filter params (group.id=d461eff1f04a474cb648ee77547a3b34, role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=be5f0ec6059e4393ac953e1a8c865e6d) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:46.556977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4635a-0982-46f9-af48-b55e434b7f69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:46.558417 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4635a-0982-46f9-af48-b55e434b7f69 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:46.560155 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:46.565048 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 234/455] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Jun 17 07:15:46 2022] GET /identity/v3/role_assignments?group.id=d461eff1f04a474cb648ee77547a3b34&scope.project.id=be5f0ec6059e4393ac953e1a8c865e6d&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:49.148490 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb97270-b06c-4b97-88ab-5db65431d9cf None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:49.149577 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb97270-b06c-4b97-88ab-5db65431d9cf None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:49.150068 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb97270-b06c-4b97-88ab-5db65431d9cf None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:49.151900 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 222/456] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:49.157704 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0706e-fe9b-4d14-b3b3-5d7cd6971bb7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:49.158555 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0706e-fe9b-4d14-b3b3-5d7cd6971bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:49.159054 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0706e-fe9b-4d14-b3b3-5d7cd6971bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:49.185585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-25c0706e-fe9b-4d14-b3b3-5d7cd6971bb7 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:49.187630 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-25c0706e-fe9b-4d14-b3b3-5d7cd6971bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:49.283237 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 235/457] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:49.297651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6871d-0de4-44fc-8dcc-846de6dd083e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:49.298339 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6871d-0de4-44fc-8dcc-846de6dd083e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:49.298819 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6871d-0de4-44fc-8dcc-846de6dd083e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:49.300607 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 223/458] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:49.305927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6328b-7f81-4c90-a98a-88cee3b88400 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:49.306220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6328b-7f81-4c90-a98a-88cee3b88400 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:49.306499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6328b-7f81-4c90-a98a-88cee3b88400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:49.314661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6871d-0de4-44fc-8dcc-846de6dd083e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:49.334481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-20d6328b-7f81-4c90-a98a-88cee3b88400 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:49.335679 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-20d6328b-7f81-4c90-a98a-88cee3b88400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:49.345670 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:49.466822 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 236/459] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:49.490792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6871d-0de4-44fc-8dcc-846de6dd083e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:49.504017 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6328b-7f81-4c90-a98a-88cee3b88400 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:49.547805 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d61224-9a9c-41c9-a944-b069949c8d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:49.548604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d61224-9a9c-41c9-a944-b069949c8d20 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:49.548886 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d61224-9a9c-41c9-a944-b069949c8d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:49.549160 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d61224-9a9c-41c9-a944-b069949c8d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:49.559842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d61224-9a9c-41c9-a944-b069949c8d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:49.561776 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d61224-9a9c-41c9-a944-b069949c8d20 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:49.579618 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:49.581664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-92d61224-9a9c-41c9-a944-b069949c8d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:49.581664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:49.581664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:49.581664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:49.581664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:49.581664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:49.581664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:49.581664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:49.581664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:49.581664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:49.581664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:49.581664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:49.581664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:49.581664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:49.581664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:49.582708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:49.582708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:49.582708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:49.582708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:49.582708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:49.582708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:49.582708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:49.582708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:49.582708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:49.582708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:49.582708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:49.582708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:49.582708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:49.582708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:49.582708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:49.582708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:49.582708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:49.583762 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:49.583762 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:49.583762 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:49.583762 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:49.589529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 224/460] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:49.591028 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f91656-6b91-4c72-ba05-9ae2da4793f7 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:49.591458 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f91656-6b91-4c72-ba05-9ae2da4793f7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:49.592997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f91656-6b91-4c72-ba05-9ae2da4793f7 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:49.595208 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 225/461] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:49.599881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f91656-6b91-4c72-ba05-9ae2da4793f7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:49.631183 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6328b-7f81-4c90-a98a-88cee3b88400 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:49.675974 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3125d79-a625-48f5-b3c8-67e35f7622da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:49.677057 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3125d79-a625-48f5-b3c8-67e35f7622da None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:49.681226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:49.682973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3125d79-a625-48f5-b3c8-67e35f7622da None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:49.683455 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3125d79-a625-48f5-b3c8-67e35f7622da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:49.695364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3125d79-a625-48f5-b3c8-67e35f7622da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:49.697663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3125d79-a625-48f5-b3c8-67e35f7622da None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:49.721492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-d3125d79-a625-48f5-b3c8-67e35f7622da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:49.721492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:49.721492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:49.721492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:49.721492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:49.721492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:49.721492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:49.721492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:49.721492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:49.721492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:49.721492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:49.721492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:49.721492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:49.721492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:49.721492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:49.722532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:49.722532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:49.722532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:49.722532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:49.722532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:49.722532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:49.722532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:49.722532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:49.722532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:49.722532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:49.722532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:49.722532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:49.722532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:49.722532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:49.722532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:49.722532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:49.722532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:49.723507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:49.723507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:49.723507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:49.723507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:49.725816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 237/462] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:49.727203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471d18a-01ed-4c2d-a888-1f6246f92a3c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:49.727619 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471d18a-01ed-4c2d-a888-1f6246f92a3c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:49.728026 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471d18a-01ed-4c2d-a888-1f6246f92a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:49.735100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f91656-6b91-4c72-ba05-9ae2da4793f7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:49.749769 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4471d18a-01ed-4c2d-a888-1f6246f92a3c None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:49.751908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4471d18a-01ed-4c2d-a888-1f6246f92a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:49.771699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883413d-988a-4566-bc70-ba95b1c35dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:49.772683 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883413d-988a-4566-bc70-ba95b1c35dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:49.773164 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883413d-988a-4566-bc70-ba95b1c35dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:49.773682 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883413d-988a-4566-bc70-ba95b1c35dc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:49.774619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883413d-988a-4566-bc70-ba95b1c35dc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:49.775141 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883413d-988a-4566-bc70-ba95b1c35dc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:49.776727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883413d-988a-4566-bc70-ba95b1c35dc5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:49.790613 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 226/463] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:49.791675 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883413d-988a-4566-bc70-ba95b1c35dc5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:49.838515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 238/464] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:49.839622 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471d18a-01ed-4c2d-a888-1f6246f92a3c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:49.890069 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:49.922697 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883413d-988a-4566-bc70-ba95b1c35dc5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:49.950402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:49.964841 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ee675-756b-4b5a-85e8-dd3361085df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:49.965931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ee675-756b-4b5a-85e8-dd3361085df1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:49.966398 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ee675-756b-4b5a-85e8-dd3361085df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:49.966662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471d18a-01ed-4c2d-a888-1f6246f92a3c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:49.967045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ee675-756b-4b5a-85e8-dd3361085df1 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:49.969155 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ee675-756b-4b5a-85e8-dd3361085df1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:49.969757 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ee675-756b-4b5a-85e8-dd3361085df1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:49.971454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ee675-756b-4b5a-85e8-dd3361085df1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:49.990740 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 227/465] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:49.991995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ee675-756b-4b5a-85e8-dd3361085df1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:50.009052 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a002c-c0cf-44a1-9ede-84179a5d299e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:50.009771 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a002c-c0cf-44a1-9ede-84179a5d299e None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:50.010055 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a002c-c0cf-44a1-9ede-84179a5d299e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:50.010336 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a002c-c0cf-44a1-9ede-84179a5d299e None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:50.011430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a002c-c0cf-44a1-9ede-84179a5d299e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:50.013173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a002c-c0cf-44a1-9ede-84179a5d299e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:50.101407 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ee675-756b-4b5a-85e8-dd3361085df1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:50.102254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 239/466] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:15:49 2022] POST /identity/v3/users => generated 246 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:15:50.103464 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a002c-c0cf-44a1-9ede-84179a5d299e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:50.136898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cb43d-5caa-4509-923a-db8535cdcd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:50.137788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cb43d-5caa-4509-923a-db8535cdcd97 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:50.138074 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cb43d-5caa-4509-923a-db8535cdcd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:50.138348 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cb43d-5caa-4509-923a-db8535cdcd97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:50.151319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7cb43d-5caa-4509-923a-db8535cdcd97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:50.152776 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7cb43d-5caa-4509-923a-db8535cdcd97 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:50.172908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ea7cb43d-5caa-4509-923a-db8535cdcd97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:50.172908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:50.172908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:50.172908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:50.172908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:50.172908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:50.172908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:50.172908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:50.172908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:50.172908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:50.172908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:50.172908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:50.172908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:50.172908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:50.172908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:50.173880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:50.173880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:50.173880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:50.173880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:50.173880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:50.173880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:50.173880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:50.173880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:50.173880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:50.173880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:50.173880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:50.173880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:50.173880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:50.173880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:50.173880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:50.173880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:50.173880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:50.174734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:50.174734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:50.174734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:50.174734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:50.174734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 228/467] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:50.175915 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82941634-03e9-4a85-8e05-2f10ff31a7b1 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:50.176191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82941634-03e9-4a85-8e05-2f10ff31a7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:50.176462 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82941634-03e9-4a85-8e05-2f10ff31a7b1 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:50.181964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 229/468] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:50.182832 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82941634-03e9-4a85-8e05-2f10ff31a7b1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:50.230020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:50.249106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:50.256955 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a002c-c0cf-44a1-9ede-84179a5d299e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:50.304100 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065e1da-2e80-43b0-9bec-f78522e29c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:50.304809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065e1da-2e80-43b0-9bec-f78522e29c82 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:50.305087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065e1da-2e80-43b0-9bec-f78522e29c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:50.305462 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065e1da-2e80-43b0-9bec-f78522e29c82 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:50.306629 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065e1da-2e80-43b0-9bec-f78522e29c82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:50.308368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065e1da-2e80-43b0-9bec-f78522e29c82 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:50.308477 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82941634-03e9-4a85-8e05-2f10ff31a7b1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:50.348254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf609f-f1ac-4d2e-9bf0-390bcc19a181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:50.348970 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf609f-f1ac-4d2e-9bf0-390bcc19a181 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:50.349260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf609f-f1ac-4d2e-9bf0-390bcc19a181 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:50.349586 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf609f-f1ac-4d2e-9bf0-390bcc19a181 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:50.350350 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf609f-f1ac-4d2e-9bf0-390bcc19a181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:50.350702 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf609f-f1ac-4d2e-9bf0-390bcc19a181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:50.352065 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf609f-f1ac-4d2e-9bf0-390bcc19a181 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:50.364734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 230/469] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:50.366176 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b8f2e-9692-4095-b8cf-08a274ed4942 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:50.366490 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b8f2e-9692-4095-b8cf-08a274ed4942 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:50.366764 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b8f2e-9692-4095-b8cf-08a274ed4942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:50.383210 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-961b8f2e-9692-4095-b8cf-08a274ed4942 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:50.384442 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-961b8f2e-9692-4095-b8cf-08a274ed4942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:50.400574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 240/470] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:15:50 2022] POST /identity/v3/users => generated 248 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:15:50.405391 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065e1da-2e80-43b0-9bec-f78522e29c82 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:50.535292 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 231/471] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:50.559915 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b8f2e-9692-4095-b8cf-08a274ed4942 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:50.574704 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065e1da-2e80-43b0-9bec-f78522e29c82 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:50.604216 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:50.620893 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4c21d-c059-49fe-89e8-71ba3f0a4c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:50.621624 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c21d-c059-49fe-89e8-71ba3f0a4c8e None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:50.621913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c21d-c059-49fe-89e8-71ba3f0a4c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:50.622192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c21d-c059-49fe-89e8-71ba3f0a4c8e None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:50.622927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4c21d-c059-49fe-89e8-71ba3f0a4c8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:50.624683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4c21d-c059-49fe-89e8-71ba3f0a4c8e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:50.719134 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 241/472] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:15:50 2022] POST /identity/v3/users => generated 248 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:15:50.720619 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ce941-cda5-42cd-98f8-422c4eca0959 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:50.720727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b8f2e-9692-4095-b8cf-08a274ed4942 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:50.721006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ce941-cda5-42cd-98f8-422c4eca0959 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:50.726089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ce941-cda5-42cd-98f8-422c4eca0959 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:50.727940 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 242/473] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:50.736104 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3f0e6-fd37-4be9-9fb9-0e248866df3e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:50.736460 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3f0e6-fd37-4be9-9fb9-0e248866df3e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:50.736817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3f0e6-fd37-4be9-9fb9-0e248866df3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:50.757092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a8e3f0e6-fd37-4be9-9fb9-0e248866df3e None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:50.758737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a8e3f0e6-fd37-4be9-9fb9-0e248866df3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:50.761193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:50.766712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a8b1c-d3a9-4ca2-9eab-82ad22fe4c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:50.767925 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a8b1c-d3a9-4ca2-9eab-82ad22fe4c3a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:50.768350 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a8b1c-d3a9-4ca2-9eab-82ad22fe4c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:50.768783 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a8b1c-d3a9-4ca2-9eab-82ad22fe4c3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:50.782056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a8b1c-d3a9-4ca2-9eab-82ad22fe4c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:50.784158 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a8b1c-d3a9-4ca2-9eab-82ad22fe4c3a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:50.809421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-962a8b1c-d3a9-4ca2-9eab-82ad22fe4c3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:50.809421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:50.809421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:50.809421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:50.809421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:50.809421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:50.809421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:50.809421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:50.809421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:50.809421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:50.809421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:50.809421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:50.809421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:50.809421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:50.809421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:50.810468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:50.810468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:50.810468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:50.810468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:50.810468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:50.810468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:50.810468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:50.810468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:50.810468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:50.810468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:50.810468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:50.810468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:50.810468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:50.810468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:50.810468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:50.810468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:50.810468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:50.812060 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:50.812060 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:50.812060 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:50.812060 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:50.814626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 232/474] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:50.821347 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a8b1c-d3a9-4ca2-9eab-82ad22fe4c3a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:50.895686 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 243/475] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:15:50.916504 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:50.929584 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3f0e6-fd37-4be9-9fb9-0e248866df3e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:50.963926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a8b1c-d3a9-4ca2-9eab-82ad22fe4c3a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:51.012629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cbefd-556f-485c-a239-a966f44eae6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:51.013300 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cbefd-556f-485c-a239-a966f44eae6b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:51.013601 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cbefd-556f-485c-a239-a966f44eae6b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:51.013876 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cbefd-556f-485c-a239-a966f44eae6b None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:51.015426 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cbefd-556f-485c-a239-a966f44eae6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:51.015731 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cbefd-556f-485c-a239-a966f44eae6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:51.017102 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cbefd-556f-485c-a239-a966f44eae6b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:51.032747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 233/476] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:51.038170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cbefd-556f-485c-a239-a966f44eae6b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:51.063130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3f0e6-fd37-4be9-9fb9-0e248866df3e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:51.103639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114bfe8-73f0-4dbc-98b9-607be4f2b5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:51.104600 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114bfe8-73f0-4dbc-98b9-607be4f2b5ae None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:51.104779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114bfe8-73f0-4dbc-98b9-607be4f2b5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:51.110453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114bfe8-73f0-4dbc-98b9-607be4f2b5ae None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:51.110453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114bfe8-73f0-4dbc-98b9-607be4f2b5ae None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:51.110453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114bfe8-73f0-4dbc-98b9-607be4f2b5ae None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:51.152350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.sql.core [None req-4114bfe8-73f0-4dbc-98b9-607be4f2b5ae None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 07:15:51.152350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 17 07:15:51.152350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [parameters: {'id': '4de9bfea2b704e7e8c3633fba0999f79', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 17 07:15:51.152350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80239) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 07:15:51.159528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cbefd-556f-485c-a239-a966f44eae6b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:51.171469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-4114bfe8-73f0-4dbc-98b9-607be4f2b5ae None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 17 07:15:51.171469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:51.171469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 07:15:51.171469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 07:15:51.171469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 07:15:51.171469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 07:15:51.171469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 07:15:51.171469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 07:15:51.171469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 07:15:51.171469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application conn.query(q) Jun 17 07:15:51.171469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 07:15:51.171469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 07:15:51.171469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 07:15:51.171469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application result.read() Jun 17 07:15:51.171469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return ref.to_dict() Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 07:15:51.172396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application next(self.gen) Jun 17 07:15:51.173361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 07:15:51.173361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application yield resource Jun 17 07:15:51.173361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 07:15:51.173361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application next(self.gen) Jun 17 07:15:51.173361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 07:15:51.173361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 07:15:51.173361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 07:15:51.173361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 07:15:51.173361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 07:15:51.173361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise self.value Jun 17 07:15:51.173361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 07:15:51.173361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 07:15:51.173361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 07:15:51.173361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application session.commit() Jun 17 07:15:51.173361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 07:15:51.173361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 07:15:51.173361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 07:15:51.174259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 07:15:51.174259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 07:15:51.174259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self.session.flush() Jun 17 07:15:51.174259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 07:15:51.174259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 07:15:51.174259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 07:15:51.174259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 07:15:51.174259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 07:15:51.174259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application compat.raise_( Jun 17 07:15:51.174259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 07:15:51.174259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception Jun 17 07:15:51.174259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 07:15:51.174259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 07:15:51.174259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 07:15:51.174259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 07:15:51.174259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 07:15:51.174259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 07:15:51.176359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 07:15:51.176359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 07:15:51.176359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 17 07:15:51.176359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 17 07:15:51.176359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 07:15:51.176359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 07:15:51.176359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 07:15:51.176359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 07:15:51.176359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 07:15:51.176359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 07:15:51.176359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 07:15:51.176359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 07:15:51.176359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 07:15:51.176359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 07:15:51.176359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 07:15:51.176359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception Jun 17 07:15:51.177495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 07:15:51.177495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 07:15:51.177495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 07:15:51.177495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 07:15:51.177495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 07:15:51.177495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 07:15:51.177495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 07:15:51.177495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application conn.query(q) Jun 17 07:15:51.177495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 07:15:51.177495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 07:15:51.177495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 07:15:51.177495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application result.read() Jun 17 07:15:51.177495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 07:15:51.177495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 07:15:51.177495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 07:15:51.177495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 07:15:51.179521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 07:15:51.179521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 07:15:51.179521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 07:15:51.179521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 07:15:51.179521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 07:15:51.179521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 17 07:15:51.179521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [parameters: {'id': '4de9bfea2b704e7e8c3633fba0999f79', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 17 07:15:51.179521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 07:15:51.179521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:51.179521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:15:51.179521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:51.179521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:51.179521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:51.179521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:51.179521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:51.179521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:51.181651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:51.181651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:51.181651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:51.181651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:51.181651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:51.181651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:51.181651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 17 07:15:51.181651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 17 07:15:51.181651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:51.181651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:51.181651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 17 07:15:51.181651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 17 07:15:51.181651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 07:15:51.181651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 07:15:51.181651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 17 07:15:51.181651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:51.183685 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 244/477] 10.222.0.52 () {60 vars in 1131 bytes} [Fri Jun 17 07:15:50 2022] POST /identity/v3/roles => generated 144 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:51.183685 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114bfe8-73f0-4dbc-98b9-607be4f2b5ae None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:51.189384 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:51.223994 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0977e5f-d463-443c-b99f-6d286f086519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:51.224996 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0977e5f-d463-443c-b99f-6d286f086519 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:51.225453 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0977e5f-d463-443c-b99f-6d286f086519 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:51.225885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0977e5f-d463-443c-b99f-6d286f086519 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:51.226981 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0977e5f-d463-443c-b99f-6d286f086519 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:51.228649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0977e5f-d463-443c-b99f-6d286f086519 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:51.246392 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:51.300747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114bfe8-73f0-4dbc-98b9-607be4f2b5ae None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:51.336725 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4163c-6b15-4488-9e22-140a9ce581d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:51.337566 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4163c-6b15-4488-9e22-140a9ce581d7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:51.337846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4163c-6b15-4488-9e22-140a9ce581d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:51.338115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4163c-6b15-4488-9e22-140a9ce581d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:51.349016 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4163c-6b15-4488-9e22-140a9ce581d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:51.357288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-bab4163c-6b15-4488-9e22-140a9ce581d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:51.357288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:51.357288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:51.357288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:51.357288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:51.357288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:51.357288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:51.357288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:51.357288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:51.357288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:51.357288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:51.357288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:51.357288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:51.357288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:51.357288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:51.357288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:51.359186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:51.359186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:51.359186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:51.359186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:51.359186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:51.359186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:51.359186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:51.359186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:51.359186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:51.359186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:51.359186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:51.359186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:51.359186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:51.359186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:51.359186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:51.359186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:51.360279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:51.360279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:51.360279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:51.360279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:51.360279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:51.360279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:51.360279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:51.360279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:51.360279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:51.360279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:51.360279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:15:51.360279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:51.360279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 245/478] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:15:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:51.364622 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4163c-6b15-4488-9e22-140a9ce581d7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:51.377677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 234/479] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:15:51 2022] POST /identity/v3/users => generated 249 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:15:51.448124 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:51.503365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4163c-6b15-4488-9e22-140a9ce581d7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:51.551619 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de728ac7-9921-4b06-bb98-c2028f1c6481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:51.552307 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de728ac7-9921-4b06-bb98-c2028f1c6481 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:51.552588 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de728ac7-9921-4b06-bb98-c2028f1c6481 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:51.552863 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de728ac7-9921-4b06-bb98-c2028f1c6481 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:51.553660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de728ac7-9921-4b06-bb98-c2028f1c6481 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:51.553964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de728ac7-9921-4b06-bb98-c2028f1c6481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:51.555356 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de728ac7-9921-4b06-bb98-c2028f1c6481 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:51.565187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 246/480] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:52.595644 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f227c-88af-498c-82ce-c4ac36f9ec3e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:52.596701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f227c-88af-498c-82ce-c4ac36f9ec3e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:52.597180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f227c-88af-498c-82ce-c4ac36f9ec3e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:52.598745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 235/481] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:52.603770 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fe57d-162e-4f6d-b211-f889d5e235f3 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:52.604545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fe57d-162e-4f6d-b211-f889d5e235f3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:52.605032 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fe57d-162e-4f6d-b211-f889d5e235f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:52.631624 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4a3fe57d-162e-4f6d-b211-f889d5e235f3 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:52.633137 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4a3fe57d-162e-4f6d-b211-f889d5e235f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:52.738806 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 247/482] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:52.774794 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f227c-88af-498c-82ce-c4ac36f9ec3e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:52.917087 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f227c-88af-498c-82ce-c4ac36f9ec3e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:52.966128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50b715-a8d6-4dd8-8f43-5d88f318e830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:52.966931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50b715-a8d6-4dd8-8f43-5d88f318e830 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:52.967751 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50b715-a8d6-4dd8-8f43-5d88f318e830 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:52.968182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50b715-a8d6-4dd8-8f43-5d88f318e830 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:52.990080 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50b715-a8d6-4dd8-8f43-5d88f318e830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:52.998161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ec50b715-a8d6-4dd8-8f43-5d88f318e830 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:15:52.998161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:52.998161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:52.998161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:52.998161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:52.998161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:52.998161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:52.998161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:52.998161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:52.998161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:52.998161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:52.998161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:52.998161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:52.998161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:52.998161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:52.998161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:52.999664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:52.999664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:52.999664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:52.999664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:52.999664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:52.999664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:52.999664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:52.999664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:52.999664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:52.999664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:52.999664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:52.999664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:52.999664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:52.999664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:52.999664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:52.999664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:53.000464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:53.000464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:53.000464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:53.000464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:53.000464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:53.000464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:53.000464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:53.000464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:53.000464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:53.000464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:53.000464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:15:53.000464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:53.005203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 236/483] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:15:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:53.006668 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fe57d-162e-4f6d-b211-f889d5e235f3 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:53.050687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc09b6-d383-42dc-81a9-2a11663419dc None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:53.051016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc09b6-d383-42dc-81a9-2a11663419dc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:53.051248 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc09b6-d383-42dc-81a9-2a11663419dc None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:53.053013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 237/484] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:15:53.062656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae6eff-fdd8-4b3e-a544-6507451853b0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:53.062964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae6eff-fdd8-4b3e-a544-6507451853b0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:53.063224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae6eff-fdd8-4b3e-a544-6507451853b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:53.091710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-82ae6eff-fdd8-4b3e-a544-6507451853b0 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:53.093004 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-82ae6eff-fdd8-4b3e-a544-6507451853b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:53.121639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:53.182291 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:53.210403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fe57d-162e-4f6d-b211-f889d5e235f3 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:53.220679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 238/485] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:15:53.262164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa391694-90ef-46a4-b90f-45019a70baa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:53.262846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa391694-90ef-46a4-b90f-45019a70baa2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:53.263128 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa391694-90ef-46a4-b90f-45019a70baa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:53.263402 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa391694-90ef-46a4-b90f-45019a70baa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:53.264463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa391694-90ef-46a4-b90f-45019a70baa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:53.264773 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa391694-90ef-46a4-b90f-45019a70baa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:53.266181 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa391694-90ef-46a4-b90f-45019a70baa2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:53.277506 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 248/486] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:15:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:53.282671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae6eff-fdd8-4b3e-a544-6507451853b0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:53.323659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa391694-90ef-46a4-b90f-45019a70baa2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:53.422907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae6eff-fdd8-4b3e-a544-6507451853b0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:53.468667 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a1be9-4113-4622-8348-543969ab510b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:53.469153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a1be9-4113-4622-8348-543969ab510b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:53.469483 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a1be9-4113-4622-8348-543969ab510b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:53.469753 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a1be9-4113-4622-8348-543969ab510b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:53.489040 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a1be9-4113-4622-8348-543969ab510b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:53.490528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a1be9-4113-4622-8348-543969ab510b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:53.522926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-7d6a1be9-4113-4622-8348-543969ab510b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:53.522926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:53.522926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:53.522926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:53.522926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:53.522926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:53.522926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:53.522926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:53.522926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:53.522926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:53.522926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:53.522926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:53.522926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:53.522926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:53.522926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:53.523871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:53.523871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:53.523871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:53.523871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:53.523871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:53.523871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:53.523871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:53.523871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:53.523871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:53.523871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:53.523871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:53.523871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:53.523871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:53.523871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:53.523871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:53.523871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:53.523871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:53.524718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:53.524718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:53.524718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:53.524718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:53.524718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 239/487] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:53.531449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa391694-90ef-46a4-b90f-45019a70baa2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:53.538463 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a1be9-4113-4622-8348-543969ab510b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:53.552149 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:53.590653 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbca2f1-2543-4584-827f-7a90d7314fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:53.593376 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbca2f1-2543-4584-827f-7a90d7314fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:53.593692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbca2f1-2543-4584-827f-7a90d7314fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:53.594061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbca2f1-2543-4584-827f-7a90d7314fc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:53.606073 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:53.612005 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbca2f1-2543-4584-827f-7a90d7314fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:53.622378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-dbbca2f1-2543-4584-827f-7a90d7314fc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:15:53.622378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:53.622378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:53.622378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:53.622378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:53.622378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:53.622378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:53.622378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:53.622378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:53.622378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:53.622378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:53.622378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:53.622378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:53.622378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:53.622378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:53.622378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:53.623370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:53.623370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:53.623370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:53.623370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:53.623370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:53.623370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:53.623370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:53.623370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:53.623370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:53.623370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:53.623370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:53.623370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:53.623370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:53.623370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:53.623370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:53.623370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:53.624169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:53.624169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:53.624169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:53.624169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:53.624169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:53.624169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:53.624169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:53.624169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:53.624169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:53.624169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:53.624169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:15:53.624169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:53.624169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 249/488] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:15:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:53.629406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a1a23-46cb-4bff-ac3b-940d98825df2 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:53.629998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a1a23-46cb-4bff-ac3b-940d98825df2 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:53.631368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a1a23-46cb-4bff-ac3b-940d98825df2 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:53.634599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 250/489] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:53.636089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a1a23-46cb-4bff-ac3b-940d98825df2 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:53.709864 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a1be9-4113-4622-8348-543969ab510b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:53.755828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f31f3c-8c04-4c5f-9ea6-5f4fdd6b2e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:53.756589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f31f3c-8c04-4c5f-9ea6-5f4fdd6b2e0e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:53.756697 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f31f3c-8c04-4c5f-9ea6-5f4fdd6b2e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:53.756967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f31f3c-8c04-4c5f-9ea6-5f4fdd6b2e0e None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:53.757711 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f31f3c-8c04-4c5f-9ea6-5f4fdd6b2e0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:53.758014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f31f3c-8c04-4c5f-9ea6-5f4fdd6b2e0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:53.759372 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f31f3c-8c04-4c5f-9ea6-5f4fdd6b2e0e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:53.777148 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a1a23-46cb-4bff-ac3b-940d98825df2 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:53.781186 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 240/490] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:53.782370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c4a2-f2ac-4e39-8fd0-8f418f844b9f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:53.782657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c4a2-f2ac-4e39-8fd0-8f418f844b9f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:53.782931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c4a2-f2ac-4e39-8fd0-8f418f844b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:53.803838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a7f6c4a2-f2ac-4e39-8fd0-8f418f844b9f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:53.806203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a7f6c4a2-f2ac-4e39-8fd0-8f418f844b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:53.817343 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31197fde-ba79-4c3c-9305-06823c22334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:53.818038 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31197fde-ba79-4c3c-9305-06823c22334e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:53.818631 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31197fde-ba79-4c3c-9305-06823c22334e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:53.818631 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31197fde-ba79-4c3c-9305-06823c22334e None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:53.819406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31197fde-ba79-4c3c-9305-06823c22334e None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:53.819727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31197fde-ba79-4c3c-9305-06823c22334e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:53.821279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31197fde-ba79-4c3c-9305-06823c22334e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:53.830532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 251/491] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:15:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:53.831346 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31197fde-ba79-4c3c-9305-06823c22334e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:53.878696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:53.897173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 241/492] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:53.898079 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6c4a2-f2ac-4e39-8fd0-8f418f844b9f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:53.944256 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:53.958876 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31197fde-ba79-4c3c-9305-06823c22334e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:53.996707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2129b-ef4d-44bc-bc26-7289ebfda87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:53.997622 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2129b-ef4d-44bc-bc26-7289ebfda87f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:53.997972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2129b-ef4d-44bc-bc26-7289ebfda87f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:53.998356 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2129b-ef4d-44bc-bc26-7289ebfda87f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:54.007183 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2129b-ef4d-44bc-bc26-7289ebfda87f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:54.008369 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2129b-ef4d-44bc-bc26-7289ebfda87f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:54.024309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-2ed2129b-ef4d-44bc-bc26-7289ebfda87f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:15:54.024309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:54.024309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:54.024309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:54.024309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:54.024309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:54.024309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:54.024309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:54.024309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:54.024309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:54.024309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:54.024309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:54.024309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:15:54.024309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:15:54.024309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:15:54.024309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:54.025269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:54.026212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:54.026212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:54.026212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:15:54.026212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:15:54.026212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:15:54.026212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:15:54.026212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:15:54.026212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:15:54.026212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:15:54.026212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:54.030648 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 252/493] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Jun 17 07:15:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:54.031648 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2129b-ef4d-44bc-bc26-7289ebfda87f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:54.040112 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6c4a2-f2ac-4e39-8fd0-8f418f844b9f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:54.083698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce875f-a3a2-4994-881d-4f46c27084f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:54.084709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce875f-a3a2-4994-881d-4f46c27084f1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:54.085032 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce875f-a3a2-4994-881d-4f46c27084f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:54.085401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce875f-a3a2-4994-881d-4f46c27084f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:54.099471 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce875f-a3a2-4994-881d-4f46c27084f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:54.101741 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce875f-a3a2-4994-881d-4f46c27084f1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:54.126331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-95ce875f-a3a2-4994-881d-4f46c27084f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:54.126331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:54.126331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:54.126331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:54.126331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:54.126331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:54.126331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:54.126331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:54.126331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:54.126331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:54.126331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:54.126331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:54.126331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:54.126331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:54.126331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:54.127281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:54.127281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:54.127281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:54.127281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:54.127281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:54.127281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:54.127281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:54.127281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:54.127281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:54.127281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:54.127281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:54.127281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:54.127281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:54.127281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:54.127281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:54.127281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:54.127281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:54.128156 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:54.128156 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:54.128156 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:54.128156 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:54.128156 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 242/494] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:54.129186 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce875f-a3a2-4994-881d-4f46c27084f1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:54.152821 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:54.160333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2129b-ef4d-44bc-bc26-7289ebfda87f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:54.216844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5993a-dd5f-41b4-b646-93e7cfd0ebc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:54.218510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5993a-dd5f-41b4-b646-93e7cfd0ebc9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:54.218886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5993a-dd5f-41b4-b646-93e7cfd0ebc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:54.219257 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5993a-dd5f-41b4-b646-93e7cfd0ebc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:54.224953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:54.231108 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5993a-dd5f-41b4-b646-93e7cfd0ebc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:54.239587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-4de5993a-dd5f-41b4-b646-93e7cfd0ebc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:15:54.239587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:54.239587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:54.239587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:54.239587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:54.239587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:54.239587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:54.239587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:54.239587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:54.239587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:54.239587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:54.239587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:54.239587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:54.239587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:54.239587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:54.239587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:54.240673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:54.240673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:54.240673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:54.240673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:54.240673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:54.240673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:54.240673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:54.240673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:54.240673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:54.240673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:54.240673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:54.240673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:54.240673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:54.240673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:54.240673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:54.240673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:54.241567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:54.241567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:54.241567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:54.241567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:54.241567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:54.241567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:54.241567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:54.241567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:54.241567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:54.241567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:54.241567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:15:54.241567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:54.241567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 253/495] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:15:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:54.242339 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5993a-dd5f-41b4-b646-93e7cfd0ebc9 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:54.248399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce875f-a3a2-4994-881d-4f46c27084f1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:54.283627 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a977b-e69a-4c2e-8b30-be5c2e733249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:54.284226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a977b-e69a-4c2e-8b30-be5c2e733249 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:54.284496 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a977b-e69a-4c2e-8b30-be5c2e733249 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:54.284770 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a977b-e69a-4c2e-8b30-be5c2e733249 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:54.285635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a977b-e69a-4c2e-8b30-be5c2e733249 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:54.285945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a977b-e69a-4c2e-8b30-be5c2e733249 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:54.287395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a977b-e69a-4c2e-8b30-be5c2e733249 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:54.324349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 243/496] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Jun 17 07:15:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:54.325749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9b5d5-d50c-4784-9e16-e168e2443bfc None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:54.326042 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9b5d5-d50c-4784-9e16-e168e2443bfc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:54.326316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9b5d5-d50c-4784-9e16-e168e2443bfc None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:54.327781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 244/497] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:54.329116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8429d-cee0-418e-b87c-6476453649af None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:54.329309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8429d-cee0-418e-b87c-6476453649af None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:54.329610 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8429d-cee0-418e-b87c-6476453649af None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:54.330874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 245/498] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:54.331640 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8429d-cee0-418e-b87c-6476453649af None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:54.347233 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5993a-dd5f-41b4-b646-93e7cfd0ebc9 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:54.381274 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff01600-f9eb-4672-8981-4e33b8b4cd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:54.381955 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff01600-f9eb-4672-8981-4e33b8b4cd10 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:54.382249 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff01600-f9eb-4672-8981-4e33b8b4cd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:54.382526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff01600-f9eb-4672-8981-4e33b8b4cd10 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:54.383241 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff01600-f9eb-4672-8981-4e33b8b4cd10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:54.383550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff01600-f9eb-4672-8981-4e33b8b4cd10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:54.384939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff01600-f9eb-4672-8981-4e33b8b4cd10 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:54.402289 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 254/499] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:54.402921 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff01600-f9eb-4672-8981-4e33b8b4cd10 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:54.422578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:54.438685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8429d-cee0-418e-b87c-6476453649af None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:54.473001 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192d318-71ed-40e0-856c-c94f3a4233b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:54.473685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192d318-71ed-40e0-856c-c94f3a4233b3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:54.473964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192d318-71ed-40e0-856c-c94f3a4233b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:54.474238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192d318-71ed-40e0-856c-c94f3a4233b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:54.474973 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192d318-71ed-40e0-856c-c94f3a4233b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:54.475275 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192d318-71ed-40e0-856c-c94f3a4233b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:54.476658 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192d318-71ed-40e0-856c-c94f3a4233b3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:54.478869 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:54.485453 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 246/500] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:15:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:54.486728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97851542-1201-4ba2-84c8-5b0bd5252fec None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:54.487019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97851542-1201-4ba2-84c8-5b0bd5252fec None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:54.487296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97851542-1201-4ba2-84c8-5b0bd5252fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:54.503658 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-97851542-1201-4ba2-84c8-5b0bd5252fec None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:54.504855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-97851542-1201-4ba2-84c8-5b0bd5252fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:54.510290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff01600-f9eb-4672-8981-4e33b8b4cd10 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:54.547015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c28fe-0d9e-465b-829b-b3489d68ca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:54.547592 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c28fe-0d9e-465b-829b-b3489d68ca7b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:54.547878 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c28fe-0d9e-465b-829b-b3489d68ca7b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:54.548155 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c28fe-0d9e-465b-829b-b3489d68ca7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:54.572196 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 247/501] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:54.573512 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfae61-1637-4ddb-8c41-b38b5ee8e6f2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:54.573805 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfae61-1637-4ddb-8c41-b38b5ee8e6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:54.574086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfae61-1637-4ddb-8c41-b38b5ee8e6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:54.593291 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-eccfae61-1637-4ddb-8c41-b38b5ee8e6f2 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:54.594516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-eccfae61-1637-4ddb-8c41-b38b5ee8e6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:54.617954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c28fe-0d9e-465b-829b-b3489d68ca7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:54.619438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c28fe-0d9e-465b-829b-b3489d68ca7b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:54.638190 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:54.661662 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 248/502] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:54.662497 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfae61-1637-4ddb-8c41-b38b5ee8e6f2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:54.720966 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 255/503] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:54.722047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c28fe-0d9e-465b-829b-b3489d68ca7b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:54.740341 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:54.783597 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfae61-1637-4ddb-8c41-b38b5ee8e6f2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:54.817475 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bef34-ad25-4941-b91e-23d138c55710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:54.818189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bef34-ad25-4941-b91e-23d138c55710 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:54.818464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bef34-ad25-4941-b91e-23d138c55710 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:54.818733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bef34-ad25-4941-b91e-23d138c55710 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:54.820078 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c28fe-0d9e-465b-829b-b3489d68ca7b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:54.826039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bef34-ad25-4941-b91e-23d138c55710 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:54.827616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bef34-ad25-4941-b91e-23d138c55710 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:54.836882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:54.842790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-3f9bef34-ad25-4941-b91e-23d138c55710 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 07:15:54.842790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:54.842790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:54.842790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:54.842790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:54.842790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:54.842790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:54.842790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:54.842790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:54.842790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:54.842790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:54.842790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:54.842790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:15:54.842790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:15:54.842790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:15:54.842790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:54.843902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:54.845083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:54.845083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:54.845083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:15:54.845083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:15:54.845083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:15:54.845083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:15:54.845083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:15:54.845083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:15:54.845083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 07:15:54.845083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:54.845083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 249/504] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:54.845083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bef34-ad25-4941-b91e-23d138c55710 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:54.856121 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb0eec-3997-43a1-8f6f-c2648ed5e019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:54.856918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb0eec-3997-43a1-8f6f-c2648ed5e019 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:54.857200 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb0eec-3997-43a1-8f6f-c2648ed5e019 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:54.857514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb0eec-3997-43a1-8f6f-c2648ed5e019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:54.868311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb0eec-3997-43a1-8f6f-c2648ed5e019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:54.869784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb0eec-3997-43a1-8f6f-c2648ed5e019 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:54.887150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-60eb0eec-3997-43a1-8f6f-c2648ed5e019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:54.887150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:54.887150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:54.887150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:54.887150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:54.887150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:54.887150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:54.887150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:54.887150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:54.887150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:54.887150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:54.887150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:54.887150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:54.887150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:54.887150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:54.888042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:54.888042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:54.888042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:54.888042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:54.888042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:54.888042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:54.888042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:54.888042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:54.888042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:54.888042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:54.888042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:54.888042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:54.888042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:54.888042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:54.888042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:54.888042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:54.888042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:54.888931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:54.888931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:54.888931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:54.888931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:54.888931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 256/505] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:54.889643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb0eec-3997-43a1-8f6f-c2648ed5e019 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:54.946692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bef34-ad25-4941-b91e-23d138c55710 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:54.962853 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:54.979568 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b77bcd-2c61-464c-8147-97582a270727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:54.980354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b77bcd-2c61-464c-8147-97582a270727 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:54.980635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b77bcd-2c61-464c-8147-97582a270727 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:54.980909 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b77bcd-2c61-464c-8147-97582a270727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:54.992557 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb0eec-3997-43a1-8f6f-c2648ed5e019 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:54.992861 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b77bcd-2c61-464c-8147-97582a270727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:54.994370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b77bcd-2c61-464c-8147-97582a270727 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:55.011738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-05b77bcd-2c61-464c-8147-97582a270727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:55.011738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:55.011738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:55.011738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:55.011738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:55.011738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:55.011738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:55.011738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:55.011738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:55.011738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:55.011738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:55.011738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:55.011738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:55.011738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:55.011738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:55.012777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:55.012777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:55.012777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:55.012777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:55.012777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:55.012777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:55.012777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:55.012777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:55.012777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:55.012777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:55.012777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:55.012777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:55.012777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:55.012777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:55.012777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:55.012777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:55.012777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:55.013722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:55.013722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:55.013722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:55.013722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:55.015748 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 250/506] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:55.016861 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b77bcd-2c61-464c-8147-97582a270727 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:55.026373 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d598d-1d3d-4521-b1a5-55634cf5d1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:55.027166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d598d-1d3d-4521-b1a5-55634cf5d1cc None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:55.027443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d598d-1d3d-4521-b1a5-55634cf5d1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:55.027716 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d598d-1d3d-4521-b1a5-55634cf5d1cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:55.038504 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d598d-1d3d-4521-b1a5-55634cf5d1cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:55.046812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-3c7d598d-1d3d-4521-b1a5-55634cf5d1cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:15:55.046812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:55.046812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:55.046812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:55.046812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:55.046812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:55.046812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:55.046812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:55.046812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:55.046812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:55.046812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:55.046812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:55.046812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:55.046812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:55.046812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:55.046812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:55.047713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:55.047713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:55.047713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:55.047713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:55.047713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:55.047713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:55.047713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:55.047713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:55.047713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:55.047713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:55.047713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:55.047713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:55.047713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:55.047713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:55.047713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:55.047713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:55.048515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:55.048515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:55.048515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:55.048515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:55.048515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:55.048515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:55.048515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:55.048515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:55.048515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:55.048515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:55.048515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:15:55.048515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:55.048515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 257/507] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:15:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:55.049220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d598d-1d3d-4521-b1a5-55634cf5d1cc None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:55.078802 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:55.117179 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b77bcd-2c61-464c-8147-97582a270727 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:55.148287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d598d-1d3d-4521-b1a5-55634cf5d1cc None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:55.150663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b0811-55b2-4ae2-8964-481036f79bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:55.151452 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b0811-55b2-4ae2-8964-481036f79bff None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:55.151728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b0811-55b2-4ae2-8964-481036f79bff None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:55.151999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b0811-55b2-4ae2-8964-481036f79bff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:55.163030 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b0811-55b2-4ae2-8964-481036f79bff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:55.164458 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b0811-55b2-4ae2-8964-481036f79bff None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:55.181636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-cb8b0811-55b2-4ae2-8964-481036f79bff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:55.181636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:55.181636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:55.181636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:55.181636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:55.181636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:55.181636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:55.181636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:55.181636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:55.181636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:55.181636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:55.181636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:55.181636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:55.181636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:55.181636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:55.182631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:55.182631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:55.182631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:55.182631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:55.182631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:55.182631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:55.182631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:55.182631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:55.182631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:55.182631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:55.182631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:55.182631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:55.182631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:55.182631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:55.182631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:55.182631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:55.182631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:55.183515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:55.183515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:55.183515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:55.183515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:55.183724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9de2a8-3dcc-4588-8262-d060053cc4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:55.183809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 251/508] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:55.183912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9de2a8-3dcc-4588-8262-d060053cc4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:55.183912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9de2a8-3dcc-4588-8262-d060053cc4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:55.183912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9de2a8-3dcc-4588-8262-d060053cc4c7 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:55.184081 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b0811-55b2-4ae2-8964-481036f79bff None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:55.184354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9de2a8-3dcc-4588-8262-d060053cc4c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:55.184692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9de2a8-3dcc-4588-8262-d060053cc4c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:55.186143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9de2a8-3dcc-4588-8262-d060053cc4c7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:55.210182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:55.222319 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 258/509] 10.222.0.52 () {56 vars in 1137 bytes} [Fri Jun 17 07:15:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:55.223153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9de2a8-3dcc-4588-8262-d060053cc4c7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:55.286561 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b0811-55b2-4ae2-8964-481036f79bff None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:55.311554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:55.320090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804fa72-6e48-4980-9751-51314743092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:55.320759 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804fa72-6e48-4980-9751-51314743092d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:55.321042 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804fa72-6e48-4980-9751-51314743092d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:55.321337 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804fa72-6e48-4980-9751-51314743092d None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:55.322238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804fa72-6e48-4980-9751-51314743092d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:55.322356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804fa72-6e48-4980-9751-51314743092d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:55.322973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9de2a8-3dcc-4588-8262-d060053cc4c7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:55.323739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804fa72-6e48-4980-9751-51314743092d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:55.336315 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 252/510] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:55.337094 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804fa72-6e48-4980-9751-51314743092d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:55.358136 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c49246-529a-42dc-a606-49dd7ff17d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:55.358881 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c49246-529a-42dc-a606-49dd7ff17d78 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:55.359161 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c49246-529a-42dc-a606-49dd7ff17d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:55.359432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c49246-529a-42dc-a606-49dd7ff17d78 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:55.360137 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c49246-529a-42dc-a606-49dd7ff17d78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:55.360438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c49246-529a-42dc-a606-49dd7ff17d78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:55.362686 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c49246-529a-42dc-a606-49dd7ff17d78 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:55.375147 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 259/511] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:55.375948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c49246-529a-42dc-a606-49dd7ff17d78 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:55.419609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:55.437401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804fa72-6e48-4980-9751-51314743092d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:55.471614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e758687-ab20-46d6-9ea7-375445180d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:55.472285 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e758687-ab20-46d6-9ea7-375445180d63 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:55.472564 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e758687-ab20-46d6-9ea7-375445180d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:55.472834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e758687-ab20-46d6-9ea7-375445180d63 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:55.473595 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e758687-ab20-46d6-9ea7-375445180d63 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:55.473901 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e758687-ab20-46d6-9ea7-375445180d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:55.475268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e758687-ab20-46d6-9ea7-375445180d63 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:55.475404 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c49246-529a-42dc-a606-49dd7ff17d78 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:55.483268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 253/512] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:15:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:55.484366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e758687-ab20-46d6-9ea7-375445180d63 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:55.508074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a399a-6adf-4560-ab09-3a23f4acf55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:55.508729 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a399a-6adf-4560-ab09-3a23f4acf55d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:55.509004 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a399a-6adf-4560-ab09-3a23f4acf55d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:55.509277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a399a-6adf-4560-ab09-3a23f4acf55d None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:55.510015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a399a-6adf-4560-ab09-3a23f4acf55d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:55.510317 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a399a-6adf-4560-ab09-3a23f4acf55d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:55.511685 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a399a-6adf-4560-ab09-3a23f4acf55d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:55.523483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 260/513] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:55.524257 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a399a-6adf-4560-ab09-3a23f4acf55d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:55.534807 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:55.588366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e758687-ab20-46d6-9ea7-375445180d63 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:55.623070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a399a-6adf-4560-ab09-3a23f4acf55d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:55.623744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83154f-5741-449c-b168-adb466532f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:55.624203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83154f-5741-449c-b168-adb466532f4f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:55.624476 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83154f-5741-449c-b168-adb466532f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:55.624748 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83154f-5741-449c-b168-adb466532f4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:55.638773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:55.659250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec92ab-8fa5-494d-8802-6eb82a32ad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:55.660074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec92ab-8fa5-494d-8802-6eb82a32ad0a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:55.660351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec92ab-8fa5-494d-8802-6eb82a32ad0a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:55.660616 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec92ab-8fa5-494d-8802-6eb82a32ad0a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:55.667900 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec92ab-8fa5-494d-8802-6eb82a32ad0a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:55.669412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec92ab-8fa5-494d-8802-6eb82a32ad0a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:55.684130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-5eec92ab-8fa5-494d-8802-6eb82a32ad0a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 07:15:55.684130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:55.684130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:55.684130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:55.684130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:55.684130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:55.684130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:55.684130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:55.684130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:55.684130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:55.684130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:55.684130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:55.684130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:15:55.684130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:15:55.684130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:15:55.684130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:55.684998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:55.686713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:55.686713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:55.686713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:15:55.686713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:15:55.686713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:15:55.686713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:15:55.686713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:15:55.686713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:15:55.686713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 07:15:55.686713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:55.686713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 261/514] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:55.686713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec92ab-8fa5-494d-8802-6eb82a32ad0a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:55.696743 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83154f-5741-449c-b168-adb466532f4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:55.698248 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83154f-5741-449c-b168-adb466532f4f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:55.754782 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:55.786830 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec92ab-8fa5-494d-8802-6eb82a32ad0a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:55.796293 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 254/515] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:55.797122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83154f-5741-449c-b168-adb466532f4f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:55.821891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd5b18-42a9-4b06-a3ee-61439fadf4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:55.822575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd5b18-42a9-4b06-a3ee-61439fadf4f7 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:55.822854 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd5b18-42a9-4b06-a3ee-61439fadf4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:55.823121 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd5b18-42a9-4b06-a3ee-61439fadf4f7 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:55.823809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd5b18-42a9-4b06-a3ee-61439fadf4f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:55.825242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd5b18-42a9-4b06-a3ee-61439fadf4f7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:55.843793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:55.895411 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 262/516] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:15:55 2022] POST /identity/v3/users => generated 247 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:15:55.896176 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83154f-5741-449c-b168-adb466532f4f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:55.896300 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd5b18-42a9-4b06-a3ee-61439fadf4f7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:55.939115 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37df3f-b6ec-4342-874f-ccb3481041b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:55.940344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37df3f-b6ec-4342-874f-ccb3481041b2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:55.940829 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37df3f-b6ec-4342-874f-ccb3481041b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:55.941299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37df3f-b6ec-4342-874f-ccb3481041b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:55.954979 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37df3f-b6ec-4342-874f-ccb3481041b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:55.956858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37df3f-b6ec-4342-874f-ccb3481041b2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:55.975902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-0e37df3f-b6ec-4342-874f-ccb3481041b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:55.975902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:55.975902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:55.975902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:55.975902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:55.975902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:55.975902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:55.975902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:55.975902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:55.975902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:55.975902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:55.975902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:55.975902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:55.975902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:55.975902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:55.976881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:55.976881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:55.976881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:55.976881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:55.976881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:55.976881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:55.976881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:55.976881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:55.976881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:55.976881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:55.976881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:55.976881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:55.976881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:55.976881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:55.976881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:55.976881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:55.976881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:55.977808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:55.977808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:55.977808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:55.977808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:55.977808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 255/517] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:55.978072 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37df3f-b6ec-4342-874f-ccb3481041b2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:56.021504 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd5b18-42a9-4b06-a3ee-61439fadf4f7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:56.050131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:56.063235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd7473-8951-4215-a301-49b1a1a29a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:56.064063 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd7473-8951-4215-a301-49b1a1a29a04 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:56.064343 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd7473-8951-4215-a301-49b1a1a29a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:56.064610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd7473-8951-4215-a301-49b1a1a29a04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:56.072667 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd7473-8951-4215-a301-49b1a1a29a04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:56.074215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd7473-8951-4215-a301-49b1a1a29a04 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:56.082106 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:56.088125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37df3f-b6ec-4342-874f-ccb3481041b2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:56.090355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-5ecd7473-8951-4215-a301-49b1a1a29a04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:15:56.090355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:56.090355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:56.090355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:56.090355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:56.090355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:56.090355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:56.090355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:56.090355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:56.090355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:56.090355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:56.090355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:56.090355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:15:56.090355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:15:56.090355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:15:56.091188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:15:56.091188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:56.091188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:56.091188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:56.091188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:56.091188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:56.091188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:56.091188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:56.091188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:56.091188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:56.091188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:56.091188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:56.091188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:56.091188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:56.091188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:56.091188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:56.091188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:56.092106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:15:56.092106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:15:56.092106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:15:56.092106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:15:56.092106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:15:56.092106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:15:56.092106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:15:56.092106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:56.092106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 263/518] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:56.092728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd7473-8951-4215-a301-49b1a1a29a04 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:56.133653 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1416bca-2610-41a0-83d3-bd43a9ac9532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:56.134692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1416bca-2610-41a0-83d3-bd43a9ac9532 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:56.135191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1416bca-2610-41a0-83d3-bd43a9ac9532 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:56.135662 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1416bca-2610-41a0-83d3-bd43a9ac9532 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:56.136689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1416bca-2610-41a0-83d3-bd43a9ac9532 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:56.137641 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1416bca-2610-41a0-83d3-bd43a9ac9532 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:56.140299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1416bca-2610-41a0-83d3-bd43a9ac9532 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:56.162656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 256/519] 10.222.0.52 () {56 vars in 1137 bytes} [Fri Jun 17 07:15:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:56.163501 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1416bca-2610-41a0-83d3-bd43a9ac9532 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:56.203787 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd7473-8951-4215-a301-49b1a1a29a04 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:56.238416 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4581b86-89e3-4fbd-a613-1a9b3ad4b7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:56.239206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4581b86-89e3-4fbd-a613-1a9b3ad4b7ba None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:56.239486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4581b86-89e3-4fbd-a613-1a9b3ad4b7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:56.239758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4581b86-89e3-4fbd-a613-1a9b3ad4b7ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:56.250436 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4581b86-89e3-4fbd-a613-1a9b3ad4b7ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:56.251922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4581b86-89e3-4fbd-a613-1a9b3ad4b7ba None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:56.270498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-d4581b86-89e3-4fbd-a613-1a9b3ad4b7ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:56.270498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:56.270498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:56.270498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:56.270498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:56.270498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:56.270498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:56.270498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:56.270498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:56.270498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:56.270498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:56.270498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:56.270498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:56.270498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:56.270498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:56.271400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:56.271400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:56.271400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:56.271400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:56.271400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:56.271400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:56.271400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:56.271400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:56.271400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:56.271400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:56.271400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:56.271400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:56.271400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:56.271400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:56.271400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:56.271400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:56.271400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:56.276809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:56.276809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:56.276809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:56.276809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:56.276809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 264/520] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:56.277092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1416bca-2610-41a0-83d3-bd43a9ac9532 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:56.277173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4581b86-89e3-4fbd-a613-1a9b3ad4b7ba None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:56.311710 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:56.312739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0fd83-d27b-4685-9772-ef614d976ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:56.313371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0fd83-d27b-4685-9772-ef614d976ecf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:56.313659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0fd83-d27b-4685-9772-ef614d976ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:56.313915 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0fd83-d27b-4685-9772-ef614d976ecf None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:56.314659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d0fd83-d27b-4685-9772-ef614d976ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:56.314958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d0fd83-d27b-4685-9772-ef614d976ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:56.316335 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d0fd83-d27b-4685-9772-ef614d976ecf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:56.328414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 257/521] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:56.329219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0fd83-d27b-4685-9772-ef614d976ecf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:56.344856 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:56.388351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4581b86-89e3-4fbd-a613-1a9b3ad4b7ba None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:56.425302 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb693e-52eb-48c2-8f69-f7cfab55a7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:56.425995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb693e-52eb-48c2-8f69-f7cfab55a7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:56.426275 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb693e-52eb-48c2-8f69-f7cfab55a7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:56.426554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb693e-52eb-48c2-8f69-f7cfab55a7d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:56.427330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb693e-52eb-48c2-8f69-f7cfab55a7d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:56.427639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb693e-52eb-48c2-8f69-f7cfab55a7d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:56.429074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb693e-52eb-48c2-8f69-f7cfab55a7d1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:56.435563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0fd83-d27b-4685-9772-ef614d976ecf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:56.447639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 265/522] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:15:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:56.448580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb693e-52eb-48c2-8f69-f7cfab55a7d1 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:56.477896 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2672ca7-46bf-486b-a38f-b1d36eb8c635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:56.478645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2672ca7-46bf-486b-a38f-b1d36eb8c635 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:56.478934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2672ca7-46bf-486b-a38f-b1d36eb8c635 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:56.479331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2672ca7-46bf-486b-a38f-b1d36eb8c635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:56.545947 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:56.551559 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb693e-52eb-48c2-8f69-f7cfab55a7d1 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:56.552429 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2672ca7-46bf-486b-a38f-b1d36eb8c635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:56.554213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2672ca7-46bf-486b-a38f-b1d36eb8c635 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:56.569710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:56.585924 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73a696-d3e1-469e-8a22-695728b8c26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:56.586586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73a696-d3e1-469e-8a22-695728b8c26c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:56.590839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73a696-d3e1-469e-8a22-695728b8c26c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:56.590839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73a696-d3e1-469e-8a22-695728b8c26c None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:56.590839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73a696-d3e1-469e-8a22-695728b8c26c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:56.590839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73a696-d3e1-469e-8a22-695728b8c26c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:56.590839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73a696-d3e1-469e-8a22-695728b8c26c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:56.601352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 266/523] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:56.602354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73a696-d3e1-469e-8a22-695728b8c26c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:56.664543 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 258/524] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:56.665642 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2672ca7-46bf-486b-a38f-b1d36eb8c635 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:56.720983 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73a696-d3e1-469e-8a22-695728b8c26c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:56.756481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c62d-5a86-4183-abad-f2b5ed1a41c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:56.757392 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c62d-5a86-4183-abad-f2b5ed1a41c7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:56.757607 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c62d-5a86-4183-abad-f2b5ed1a41c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:56.757860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c62d-5a86-4183-abad-f2b5ed1a41c7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:56.766371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68c62d-5a86-4183-abad-f2b5ed1a41c7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:56.767826 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68c62d-5a86-4183-abad-f2b5ed1a41c7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:56.773851 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2672ca7-46bf-486b-a38f-b1d36eb8c635 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:56.785554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-7e68c62d-5a86-4183-abad-f2b5ed1a41c7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 07:15:56.785554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:56.785554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:56.785554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:56.785554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:56.785554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:56.785554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:56.785554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:56.785554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:56.785554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:56.785554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:56.785554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:56.785554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:15:56.785554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:15:56.785554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:15:56.785554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:56.786448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:56.787342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:56.787342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:56.787342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:15:56.787342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:15:56.787342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:15:56.787342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:15:56.787342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:15:56.787342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:15:56.787342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 07:15:56.787342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:56.787342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 267/525] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:15:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:56.787890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c62d-5a86-4183-abad-f2b5ed1a41c7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:56.792882 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:56.806487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:56.814202 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d951d-f9ab-40cb-bbca-78bc6aa2ca25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:56.814858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d951d-f9ab-40cb-bbca-78bc6aa2ca25 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:56.815138 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d951d-f9ab-40cb-bbca-78bc6aa2ca25 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:56.815411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d951d-f9ab-40cb-bbca-78bc6aa2ca25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:56.816224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d951d-f9ab-40cb-bbca-78bc6aa2ca25 None admin] RBAC: Adding query filter params (role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=88e1572d22c048b09699a2fe50900f92) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:56.816544 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d951d-f9ab-40cb-bbca-78bc6aa2ca25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:56.817975 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d951d-f9ab-40cb-bbca-78bc6aa2ca25 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:56.830041 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 259/526] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:56 2022] GET /identity/v3/role_assignments?user.id=88e1572d22c048b09699a2fe50900f92&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:56.831365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d951d-f9ab-40cb-bbca-78bc6aa2ca25 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:56.899480 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c62d-5a86-4183-abad-f2b5ed1a41c7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:56.939495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f33c9-3286-4b1c-9510-9b696102c901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:56.940333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f33c9-3286-4b1c-9510-9b696102c901 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:56.940678 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f33c9-3286-4b1c-9510-9b696102c901 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:56.941126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f33c9-3286-4b1c-9510-9b696102c901 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:56.949184 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f33c9-3286-4b1c-9510-9b696102c901 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:56.951177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f33c9-3286-4b1c-9510-9b696102c901 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:56.954836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d951d-f9ab-40cb-bbca-78bc6aa2ca25 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:56.966432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-b10f33c9-3286-4b1c-9510-9b696102c901 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:15:56.966432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:56.966432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:56.966432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:56.966432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:56.966432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:56.966432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:56.966432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:56.966432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:56.966432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:56.966432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:56.966432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:56.966432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:15:56.966432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:15:56.966432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:15:56.967784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:15:56.967784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:56.967784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:56.967784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:56.967784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:56.967784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:56.967784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:56.967784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:56.967784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:56.967784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:56.967784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:56.967784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:56.967784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:56.967784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:56.967784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:56.967784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:56.967784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:56.968632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:15:56.968632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:15:56.968632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:15:56.968632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:15:56.968632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:15:56.968632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:15:56.968632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:15:56.968632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:56.972468 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 268/527] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:56.973462 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f33c9-3286-4b1c-9510-9b696102c901 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:56.999681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e8e83-3ba7-42c1-89ec-b652f2aae009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:57.000841 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e8e83-3ba7-42c1-89ec-b652f2aae009 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:57.001306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e8e83-3ba7-42c1-89ec-b652f2aae009 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:57.001796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e8e83-3ba7-42c1-89ec-b652f2aae009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:57.013097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e8e83-3ba7-42c1-89ec-b652f2aae009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:57.015020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e8e83-3ba7-42c1-89ec-b652f2aae009 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:57.034608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-651e8e83-3ba7-42c1-89ec-b652f2aae009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:57.034608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:57.034608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:57.034608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:57.034608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:57.034608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:57.034608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:57.034608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:57.034608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:57.034608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:57.034608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:57.034608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:57.034608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:57.034608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:57.034608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:57.035548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:57.035548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:57.035548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:57.035548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:57.035548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:57.035548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:57.035548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:57.035548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:57.035548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:57.035548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:57.035548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:57.035548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:57.035548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:57.035548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:57.035548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:57.035548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:57.035548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:57.036384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:57.036384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:57.036384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:57.036384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:57.036384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 260/528] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:57.037191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e8e83-3ba7-42c1-89ec-b652f2aae009 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:57.073303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:57.078748 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:57.104494 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f33c9-3286-4b1c-9510-9b696102c901 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:57.149087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f055806-f8c2-4130-9e89-ed8a222ef09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:57.149955 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f055806-f8c2-4130-9e89-ed8a222ef09b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:57.150239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f055806-f8c2-4130-9e89-ed8a222ef09b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:57.150529 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f055806-f8c2-4130-9e89-ed8a222ef09b None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:57.151947 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f055806-f8c2-4130-9e89-ed8a222ef09b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:57.152263 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f055806-f8c2-4130-9e89-ed8a222ef09b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:57.153948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f055806-f8c2-4130-9e89-ed8a222ef09b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:57.157018 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e8e83-3ba7-42c1-89ec-b652f2aae009 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:57.175054 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 269/529] 10.222.0.52 () {56 vars in 1139 bytes} [Fri Jun 17 07:15:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:57.176039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f055806-f8c2-4130-9e89-ed8a222ef09b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:57.196306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b14965-d49c-4a06-b9de-f14e085c7388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:57.197316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b14965-d49c-4a06-b9de-f14e085c7388 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:57.197807 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b14965-d49c-4a06-b9de-f14e085c7388 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:57.198226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b14965-d49c-4a06-b9de-f14e085c7388 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:57.199593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b14965-d49c-4a06-b9de-f14e085c7388 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:57.200287 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b14965-d49c-4a06-b9de-f14e085c7388 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:57.202413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b14965-d49c-4a06-b9de-f14e085c7388 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:57.226020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 261/530] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:15:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:57.227685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b14965-d49c-4a06-b9de-f14e085c7388 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:57.300007 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f055806-f8c2-4130-9e89-ed8a222ef09b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:57.338272 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:57.345547 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8149c40-ee94-454a-a275-81d7e474d8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:57.346929 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8149c40-ee94-454a-a275-81d7e474d8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:57.347356 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8149c40-ee94-454a-a275-81d7e474d8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:57.351245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8149c40-ee94-454a-a275-81d7e474d8a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:57.351245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8149c40-ee94-454a-a275-81d7e474d8a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:57.351436 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b14965-d49c-4a06-b9de-f14e085c7388 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:57.351525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8149c40-ee94-454a-a275-81d7e474d8a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:57.351525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8149c40-ee94-454a-a275-81d7e474d8a1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:57.352574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:57.365540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 270/531] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:57.366754 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8149c40-ee94-454a-a275-81d7e474d8a1 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:57.386333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d32c04-e7be-4529-94ba-006feee6273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:57.387077 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d32c04-e7be-4529-94ba-006feee6273e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:57.387361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d32c04-e7be-4529-94ba-006feee6273e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:57.387631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d32c04-e7be-4529-94ba-006feee6273e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:57.462791 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d32c04-e7be-4529-94ba-006feee6273e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:57.464174 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d32c04-e7be-4529-94ba-006feee6273e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:57.500456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8149c40-ee94-454a-a275-81d7e474d8a1 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:57.551203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854a3e6-d8e5-49d1-8463-67f44f665518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:57.552419 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854a3e6-d8e5-49d1-8463-67f44f665518 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:57.552934 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854a3e6-d8e5-49d1-8463-67f44f665518 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:57.553415 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854a3e6-d8e5-49d1-8463-67f44f665518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:57.554661 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854a3e6-d8e5-49d1-8463-67f44f665518 None admin] RBAC: Adding query filter params (role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=bde4369f695745c199ce6c10d241b841) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:57.555043 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854a3e6-d8e5-49d1-8463-67f44f665518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:57.557313 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854a3e6-d8e5-49d1-8463-67f44f665518 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:57.565254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:57.566644 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 271/532] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:57 2022] GET /identity/v3/role_assignments?user.id=bde4369f695745c199ce6c10d241b841&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:57.567838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854a3e6-d8e5-49d1-8463-67f44f665518 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:57.590873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 262/533] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:15:57.596779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d32c04-e7be-4529-94ba-006feee6273e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:57.685352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:57.728272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854a3e6-d8e5-49d1-8463-67f44f665518 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:57.749349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d32c04-e7be-4529-94ba-006feee6273e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:57.767607 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f5020-778f-4500-839a-fdcdd9594b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:57.768405 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f5020-778f-4500-839a-fdcdd9594b08 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:57.768688 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f5020-778f-4500-839a-fdcdd9594b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:57.768948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f5020-778f-4500-839a-fdcdd9594b08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:57.776266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f5020-778f-4500-839a-fdcdd9594b08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:57.777764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f5020-778f-4500-839a-fdcdd9594b08 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:57.794039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-1c0f5020-778f-4500-839a-fdcdd9594b08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:15:57.794039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:57.794039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:57.794039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:57.794039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:57.794039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:57.794039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:57.794039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:57.794039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:57.794039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:57.794039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:57.794039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:57.794039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:15:57.794039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:15:57.794039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:15:57.794918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:15:57.794918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:57.794918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:57.794918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:57.794918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:57.794918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:57.794918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:57.794918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:57.794918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:57.794918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:57.794918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:57.794918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:57.794918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:57.794918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:57.794918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:57.794918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:57.794918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:57.795833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:15:57.795833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:15:57.795833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:15:57.795833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:15:57.795833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:15:57.795833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:15:57.795833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:15:57.795833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:57.795833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 272/534] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:57.800964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f5020-778f-4500-839a-fdcdd9594b08 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:57.814576 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da198de2-be0e-4144-bc3f-a1fb0a9db246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:57.815384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da198de2-be0e-4144-bc3f-a1fb0a9db246 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:57.815661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da198de2-be0e-4144-bc3f-a1fb0a9db246 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:57.815931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da198de2-be0e-4144-bc3f-a1fb0a9db246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:57.843024 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da198de2-be0e-4144-bc3f-a1fb0a9db246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:57.844512 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da198de2-be0e-4144-bc3f-a1fb0a9db246 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:57.870993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-da198de2-be0e-4144-bc3f-a1fb0a9db246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:57.870993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:57.870993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:57.870993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:57.870993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:57.870993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:57.870993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:57.870993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:57.870993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:57.870993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:57.870993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:57.870993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:57.870993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:57.870993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:57.870993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:57.871906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:57.871906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:57.871906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:57.871906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:57.871906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:57.871906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:57.871906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:57.871906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:57.871906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:57.871906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:57.871906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:57.871906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:57.871906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:57.871906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:57.871906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:57.871906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:57.871906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:57.872842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:57.872842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:57.872842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:57.872842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:57.872842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 263/535] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:57.882269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da198de2-be0e-4144-bc3f-a1fb0a9db246 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:57.930729 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f5020-778f-4500-839a-fdcdd9594b08 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:57.965789 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:57.967372 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:57.992287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e7223-10d2-4b18-bcaa-87135d126e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:57.992874 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e7223-10d2-4b18-bcaa-87135d126e75 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:57.993183 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e7223-10d2-4b18-bcaa-87135d126e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:57.993451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e7223-10d2-4b18-bcaa-87135d126e75 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:57.994261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e7223-10d2-4b18-bcaa-87135d126e75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:57.994540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e7223-10d2-4b18-bcaa-87135d126e75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:57.996051 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e7223-10d2-4b18-bcaa-87135d126e75 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:58.018006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 273/536] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:15:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:58.023561 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e7223-10d2-4b18-bcaa-87135d126e75 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:58.051397 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da198de2-be0e-4144-bc3f-a1fb0a9db246 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:58.118089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcef4b7-6514-40f8-a592-c4348067f020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:58.119112 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcef4b7-6514-40f8-a592-c4348067f020 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:58.119638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcef4b7-6514-40f8-a592-c4348067f020 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:58.120112 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcef4b7-6514-40f8-a592-c4348067f020 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:58.121056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcef4b7-6514-40f8-a592-c4348067f020 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:58.121592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcef4b7-6514-40f8-a592-c4348067f020 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:58.127152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcef4b7-6514-40f8-a592-c4348067f020 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:58.144882 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 264/537] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:58.150632 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcef4b7-6514-40f8-a592-c4348067f020 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:58.179608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e7223-10d2-4b18-bcaa-87135d126e75 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:58.227339 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc8677-12f5-4b44-8858-21aa8eaf3993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:58.228006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc8677-12f5-4b44-8858-21aa8eaf3993 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:58.228282 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc8677-12f5-4b44-8858-21aa8eaf3993 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:58.228556 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc8677-12f5-4b44-8858-21aa8eaf3993 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:58.229401 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc8677-12f5-4b44-8858-21aa8eaf3993 None admin] RBAC: Adding query filter params (role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=afefcf9ac054459c9585d8be3c604fc0) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:58.229710 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc8677-12f5-4b44-8858-21aa8eaf3993 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:58.232040 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc8677-12f5-4b44-8858-21aa8eaf3993 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:58.253401 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 274/538] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:58 2022] GET /identity/v3/role_assignments?user.id=afefcf9ac054459c9585d8be3c604fc0&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:58.255164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a077ad6-b25c-491a-8524-661c489649a7 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:58.255684 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a077ad6-b25c-491a-8524-661c489649a7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:58.256186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a077ad6-b25c-491a-8524-661c489649a7 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:58.258250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 275/539] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:58.264514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad0a33-84e3-4f65-a25d-41d778b4a333 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:58.265214 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad0a33-84e3-4f65-a25d-41d778b4a333 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:58.265744 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad0a33-84e3-4f65-a25d-41d778b4a333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:58.285066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-75ad0a33-84e3-4f65-a25d-41d778b4a333 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:58.286841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-75ad0a33-84e3-4f65-a25d-41d778b4a333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:58.295961 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcef4b7-6514-40f8-a592-c4348067f020 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:58.299257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:58.364698 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:58.373643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2951449-cb9f-4e26-b6ff-92b3fc2bbbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:58.377349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2951449-cb9f-4e26-b6ff-92b3fc2bbbeb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:58.377349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2951449-cb9f-4e26-b6ff-92b3fc2bbbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:58.377349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2951449-cb9f-4e26-b6ff-92b3fc2bbbeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:58.388066 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2951449-cb9f-4e26-b6ff-92b3fc2bbbeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:58.396533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2951449-cb9f-4e26-b6ff-92b3fc2bbbeb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:58.411674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a2951449-cb9f-4e26-b6ff-92b3fc2bbbeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:15:58.411674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:58.411674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:58.411674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:58.411674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:58.411674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:58.411674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:58.411674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:58.411674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:58.411674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:58.411674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:58.411674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:58.411674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:15:58.411674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:15:58.411674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:15:58.412588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:15:58.412588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:58.412588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:58.412588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:58.412588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:58.412588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:58.412588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:58.412588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:58.412588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:58.412588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:58.412588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:58.412588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:58.412588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:58.412588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:58.412588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:58.412588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:58.412588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:58.413464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:15:58.413464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:15:58.413464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:15:58.413464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:15:58.413464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:15:58.413464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:15:58.413464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:15:58.413464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:58.414424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 265/540] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:58.417497 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 276/541] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:15:58.425147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2951449-cb9f-4e26-b6ff-92b3fc2bbbeb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:58.469563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad0a33-84e3-4f65-a25d-41d778b4a333 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:58.540935 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2951449-cb9f-4e26-b6ff-92b3fc2bbbeb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:58.582589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad0a33-84e3-4f65-a25d-41d778b4a333 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:58.593930 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6625e-147e-418e-b709-3c63d53e7549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:58.594848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6625e-147e-418e-b709-3c63d53e7549 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:58.595307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6625e-147e-418e-b709-3c63d53e7549 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:58.595780 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6625e-147e-418e-b709-3c63d53e7549 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:58.596737 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6625e-147e-418e-b709-3c63d53e7549 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:58.597220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6625e-147e-418e-b709-3c63d53e7549 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:58.598843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6625e-147e-418e-b709-3c63d53e7549 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:58.618486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06eeef-9764-4014-acb7-c90ddf0c446e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:58.619290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06eeef-9764-4014-acb7-c90ddf0c446e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:58.619574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06eeef-9764-4014-acb7-c90ddf0c446e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:58.619850 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06eeef-9764-4014-acb7-c90ddf0c446e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:58.624480 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 266/542] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:15:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:58.632380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6625e-147e-418e-b709-3c63d53e7549 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:58.637258 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06eeef-9764-4014-acb7-c90ddf0c446e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:58.650860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-2c06eeef-9764-4014-acb7-c90ddf0c446e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:15:58.650860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:58.650860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:58.650860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:58.650860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:58.650860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:58.650860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:58.650860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:58.650860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:58.650860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:58.650860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:58.650860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:58.650860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:58.650860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:58.650860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:58.650860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:58.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:58.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:58.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:58.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:58.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:58.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:58.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:58.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:58.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:58.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:58.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:58.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:58.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:58.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:58.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:58.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:58.652548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:58.652548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:58.652548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:58.652548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:58.652548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:58.652548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:58.652548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:58.652548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:58.652548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:58.652548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:58.652548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:15:58.652548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:58.658292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 277/543] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:15:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:58.660856 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06eeef-9764-4014-acb7-c90ddf0c446e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:58.698782 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:58.737731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:58.845861 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06eeef-9764-4014-acb7-c90ddf0c446e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:58.846754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6625e-147e-418e-b709-3c63d53e7549 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:58.883418 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154558f9-0954-4f33-95f5-978e87686ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:58.884157 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154558f9-0954-4f33-95f5-978e87686ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:58.884443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154558f9-0954-4f33-95f5-978e87686ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:58.884767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154558f9-0954-4f33-95f5-978e87686ca2 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:58.885686 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154558f9-0954-4f33-95f5-978e87686ca2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:58.885999 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154558f9-0954-4f33-95f5-978e87686ca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:58.887506 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154558f9-0954-4f33-95f5-978e87686ca2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:58.896847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 278/544] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:15:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:58.905356 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154558f9-0954-4f33-95f5-978e87686ca2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:58.919383 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6a607-cab5-4484-917b-d907bb800f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:58.921104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a607-cab5-4484-917b-d907bb800f10 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:58.921635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a607-cab5-4484-917b-d907bb800f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:58.922109 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a607-cab5-4484-917b-d907bb800f10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:58.923163 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6a607-cab5-4484-917b-d907bb800f10 None admin] RBAC: Adding query filter params (role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=ad436c2fecba4754875b7c7cb26852a5) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:58.923698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6a607-cab5-4484-917b-d907bb800f10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:58.925377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6a607-cab5-4484-917b-d907bb800f10 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:58.937242 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 267/545] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:58 2022] GET /identity/v3/role_assignments?user.id=ad436c2fecba4754875b7c7cb26852a5&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:59.057358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:59.063095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154558f9-0954-4f33-95f5-978e87686ca2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:59.113144 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd939651-3e1b-4dbc-befa-7b99968f371c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:59.114439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd939651-3e1b-4dbc-befa-7b99968f371c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:59.114928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd939651-3e1b-4dbc-befa-7b99968f371c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:59.115389 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd939651-3e1b-4dbc-befa-7b99968f371c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:59.133006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd939651-3e1b-4dbc-befa-7b99968f371c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:59.134786 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd939651-3e1b-4dbc-befa-7b99968f371c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:59.158142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-dd939651-3e1b-4dbc-befa-7b99968f371c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:59.158142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:59.158142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:59.158142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:59.158142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:59.158142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:59.158142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:59.158142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:59.158142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:59.158142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:59.158142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:59.158142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:59.158142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:59.158142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:59.158142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:59.159056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:59.159056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:59.159056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:59.159056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:59.159056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:59.159056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:59.159056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:59.159056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:59.159056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:59.159056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:59.159056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:59.159056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:59.159056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:59.159056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:59.159056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:59.159056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:59.159056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:59.159975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:59.159975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:59.159975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:59.159975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:59.162061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 279/546] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:59.167481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6a607-cab5-4484-917b-d907bb800f10 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:59.276001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6604a8-cf1b-45a6-b54d-ae549bc3f32b None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:59.276319 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6604a8-cf1b-45a6-b54d-ae549bc3f32b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:59.276567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6604a8-cf1b-45a6-b54d-ae549bc3f32b None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:59.278236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 280/547] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:59.289071 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b9870-3bd7-4997-9e89-bc0745e6c2cd None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:59.289375 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b9870-3bd7-4997-9e89-bc0745e6c2cd None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:59.289656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b9870-3bd7-4997-9e89-bc0745e6c2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:59.294227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:59.311419 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6a607-cab5-4484-917b-d907bb800f10 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:59.317249 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c53b9870-3bd7-4997-9e89-bc0745e6c2cd None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:59.318455 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c53b9870-3bd7-4997-9e89-bc0745e6c2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:59.375088 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308560d9-479e-4631-ae33-28f6980e7b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:59.375673 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308560d9-479e-4631-ae33-28f6980e7b6c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:59.375948 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308560d9-479e-4631-ae33-28f6980e7b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:59.376217 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308560d9-479e-4631-ae33-28f6980e7b6c None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:59.376937 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308560d9-479e-4631-ae33-28f6980e7b6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:59.377234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308560d9-479e-4631-ae33-28f6980e7b6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:59.378645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308560d9-479e-4631-ae33-28f6980e7b6c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:59.402619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 268/548] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:59.408791 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308560d9-479e-4631-ae33-28f6980e7b6c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:59.449354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 281/549] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:15:59.476268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b9870-3bd7-4997-9e89-bc0745e6c2cd None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:59.587021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:59.605395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308560d9-479e-4631-ae33-28f6980e7b6c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:59.611700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b9870-3bd7-4997-9e89-bc0745e6c2cd None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:59.651482 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b927f9d-a461-48d8-a962-e4ea971e26d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:59.652213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b927f9d-a461-48d8-a962-e4ea971e26d3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:59.652501 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b927f9d-a461-48d8-a962-e4ea971e26d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:59.652781 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b927f9d-a461-48d8-a962-e4ea971e26d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:59.664744 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b927f9d-a461-48d8-a962-e4ea971e26d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:59.677152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-9b927f9d-a461-48d8-a962-e4ea971e26d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:15:59.677152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:59.677152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:59.677152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:59.677152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:59.677152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:59.677152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:59.677152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:59.677152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:59.677152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:59.677152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:59.677152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:59.677152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:59.677152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:59.677152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:59.677152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:59.678173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:59.678173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:59.678173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:59.678173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:59.678173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:59.678173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:59.678173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:59.678173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:59.678173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:59.678173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:59.678173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:59.678173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:59.678173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:59.678173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:59.678173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:59.678173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:59.679001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:59.679001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:59.679001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:59.679001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:59.679001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:59.679001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:59.679001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:59.679001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:59.679001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:59.679001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:59.679001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:15:59.679001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:15:59.680489 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 282/550] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:15:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:59.684915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b927f9d-a461-48d8-a962-e4ea971e26d3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:59.738594 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f881d8-32fb-49e4-9cab-e15d5dc35731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:59.739405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f881d8-32fb-49e4-9cab-e15d5dc35731 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:59.739682 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f881d8-32fb-49e4-9cab-e15d5dc35731 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:59.739951 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f881d8-32fb-49e4-9cab-e15d5dc35731 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:59.762149 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f881d8-32fb-49e4-9cab-e15d5dc35731 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:59.763606 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f881d8-32fb-49e4-9cab-e15d5dc35731 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:59.793363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-95f881d8-32fb-49e4-9cab-e15d5dc35731 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:15:59.793363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:59.793363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:59.793363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:59.793363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:59.793363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:59.793363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:59.793363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:59.793363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:59.793363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:59.793363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:59.793363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:59.793363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:15:59.793363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:15:59.793363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:15:59.793363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:59.794444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:59.795443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:59.795443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:59.795443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:15:59.795443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:15:59.795443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:15:59.795443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:15:59.795443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:15:59.795443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:15:59.795443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:15:59.795443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:15:59.795977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b927f9d-a461-48d8-a962-e4ea971e26d3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:59.802991 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 269/551] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:15:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:59.810266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f881d8-32fb-49e4-9cab-e15d5dc35731 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:59.831118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:59.838654 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4123b-6c3a-425a-bac2-5ad11660ef5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:59.839577 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4123b-6c3a-425a-bac2-5ad11660ef5d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:59.840005 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4123b-6c3a-425a-bac2-5ad11660ef5d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:59.840424 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4123b-6c3a-425a-bac2-5ad11660ef5d None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:59.851044 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4123b-6c3a-425a-bac2-5ad11660ef5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:59.851044 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4123b-6c3a-425a-bac2-5ad11660ef5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:59.851044 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4123b-6c3a-425a-bac2-5ad11660ef5d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:59.857085 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 283/552] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:15:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:59.858162 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:59.860147 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4123b-6c3a-425a-bac2-5ad11660ef5d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:00.032306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f881d8-32fb-49e4-9cab-e15d5dc35731 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:00.051698 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4123b-6c3a-425a-bac2-5ad11660ef5d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:00.077145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dec3c0-ff48-49fd-8bda-5770f3315cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:00.077852 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dec3c0-ff48-49fd-8bda-5770f3315cde None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:00.078138 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dec3c0-ff48-49fd-8bda-5770f3315cde None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:00.078440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dec3c0-ff48-49fd-8bda-5770f3315cde None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:00.079987 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dec3c0-ff48-49fd-8bda-5770f3315cde None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:00.080300 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dec3c0-ff48-49fd-8bda-5770f3315cde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:00.082224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dec3c0-ff48-49fd-8bda-5770f3315cde None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:00.088508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b0111-8843-4642-9f06-e318daa66505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:00.089565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b0111-8843-4642-9f06-e318daa66505 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:00.090028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b0111-8843-4642-9f06-e318daa66505 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:00.090503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b0111-8843-4642-9f06-e318daa66505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:00.102530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 270/553] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Jun 17 07:15:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:00.104243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee545bc4-4440-4cd8-b5d4-192ab7af2b27 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:00.106338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee545bc4-4440-4cd8-b5d4-192ab7af2b27 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:00.106338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee545bc4-4440-4cd8-b5d4-192ab7af2b27 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:00.106869 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 271/554] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:00.112171 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee545bc4-4440-4cd8-b5d4-192ab7af2b27 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:00.112628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b0111-8843-4642-9f06-e318daa66505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:00.114276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b0111-8843-4642-9f06-e318daa66505 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:00.137102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-6a2b0111-8843-4642-9f06-e318daa66505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:00.137102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:00.137102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:00.137102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:00.137102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:00.137102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:00.137102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:00.137102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:00.137102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:00.137102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:00.137102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:00.137102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:00.137102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:00.137102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:00.137102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:00.142764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:00.142764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:00.142764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:00.142764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:00.142764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:00.142764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:00.142764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:00.142764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:00.142764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:00.142764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:00.142764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:00.142764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:00.142764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:00.142764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:00.142764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:00.142764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:00.142764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:00.143643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:00.143643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:00.143643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:00.143643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:00.143643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 284/555] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:00.143643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df21cd5-da19-45e2-86d1-3cabbcf37bf9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:00.143643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df21cd5-da19-45e2-86d1-3cabbcf37bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:00.143643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df21cd5-da19-45e2-86d1-3cabbcf37bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:00.167123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-5df21cd5-da19-45e2-86d1-3cabbcf37bf9 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:00.168546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5df21cd5-da19-45e2-86d1-3cabbcf37bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:00.187017 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:00.229141 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:00.235404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee545bc4-4440-4cd8-b5d4-192ab7af2b27 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:00.257073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 285/556] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:16:00.258713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df21cd5-da19-45e2-86d1-3cabbcf37bf9 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:00.273772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266dc21-6794-4e69-98d6-99b7afdfa6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:00.274734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266dc21-6794-4e69-98d6-99b7afdfa6fc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:00.275096 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266dc21-6794-4e69-98d6-99b7afdfa6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:00.275424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266dc21-6794-4e69-98d6-99b7afdfa6fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:00.356846 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266dc21-6794-4e69-98d6-99b7afdfa6fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:00.358912 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266dc21-6794-4e69-98d6-99b7afdfa6fc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:00.386245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df21cd5-da19-45e2-86d1-3cabbcf37bf9 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:00.425587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00926085-77f2-436d-9443-d24c31e11163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:00.426387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926085-77f2-436d-9443-d24c31e11163 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:00.426743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926085-77f2-436d-9443-d24c31e11163 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:00.427092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926085-77f2-436d-9443-d24c31e11163 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:00.427902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00926085-77f2-436d-9443-d24c31e11163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:00.428253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00926085-77f2-436d-9443-d24c31e11163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:00.429732 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00926085-77f2-436d-9443-d24c31e11163 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:00.440045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:00.447147 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 286/557] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:00.448332 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00926085-77f2-436d-9443-d24c31e11163 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:00.494832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:00.496446 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 272/558] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 07:16:00.501766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266dc21-6794-4e69-98d6-99b7afdfa6fc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:00.557447 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00926085-77f2-436d-9443-d24c31e11163 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:00.592792 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0fabc-b4a4-4c46-95a7-bc719561372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:00.593764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0fabc-b4a4-4c46-95a7-bc719561372d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:00.594140 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0fabc-b4a4-4c46-95a7-bc719561372d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:00.594511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0fabc-b4a4-4c46-95a7-bc719561372d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:00.605026 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0fabc-b4a4-4c46-95a7-bc719561372d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:00.612945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266dc21-6794-4e69-98d6-99b7afdfa6fc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:00.613875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-c1a0fabc-b4a4-4c46-95a7-bc719561372d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:00.613875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:00.613875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:00.613875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:00.613875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:00.613875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:00.613875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:00.613875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:00.613875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:00.613875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:00.613875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:00.613875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:00.613875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:00.613875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:00.613875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:00.613875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:00.615331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:00.615331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:00.615331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:00.615331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:00.615331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:00.615331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:00.615331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:00.615331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:00.615331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:00.615331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:00.615331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:00.615331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:00.615331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:00.615331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:00.615331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:00.615331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:00.616172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:00.616172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:00.616172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:00.616172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:00.616172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:00.616172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:00.616172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:00.616172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:00.616172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:00.616172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:00.616172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:00.616172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:00.616172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 287/559] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:16:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:00.616863 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0fabc-b4a4-4c46-95a7-bc719561372d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:00.658272 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795853d-0ecf-459e-a36f-d275ca0b8a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:00.659374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795853d-0ecf-459e-a36f-d275ca0b8a70 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:00.659840 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795853d-0ecf-459e-a36f-d275ca0b8a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:00.660296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795853d-0ecf-459e-a36f-d275ca0b8a70 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:00.669229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795853d-0ecf-459e-a36f-d275ca0b8a70 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:00.673633 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795853d-0ecf-459e-a36f-d275ca0b8a70 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:00.692666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d795853d-0ecf-459e-a36f-d275ca0b8a70 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:16:00.692666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:00.692666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:00.692666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:00.692666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:00.692666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:00.692666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:00.692666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:00.692666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:00.692666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:00.692666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:00.692666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:00.692666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:00.692666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:00.692666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:00.692666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:00.693779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:00.694734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:00.694734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:00.694734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:00.694734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:00.694734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:00.694734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:00.694734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:00.694734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:00.694734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:16:00.694734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:00.697502 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 273/560] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Jun 17 07:16:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:00.698491 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795853d-0ecf-459e-a36f-d275ca0b8a70 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:00.732965 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:00.734171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:00.736415 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0fabc-b4a4-4c46-95a7-bc719561372d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:00.776775 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94342614-5915-4236-9687-370c59c01195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:00.777833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94342614-5915-4236-9687-370c59c01195 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:00.778346 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94342614-5915-4236-9687-370c59c01195 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:00.778888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94342614-5915-4236-9687-370c59c01195 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:00.791552 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94342614-5915-4236-9687-370c59c01195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:00.793489 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94342614-5915-4236-9687-370c59c01195 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:00.815130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-94342614-5915-4236-9687-370c59c01195 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:00.815130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:00.815130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:00.815130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:00.815130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:00.815130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:00.815130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:00.815130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:00.815130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:00.815130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:00.815130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:00.815130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:00.815130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:00.815130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:00.815130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:00.817594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:00.817594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:00.817594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:00.817594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:00.817594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:00.817594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:00.817594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:00.817594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:00.817594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:00.817594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:00.817594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:00.817594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:00.817594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:00.817594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:00.817594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:00.817594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:00.817594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:00.818652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:00.818652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:00.818652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:00.818652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:00.820181 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 288/561] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:00.821216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94342614-5915-4236-9687-370c59c01195 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:00.828261 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795853d-0ecf-459e-a36f-d275ca0b8a70 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:00.868965 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea29bc-5812-40af-9b03-7a26f0bb6e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:00.869728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea29bc-5812-40af-9b03-7a26f0bb6e71 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:00.870008 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea29bc-5812-40af-9b03-7a26f0bb6e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:00.870280 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea29bc-5812-40af-9b03-7a26f0bb6e71 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:00.871031 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea29bc-5812-40af-9b03-7a26f0bb6e71 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:00.871448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea29bc-5812-40af-9b03-7a26f0bb6e71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:00.872812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea29bc-5812-40af-9b03-7a26f0bb6e71 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:00.886632 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 274/562] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:16:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:00.887497 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea29bc-5812-40af-9b03-7a26f0bb6e71 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:00.929632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94342614-5915-4236-9687-370c59c01195 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:00.966403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e39b65-b137-49e9-bdd9-5ffef4b18b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:00.967700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e39b65-b137-49e9-bdd9-5ffef4b18b6a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:00.967982 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e39b65-b137-49e9-bdd9-5ffef4b18b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:00.968417 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e39b65-b137-49e9-bdd9-5ffef4b18b6a None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:00.969713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e39b65-b137-49e9-bdd9-5ffef4b18b6a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:00.970036 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e39b65-b137-49e9-bdd9-5ffef4b18b6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:00.971843 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e39b65-b137-49e9-bdd9-5ffef4b18b6a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:00.979017 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:00.994075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea29bc-5812-40af-9b03-7a26f0bb6e71 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:01.000067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 289/563] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Jun 17 07:16:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:01.000067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6627bbf-7f9f-4e6f-ae1b-98e953a6c1fe None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.000067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6627bbf-7f9f-4e6f-ae1b-98e953a6c1fe None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.000067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6627bbf-7f9f-4e6f-ae1b-98e953a6c1fe None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.000067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 290/564] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:01.000419 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6627bbf-7f9f-4e6f-ae1b-98e953a6c1fe None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:01.017191 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:01.035706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961a203-6762-4217-9920-b132cde470ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:01.036501 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961a203-6762-4217-9920-b132cde470ab None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.036749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961a203-6762-4217-9920-b132cde470ab None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.037023 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961a203-6762-4217-9920-b132cde470ab None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.037783 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961a203-6762-4217-9920-b132cde470ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:01.038093 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961a203-6762-4217-9920-b132cde470ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:01.039563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961a203-6762-4217-9920-b132cde470ab None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:01.056226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 275/565] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:01.056226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961a203-6762-4217-9920-b132cde470ab None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:01.116481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6627bbf-7f9f-4e6f-ae1b-98e953a6c1fe None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:01.213710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961a203-6762-4217-9920-b132cde470ab None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:01.215155 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2717e9-6e0c-4028-b136-6a03ff00b2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:01.216348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2717e9-6e0c-4028-b136-6a03ff00b2fc None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.216348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2717e9-6e0c-4028-b136-6a03ff00b2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.216538 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2717e9-6e0c-4028-b136-6a03ff00b2fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.227408 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2717e9-6e0c-4028-b136-6a03ff00b2fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:01.228864 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2717e9-6e0c-4028-b136-6a03ff00b2fc None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:01.246673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-9f2717e9-6e0c-4028-b136-6a03ff00b2fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:01.246673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:01.246673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:01.246673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:01.246673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:01.246673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:01.246673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:01.246673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:01.246673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:01.246673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:01.246673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:01.246673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:01.246673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:01.246673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:01.246673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:01.247585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:01.247585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:01.247585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:01.247585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:01.247585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:01.247585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:01.247585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:01.247585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:01.247585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:01.247585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:01.247585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:01.247585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:01.247585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:01.247585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:01.247585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:01.247585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:01.247585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:01.248973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:01.248973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:01.248973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:01.248973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:01.248973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 291/566] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:01.249890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5e82d-3c3d-4190-8d2a-13d8a19c9d89 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.250174 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5e82d-3c3d-4190-8d2a-13d8a19c9d89 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.250449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5e82d-3c3d-4190-8d2a-13d8a19c9d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.256538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd73f2-8760-43d8-b296-f7df54c1158a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:01.257367 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd73f2-8760-43d8-b296-f7df54c1158a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.257653 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd73f2-8760-43d8-b296-f7df54c1158a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.257929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd73f2-8760-43d8-b296-f7df54c1158a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.268312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f7b5e82d-3c3d-4190-8d2a-13d8a19c9d89 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:01.269488 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd73f2-8760-43d8-b296-f7df54c1158a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:01.270109 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f7b5e82d-3c3d-4190-8d2a-13d8a19c9d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:01.279413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd73f2-8760-43d8-b296-f7df54c1158a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:01.287419 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:01.299262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-33cd73f2-8760-43d8-b296-f7df54c1158a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:01.299262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:01.299262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:01.299262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:01.299262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:01.299262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:01.299262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:01.299262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:01.299262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:01.299262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:01.299262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:01.299262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:01.299262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:01.299262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:01.299262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:01.300410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:01.300410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:01.300410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:01.300410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:01.300410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:01.300410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:01.300410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:01.300410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:01.300410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:01.300410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:01.300410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:01.300410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:01.300410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:01.300410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:01.300410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:01.300410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:01.300410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:01.301311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:01.301311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:01.301311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:01.301311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:01.301311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 276/567] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:01.301311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd73f2-8760-43d8-b296-f7df54c1158a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:01.341503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:01.353196 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 292/568] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:16:01.354107 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5e82d-3c3d-4190-8d2a-13d8a19c9d89 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:01.414113 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd73f2-8760-43d8-b296-f7df54c1158a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:01.447789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817f1f3-d340-4de9-af78-522ccaa2bd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:01.448580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817f1f3-d340-4de9-af78-522ccaa2bd75 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.448865 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817f1f3-d340-4de9-af78-522ccaa2bd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.449139 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817f1f3-d340-4de9-af78-522ccaa2bd75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.451467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5e82d-3c3d-4190-8d2a-13d8a19c9d89 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:01.455826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817f1f3-d340-4de9-af78-522ccaa2bd75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:01.457274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817f1f3-d340-4de9-af78-522ccaa2bd75 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:01.471953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5817f1f3-d340-4de9-af78-522ccaa2bd75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:01.471953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:01.471953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:01.471953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:01.471953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:01.471953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:01.471953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:01.471953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:01.471953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:01.471953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:01.471953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:01.471953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:01.471953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:01.471953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:01.471953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:01.473016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:01.473016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:01.473016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:01.473016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:01.473016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:01.473016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:01.473016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:01.473016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:01.473016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:01.473016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:01.473016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:01.473016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:01.473016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:01.473016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:01.473016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:01.473016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:01.473016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:01.474147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:01.474147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:01.474147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:01.474147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:01.474147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:01.474147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:01.474147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:01.474147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:01.474147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 277/569] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:01.474147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817f1f3-d340-4de9-af78-522ccaa2bd75 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:01.489879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f9c56-0269-4280-86ba-1e1aa2e65ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:01.490552 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f9c56-0269-4280-86ba-1e1aa2e65ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.490828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f9c56-0269-4280-86ba-1e1aa2e65ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.491098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f9c56-0269-4280-86ba-1e1aa2e65ef6 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.491812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f9c56-0269-4280-86ba-1e1aa2e65ef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:01.492115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f9c56-0269-4280-86ba-1e1aa2e65ef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:01.493513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f9c56-0269-4280-86ba-1e1aa2e65ef6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:01.505769 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 293/570] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:01.507153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933a66e-4c68-40ae-95b5-fbdcb51e1d15 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.507602 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933a66e-4c68-40ae-95b5-fbdcb51e1d15 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.508019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933a66e-4c68-40ae-95b5-fbdcb51e1d15 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.509521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 294/571] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:01.510347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933a66e-4c68-40ae-95b5-fbdcb51e1d15 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:01.537489 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:01.563429 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:01.579010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817f1f3-d340-4de9-af78-522ccaa2bd75 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:01.611411 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933a66e-4c68-40ae-95b5-fbdcb51e1d15 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:01.612128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f7552-c8e9-43e2-9465-f66d7a108671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:01.612784 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f7552-c8e9-43e2-9465-f66d7a108671 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.613062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f7552-c8e9-43e2-9465-f66d7a108671 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.613360 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f7552-c8e9-43e2-9465-f66d7a108671 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.614076 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f7552-c8e9-43e2-9465-f66d7a108671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:01.614378 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f7552-c8e9-43e2-9465-f66d7a108671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:01.615724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f7552-c8e9-43e2-9465-f66d7a108671 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:01.627408 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 278/572] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:01.628193 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f7552-c8e9-43e2-9465-f66d7a108671 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:01.649312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32362975-3375-4556-8be3-eec55b7d7a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:01.650136 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32362975-3375-4556-8be3-eec55b7d7a75 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.650414 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32362975-3375-4556-8be3-eec55b7d7a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.650687 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32362975-3375-4556-8be3-eec55b7d7a75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.660907 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32362975-3375-4556-8be3-eec55b7d7a75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:01.668591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-32362975-3375-4556-8be3-eec55b7d7a75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:01.668591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:01.668591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:01.668591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:01.668591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:01.668591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:01.668591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:01.668591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:01.668591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:01.668591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:01.668591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:01.668591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:01.668591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:01.668591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:01.668591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:01.668591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:01.669700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:01.669700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:01.669700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:01.669700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:01.669700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:01.669700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:01.669700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:01.669700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:01.669700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:01.669700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:01.669700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:01.669700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:01.669700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:01.669700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:01.669700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:01.669700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:01.671286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:01.671286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:01.671286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:01.671286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:01.671286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:01.671286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:01.671286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:01.671286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:01.671286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:01.671286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:01.671286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:01.671286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:01.671286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 295/573] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:16:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:01.673069 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32362975-3375-4556-8be3-eec55b7d7a75 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:01.734935 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f7552-c8e9-43e2-9465-f66d7a108671 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:01.752554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:01.768862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a4265-44bc-431a-badb-f9d0deb2664b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:01.769539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a4265-44bc-431a-badb-f9d0deb2664b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.769816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a4265-44bc-431a-badb-f9d0deb2664b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.770086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a4265-44bc-431a-badb-f9d0deb2664b None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.770852 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a4265-44bc-431a-badb-f9d0deb2664b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:01.771076 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32362975-3375-4556-8be3-eec55b7d7a75 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:01.771179 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a4265-44bc-431a-badb-f9d0deb2664b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:01.772562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a4265-44bc-431a-badb-f9d0deb2664b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:01.784631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 279/574] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:01.785010 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:01.786716 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56f504-5c18-4b48-84e6-fe9b31dbc79c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.787173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56f504-5c18-4b48-84e6-fe9b31dbc79c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.787710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56f504-5c18-4b48-84e6-fe9b31dbc79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.804352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0d56f504-5c18-4b48-84e6-fe9b31dbc79c None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:01.805583 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0d56f504-5c18-4b48-84e6-fe9b31dbc79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:01.806944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc6765-8407-4974-827b-15d632bb1bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:01.807731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc6765-8407-4974-827b-15d632bb1bba None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.808004 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc6765-8407-4974-827b-15d632bb1bba None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.808272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc6765-8407-4974-827b-15d632bb1bba None admin] PATH_INFO: `/v3/users/glance` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.816828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc6765-8407-4974-827b-15d632bb1bba None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:01.818314 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc6765-8407-4974-827b-15d632bb1bba None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:01.832650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-dedc6765-8407-4974-827b-15d632bb1bba None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 07:16:01.832650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:01.832650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:01.832650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:01.832650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:01.832650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:01.832650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:01.832650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:01.832650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:01.832650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:01.832650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:01.832650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:01.832650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:01.832650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:01.832650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:01.832650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:01.833642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:01.834590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:01.834590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:01.834590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:01.834590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:01.834590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:01.834590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:01.834590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:01.834590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:01.834590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 07:16:01.834590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:01.834590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 296/575] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:16:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:01.835177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc6765-8407-4974-827b-15d632bb1bba None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:01.874157 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 280/576] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:16:01.875256 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56f504-5c18-4b48-84e6-fe9b31dbc79c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:01.935045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc6765-8407-4974-827b-15d632bb1bba None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:01.969897 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06666f9-0dc9-44d0-8c5e-60570f40e91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:01.970685 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06666f9-0dc9-44d0-8c5e-60570f40e91d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.970966 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06666f9-0dc9-44d0-8c5e-60570f40e91d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.971238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06666f9-0dc9-44d0-8c5e-60570f40e91d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.972086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56f504-5c18-4b48-84e6-fe9b31dbc79c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:01.977763 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06666f9-0dc9-44d0-8c5e-60570f40e91d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:01.979209 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06666f9-0dc9-44d0-8c5e-60570f40e91d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:01.981057 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:02.014656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-b06666f9-0dc9-44d0-8c5e-60570f40e91d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:02.014656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:02.014656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:02.014656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:02.014656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:02.014656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:02.014656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:02.014656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:02.014656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:02.014656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:02.014656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:02.014656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:02.014656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:02.014656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:02.014656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:02.015697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:02.015697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:02.015697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:02.015697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:02.015697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:02.015697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:02.015697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:02.015697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:02.015697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:02.015697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:02.015697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:02.015697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:02.015697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:02.015697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:02.015697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:02.015697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:02.015697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:02.016574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:02.016574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:02.016574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:02.016574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:02.016574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:02.016574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:02.016574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:02.016574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:02.016574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 297/577] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:02.016574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06666f9-0dc9-44d0-8c5e-60570f40e91d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:02.017119 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb248f4e-c4a8-4bae-a5e7-6407f9ec7a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:02.017119 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb248f4e-c4a8-4bae-a5e7-6407f9ec7a82 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:02.017119 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb248f4e-c4a8-4bae-a5e7-6407f9ec7a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:02.017119 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb248f4e-c4a8-4bae-a5e7-6407f9ec7a82 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:02.017434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb248f4e-c4a8-4bae-a5e7-6407f9ec7a82 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:02.017434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb248f4e-c4a8-4bae-a5e7-6407f9ec7a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:02.017434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb248f4e-c4a8-4bae-a5e7-6407f9ec7a82 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:02.021313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 281/578] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:16:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:02.022111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb248f4e-c4a8-4bae-a5e7-6407f9ec7a82 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:02.031039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:02.100089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06666f9-0dc9-44d0-8c5e-60570f40e91d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:02.122188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb248f4e-c4a8-4bae-a5e7-6407f9ec7a82 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:02.133991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42a621-53af-4bf5-b271-ee7cabb2be57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:02.134662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42a621-53af-4bf5-b271-ee7cabb2be57 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:02.134941 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42a621-53af-4bf5-b271-ee7cabb2be57 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:02.135212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42a621-53af-4bf5-b271-ee7cabb2be57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:02.136077 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42a621-53af-4bf5-b271-ee7cabb2be57 None admin] RBAC: Adding query filter params (role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=a18b07c033224d2085773936dad33eec) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:02.136425 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42a621-53af-4bf5-b271-ee7cabb2be57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:02.138000 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42a621-53af-4bf5-b271-ee7cabb2be57 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:02.144311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 298/579] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:16:01 2022] GET /identity/v3/role_assignments?user.id=a18b07c033224d2085773936dad33eec&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:02.145072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42a621-53af-4bf5-b271-ee7cabb2be57 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:02.204527 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fedbd6-96c9-4f89-abb6-dc2a04e8fb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:02.206113 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fedbd6-96c9-4f89-abb6-dc2a04e8fb7c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:02.206394 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fedbd6-96c9-4f89-abb6-dc2a04e8fb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:02.206669 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fedbd6-96c9-4f89-abb6-dc2a04e8fb7c None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:02.207527 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fedbd6-96c9-4f89-abb6-dc2a04e8fb7c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:02.207835 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fedbd6-96c9-4f89-abb6-dc2a04e8fb7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:02.209288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fedbd6-96c9-4f89-abb6-dc2a04e8fb7c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:02.229494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 282/580] 10.222.0.52 () {56 vars in 1137 bytes} [Fri Jun 17 07:16:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:02.230370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fedbd6-96c9-4f89-abb6-dc2a04e8fb7c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:02.264853 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:02.278395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:02.284924 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42a621-53af-4bf5-b271-ee7cabb2be57 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:02.322449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1bf5d-e015-4d55-9d7b-40ac8f9207bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:02.323260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1bf5d-e015-4d55-9d7b-40ac8f9207bc None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:02.323542 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1bf5d-e015-4d55-9d7b-40ac8f9207bc None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:02.323817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1bf5d-e015-4d55-9d7b-40ac8f9207bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:02.335757 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1bf5d-e015-4d55-9d7b-40ac8f9207bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:02.344451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-9ba1bf5d-e015-4d55-9d7b-40ac8f9207bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:02.344451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:02.344451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:02.344451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:02.344451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:02.344451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:02.344451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:02.344451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:02.344451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:02.344451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:02.344451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:02.344451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:02.344451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:02.344451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:02.344451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:02.344451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:02.345423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:02.345423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:02.345423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:02.345423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:02.345423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:02.345423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:02.345423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:02.345423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:02.345423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:02.345423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:02.345423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:02.345423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:02.345423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:02.345423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:02.345423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:02.345423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:02.346262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:02.346262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:02.346262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:02.346262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:02.346262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:02.346262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:02.346262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:02.346262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:02.346262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:02.346262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:02.346262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:02.346262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:02.346262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 299/581] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:16:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:02.347061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1bf5d-e015-4d55-9d7b-40ac8f9207bc None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:02.356323 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fedbd6-96c9-4f89-abb6-dc2a04e8fb7c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:02.394413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37482858-3807-42f1-a121-4be73a66354a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:02.395074 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37482858-3807-42f1-a121-4be73a66354a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:02.395354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37482858-3807-42f1-a121-4be73a66354a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:02.395625 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37482858-3807-42f1-a121-4be73a66354a None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:02.396408 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37482858-3807-42f1-a121-4be73a66354a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:02.396713 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37482858-3807-42f1-a121-4be73a66354a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:02.398169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37482858-3807-42f1-a121-4be73a66354a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:02.414865 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 283/582] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:02.414865 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37482858-3807-42f1-a121-4be73a66354a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:02.459245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1bf5d-e015-4d55-9d7b-40ac8f9207bc None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:02.494955 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96123e63-691d-4290-83b8-01a98eeb3bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:02.495842 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96123e63-691d-4290-83b8-01a98eeb3bbf None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:02.496131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96123e63-691d-4290-83b8-01a98eeb3bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:02.496405 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96123e63-691d-4290-83b8-01a98eeb3bbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:02.507314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:02.508835 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96123e63-691d-4290-83b8-01a98eeb3bbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:02.510277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96123e63-691d-4290-83b8-01a98eeb3bbf None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:02.522932 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37482858-3807-42f1-a121-4be73a66354a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:02.528477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-96123e63-691d-4290-83b8-01a98eeb3bbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:02.528477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:02.528477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:02.528477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:02.528477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:02.528477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:02.528477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:02.528477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:02.528477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:02.528477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:02.528477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:02.528477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:02.528477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:02.528477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:02.528477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:02.530115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:02.530115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:02.530115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:02.530115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:02.530115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:02.530115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:02.530115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:02.530115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:02.530115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:02.530115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:02.530115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:02.530115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:02.530115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:02.530115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:02.530115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:02.530115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:02.530115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:02.531091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:02.531091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:02.531091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:02.531091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:02.532268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 300/583] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:02.533293 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96123e63-691d-4290-83b8-01a98eeb3bbf None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:02.545702 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:02.560436 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ba7b7-05ed-4cc7-8aa7-0d2b67cce751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:02.561317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ba7b7-05ed-4cc7-8aa7-0d2b67cce751 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:02.561722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ba7b7-05ed-4cc7-8aa7-0d2b67cce751 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:02.561998 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ba7b7-05ed-4cc7-8aa7-0d2b67cce751 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:02.572943 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ba7b7-05ed-4cc7-8aa7-0d2b67cce751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:02.574410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ba7b7-05ed-4cc7-8aa7-0d2b67cce751 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:02.593269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d86ba7b7-05ed-4cc7-8aa7-0d2b67cce751 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:02.593269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:02.593269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:02.593269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:02.593269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:02.593269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:02.593269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:02.593269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:02.593269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:02.593269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:02.593269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:02.593269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:02.593269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:02.593269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:02.593269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:02.594234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:02.594234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:02.594234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:02.594234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:02.594234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:02.594234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:02.594234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:02.594234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:02.594234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:02.594234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:02.594234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:02.594234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:02.594234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:02.594234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:02.594234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:02.594234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:02.594234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:02.595114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:02.595114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:02.595114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:02.595114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:02.595114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 284/584] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:02.595395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ba7b7-05ed-4cc7-8aa7-0d2b67cce751 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:02.640798 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96123e63-691d-4290-83b8-01a98eeb3bbf None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:02.680632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c63a4-fde8-451f-9551-bec261edef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:02.681302 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c63a4-fde8-451f-9551-bec261edef81 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:02.681626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c63a4-fde8-451f-9551-bec261edef81 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:02.681900 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c63a4-fde8-451f-9551-bec261edef81 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:02.682650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c63a4-fde8-451f-9551-bec261edef81 None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:02.683274 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c63a4-fde8-451f-9551-bec261edef81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:02.684311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c63a4-fde8-451f-9551-bec261edef81 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:02.693665 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 301/585] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:16:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:02.694391 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c63a4-fde8-451f-9551-bec261edef81 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:02.720174 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ba7b7-05ed-4cc7-8aa7-0d2b67cce751 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:02.756390 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33129db-2a31-47ee-92ed-b2f967c61ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:02.757635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33129db-2a31-47ee-92ed-b2f967c61ea9 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:02.757917 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33129db-2a31-47ee-92ed-b2f967c61ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:02.758194 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33129db-2a31-47ee-92ed-b2f967c61ea9 None admin] PATH_INFO: `/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/88e1572d22c048b09699a2fe50900f92/roles/b2b4f9b1ccfc4e63b260aa4d8c230bf6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:02.767991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:02.769891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:02.773799 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33129db-2a31-47ee-92ed-b2f967c61ea9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dffdba97abf4f59b12c4fbdc6245e9e, user_id=88e1572d22c048b09699a2fe50900f92, role_id=b2b4f9b1ccfc4e63b260aa4d8c230bf6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:02.775199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33129db-2a31-47ee-92ed-b2f967c61ea9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:02.800126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c63a4-fde8-451f-9551-bec261edef81 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:02.835305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1a3d4-0ae2-46f0-a1d5-55cee43cb0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:02.835957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1a3d4-0ae2-46f0-a1d5-55cee43cb0db None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:02.836228 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1a3d4-0ae2-46f0-a1d5-55cee43cb0db None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:02.836501 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1a3d4-0ae2-46f0-a1d5-55cee43cb0db None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:02.837215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1a3d4-0ae2-46f0-a1d5-55cee43cb0db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:02.837548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1a3d4-0ae2-46f0-a1d5-55cee43cb0db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:02.838911 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1a3d4-0ae2-46f0-a1d5-55cee43cb0db None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:02.851385 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 302/586] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:02.852172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1a3d4-0ae2-46f0-a1d5-55cee43cb0db None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:02.864308 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 285/587] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:16:02 2022] PUT /identity/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/88e1572d22c048b09699a2fe50900f92/roles/b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:16:02.865544 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33129db-2a31-47ee-92ed-b2f967c61ea9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:02.983819 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33129db-2a31-47ee-92ed-b2f967c61ea9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:02.996764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1a3d4-0ae2-46f0-a1d5-55cee43cb0db None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:03.036611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d2d41-89f8-4ee2-9754-da5c705c87f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:03.036611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d2d41-89f8-4ee2-9754-da5c705c87f1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:03.036864 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d2d41-89f8-4ee2-9754-da5c705c87f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:03.037094 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d2d41-89f8-4ee2-9754-da5c705c87f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:03.043930 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:03.050601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436056fc-ae70-4225-a254-68824cbbfc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:03.051273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436056fc-ae70-4225-a254-68824cbbfc70 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:03.051552 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436056fc-ae70-4225-a254-68824cbbfc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:03.051652 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d2d41-89f8-4ee2-9754-da5c705c87f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:03.051827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436056fc-ae70-4225-a254-68824cbbfc70 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:03.052545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436056fc-ae70-4225-a254-68824cbbfc70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:03.052847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436056fc-ae70-4225-a254-68824cbbfc70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:03.053116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d2d41-89f8-4ee2-9754-da5c705c87f1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:03.054276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436056fc-ae70-4225-a254-68824cbbfc70 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:03.066884 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 303/588] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:03.067727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436056fc-ae70-4225-a254-68824cbbfc70 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:03.073391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-186d2d41-89f8-4ee2-9754-da5c705c87f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:03.073391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:03.073391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:03.073391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:03.073391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:03.073391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:03.073391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:03.073391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:03.073391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:03.073391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:03.073391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:03.073391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:03.073391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:03.073391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:03.073391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:03.074254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:03.074254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:03.074254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:03.074254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:03.074254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:03.074254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:03.074254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:03.074254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:03.074254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:03.074254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:03.074254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:03.074254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:03.074254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:03.074254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:03.074254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:03.074254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:03.074254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:03.075153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:03.075153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:03.075153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:03.075153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:03.075153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 286/589] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:03.075831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d2d41-89f8-4ee2-9754-da5c705c87f1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:03.130144 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:03.200505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436056fc-ae70-4225-a254-68824cbbfc70 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:03.201148 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d2d41-89f8-4ee2-9754-da5c705c87f1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:03.240790 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e08ba-1f72-4fb7-9459-ad79370d825b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:03.241195 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3664a-87d3-4983-9a56-b6070d216fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:03.241611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e08ba-1f72-4fb7-9459-ad79370d825b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:03.241892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e08ba-1f72-4fb7-9459-ad79370d825b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:03.242165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e08ba-1f72-4fb7-9459-ad79370d825b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:03.242867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3664a-87d3-4983-9a56-b6070d216fed None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:03.243337 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3664a-87d3-4983-9a56-b6070d216fed None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:03.243798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3664a-87d3-4983-9a56-b6070d216fed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:03.250544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e08ba-1f72-4fb7-9459-ad79370d825b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:03.251605 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3664a-87d3-4983-9a56-b6070d216fed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:03.251990 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e08ba-1f72-4fb7-9459-ad79370d825b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:03.253532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3664a-87d3-4983-9a56-b6070d216fed None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:03.267259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-b32e08ba-1f72-4fb7-9459-ad79370d825b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 07:16:03.267259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:03.267259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:03.267259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:03.267259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:03.267259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:03.267259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:03.267259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:03.267259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:03.267259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:03.267259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:03.267259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:03.267259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:03.267259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:03.267259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:03.267259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:03.268327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:03.269279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:03.269279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:03.269279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:03.269279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:03.269279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:03.269279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:03.269279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:03.269279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:03.269279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 07:16:03.269279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:03.271571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-7fa3664a-87d3-4983-9a56-b6070d216fed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:03.271571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:03.271571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:03.271571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:03.271571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:03.271571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:03.271571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:03.271571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:03.271571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:03.271571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:03.271571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:03.271571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:03.271571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:03.271571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:03.271571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:03.272626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:03.272626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:03.272626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:03.272626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:03.272626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:03.272626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:03.272626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:03.272626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:03.272626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:03.272626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:03.272626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:03.272626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:03.272626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:03.272626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:03.272626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:03.272626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:03.272626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:03.273707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:03.273707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:03.273707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:03.273707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:03.273707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:03.273707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:03.273707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:03.273707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:03.280891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 304/591] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:16:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:03.280891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e08ba-1f72-4fb7-9459-ad79370d825b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:03.281207 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 287/591] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:03.282262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3664a-87d3-4983-9a56-b6070d216fed None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:03.335282 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:03.387545 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3664a-87d3-4983-9a56-b6070d216fed None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:03.389782 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:03.391933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e08ba-1f72-4fb7-9459-ad79370d825b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:03.429622 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0cff8-4863-467b-84a2-0e6702303402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:03.430206 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0cff8-4863-467b-84a2-0e6702303402 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:03.430488 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0cff8-4863-467b-84a2-0e6702303402 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:03.430821 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0cff8-4863-467b-84a2-0e6702303402 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:03.431611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0cff8-4863-467b-84a2-0e6702303402 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:03.431971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0cff8-4863-467b-84a2-0e6702303402 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:03.433559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0cff8-4863-467b-84a2-0e6702303402 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:03.439674 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e02e4-f8e3-42ec-a2e6-69127de53d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:03.440700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e02e4-f8e3-42ec-a2e6-69127de53d83 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:03.441598 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e02e4-f8e3-42ec-a2e6-69127de53d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:03.441895 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e02e4-f8e3-42ec-a2e6-69127de53d83 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:03.442632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e02e4-f8e3-42ec-a2e6-69127de53d83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:03.442941 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e02e4-f8e3-42ec-a2e6-69127de53d83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:03.444311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e02e4-f8e3-42ec-a2e6-69127de53d83 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:03.450946 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 288/592] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:03.452194 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0cff8-4863-467b-84a2-0e6702303402 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:03.465456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 305/593] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:03.465954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e02e4-f8e3-42ec-a2e6-69127de53d83 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:03.583005 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e02e4-f8e3-42ec-a2e6-69127de53d83 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:03.583705 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0cff8-4863-467b-84a2-0e6702303402 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:03.596713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:03.627127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295e3c7-04d6-46b3-8782-ef563fb1bf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:03.628028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295e3c7-04d6-46b3-8782-ef563fb1bf58 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:03.628337 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295e3c7-04d6-46b3-8782-ef563fb1bf58 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:03.628677 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295e3c7-04d6-46b3-8782-ef563fb1bf58 None admin] PATH_INFO: `/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/bde4369f695745c199ce6c10d241b841/roles/b2b4f9b1ccfc4e63b260aa4d8c230bf6` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:03.630378 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696821d-4978-46f8-9805-87b76f41924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:03.631283 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696821d-4978-46f8-9805-87b76f41924b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:03.631981 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696821d-4978-46f8-9805-87b76f41924b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:03.633995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696821d-4978-46f8-9805-87b76f41924b None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:03.635109 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696821d-4978-46f8-9805-87b76f41924b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:03.635645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696821d-4978-46f8-9805-87b76f41924b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:03.637290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696821d-4978-46f8-9805-87b76f41924b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:03.647094 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295e3c7-04d6-46b3-8782-ef563fb1bf58 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dffdba97abf4f59b12c4fbdc6245e9e, user_id=bde4369f695745c199ce6c10d241b841, role_id=b2b4f9b1ccfc4e63b260aa4d8c230bf6)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:03.648631 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295e3c7-04d6-46b3-8782-ef563fb1bf58 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:03.662075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 289/594] 10.222.0.52 () {56 vars in 1137 bytes} [Fri Jun 17 07:16:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:03.664692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696821d-4978-46f8-9805-87b76f41924b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:03.691749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:03.729676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 306/595] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:16:03 2022] PUT /identity/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/bde4369f695745c199ce6c10d241b841/roles/b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:16:03.730982 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295e3c7-04d6-46b3-8782-ef563fb1bf58 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:03.777627 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696821d-4978-46f8-9805-87b76f41924b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:03.825448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aec3ed-f3d6-46f9-9673-692c4d82799f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:03.828445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aec3ed-f3d6-46f9-9673-692c4d82799f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:03.828804 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aec3ed-f3d6-46f9-9673-692c4d82799f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:03.829145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aec3ed-f3d6-46f9-9673-692c4d82799f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:03.849152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aec3ed-f3d6-46f9-9673-692c4d82799f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:03.850674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aec3ed-f3d6-46f9-9673-692c4d82799f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:03.883837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-63aec3ed-f3d6-46f9-9673-692c4d82799f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 07:16:03.883837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:03.883837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:03.883837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:03.883837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:03.883837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:03.883837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:03.883837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:03.883837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:03.883837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:03.883837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:03.883837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:03.883837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:03.883837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:03.883837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:03.883837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:03.884898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:03.885874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:03.885874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:03.885874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:03.885874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:03.885874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:03.885874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:03.885874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:03.885874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:03.885874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 07:16:03.885874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:03.885874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 290/596] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:16:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:03.893719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aec3ed-f3d6-46f9-9673-692c4d82799f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:03.929265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295e3c7-04d6-46b3-8782-ef563fb1bf58 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:03.968493 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc85cc-5952-44b0-aff1-bec2cd1f874e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:03.969304 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc85cc-5952-44b0-aff1-bec2cd1f874e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:03.969614 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc85cc-5952-44b0-aff1-bec2cd1f874e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:03.969892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc85cc-5952-44b0-aff1-bec2cd1f874e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:03.980438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc85cc-5952-44b0-aff1-bec2cd1f874e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:03.981964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc85cc-5952-44b0-aff1-bec2cd1f874e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:04.008810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-73fc85cc-5952-44b0-aff1-bec2cd1f874e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:04.008810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:04.008810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:04.008810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:04.008810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:04.008810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:04.008810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:04.008810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:04.008810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:04.008810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:04.008810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:04.008810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:04.008810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:04.008810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:04.008810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:04.009820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:04.009820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:04.009820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:04.009820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:04.009820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:04.009820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:04.009820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:04.009820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:04.009820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:04.009820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:04.009820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:04.009820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:04.009820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:04.009820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:04.009820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:04.009820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:04.009820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:04.010715 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:04.010715 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:04.010715 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:04.010715 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:04.010715 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 307/597] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:04.015753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc85cc-5952-44b0-aff1-bec2cd1f874e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:04.040289 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:04.076916 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:04.083690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aec3ed-f3d6-46f9-9673-692c4d82799f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:04.124494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537fcd2-620e-4ba4-bbce-1da5a56a6fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:04.125195 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537fcd2-620e-4ba4-bbce-1da5a56a6fab None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:04.126372 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537fcd2-620e-4ba4-bbce-1da5a56a6fab None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:04.126664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537fcd2-620e-4ba4-bbce-1da5a56a6fab None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:04.128233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537fcd2-620e-4ba4-bbce-1da5a56a6fab None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:04.130345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537fcd2-620e-4ba4-bbce-1da5a56a6fab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:04.131965 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537fcd2-620e-4ba4-bbce-1da5a56a6fab None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:04.313174 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 291/598] 10.222.0.52 () {56 vars in 1139 bytes} [Fri Jun 17 07:16:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:04.329441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537fcd2-620e-4ba4-bbce-1da5a56a6fab None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:04.353563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc85cc-5952-44b0-aff1-bec2cd1f874e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:04.393582 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f052582-516a-48fb-87e2-b7b03e51c3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:04.394169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f052582-516a-48fb-87e2-b7b03e51c3fc None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:04.394451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f052582-516a-48fb-87e2-b7b03e51c3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:04.394728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f052582-516a-48fb-87e2-b7b03e51c3fc None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:04.395615 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f052582-516a-48fb-87e2-b7b03e51c3fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:04.395925 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f052582-516a-48fb-87e2-b7b03e51c3fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:04.397363 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f052582-516a-48fb-87e2-b7b03e51c3fc None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:04.410970 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 308/599] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:04.416652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0281b-8711-4c57-a3ca-7b767be0011a None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:04.417040 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0281b-8711-4c57-a3ca-7b767be0011a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:04.417348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0281b-8711-4c57-a3ca-7b767be0011a None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:04.418986 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 309/600] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:04.419846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0281b-8711-4c57-a3ca-7b767be0011a None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:04.446914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537fcd2-620e-4ba4-bbce-1da5a56a6fab None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:04.483607 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bfc98-d631-4999-8bb0-5af79eff3882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:04.484551 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bfc98-d631-4999-8bb0-5af79eff3882 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:04.484830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bfc98-d631-4999-8bb0-5af79eff3882 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:04.485105 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bfc98-d631-4999-8bb0-5af79eff3882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:04.498362 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:04.503644 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bfc98-d631-4999-8bb0-5af79eff3882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:04.505374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bfc98-d631-4999-8bb0-5af79eff3882 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:04.515965 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:04.529756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-7f0bfc98-d631-4999-8bb0-5af79eff3882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:04.529756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:04.529756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:04.529756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:04.529756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:04.529756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:04.529756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:04.529756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:04.529756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:04.529756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:04.529756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:04.529756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:04.529756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:04.529756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:04.529756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:04.530744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:04.530744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:04.530744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:04.530744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:04.530744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:04.530744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:04.530744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:04.530744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:04.530744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:04.530744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:04.530744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:04.530744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:04.530744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:04.530744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:04.530744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:04.530744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:04.530744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:04.531700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:04.531700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:04.531700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:04.531700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:04.534882 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 292/601] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:04.537102 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180219a-8641-48c7-a2d9-4e36817a16c9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:04.537416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180219a-8641-48c7-a2d9-4e36817a16c9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:04.537733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180219a-8641-48c7-a2d9-4e36817a16c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:04.554445 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0281b-8711-4c57-a3ca-7b767be0011a None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:04.558361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7180219a-8641-48c7-a2d9-4e36817a16c9 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:04.559563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7180219a-8641-48c7-a2d9-4e36817a16c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:04.594315 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a284a9-18c2-43cd-b292-7f50c7eeee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:04.595542 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a284a9-18c2-43cd-b292-7f50c7eeee60 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:04.595833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a284a9-18c2-43cd-b292-7f50c7eeee60 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:04.596115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a284a9-18c2-43cd-b292-7f50c7eeee60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:04.605488 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a284a9-18c2-43cd-b292-7f50c7eeee60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:04.606954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a284a9-18c2-43cd-b292-7f50c7eeee60 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:04.625626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-b4a284a9-18c2-43cd-b292-7f50c7eeee60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:04.625626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:04.625626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:04.625626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:04.625626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:04.625626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:04.625626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:04.625626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:04.625626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:04.625626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:04.625626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:04.625626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:04.625626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:04.625626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:04.625626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:04.626628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:04.626628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:04.626628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:04.626628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:04.626628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:04.626628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:04.626628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:04.626628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:04.626628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:04.626628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:04.626628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:04.626628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:04.626628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:04.626628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:04.626628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:04.626628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:04.626628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:04.627515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:04.627515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:04.627515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:04.627515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:04.627515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:04.627515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:04.627515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:04.627515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:04.630102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 310/602] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:04.631182 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a284a9-18c2-43cd-b292-7f50c7eeee60 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:04.649421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 293/603] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:16:04.649421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180219a-8641-48c7-a2d9-4e36817a16c9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:04.757616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180219a-8641-48c7-a2d9-4e36817a16c9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:04.764507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a284a9-18c2-43cd-b292-7f50c7eeee60 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:04.779594 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:04.795205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b537ff-33b1-4510-84a9-423ff433cc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:04.806719 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:04.806843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b537ff-33b1-4510-84a9-423ff433cc0c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:04.806843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b537ff-33b1-4510-84a9-423ff433cc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:04.806843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b537ff-33b1-4510-84a9-423ff433cc0c None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:04.806843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b537ff-33b1-4510-84a9-423ff433cc0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:04.806843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b537ff-33b1-4510-84a9-423ff433cc0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:04.806843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b537ff-33b1-4510-84a9-423ff433cc0c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:04.807260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210ba46-7ddc-41a8-87ce-b04ee670e9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:04.807260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210ba46-7ddc-41a8-87ce-b04ee670e9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:04.807260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210ba46-7ddc-41a8-87ce-b04ee670e9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:04.807260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210ba46-7ddc-41a8-87ce-b04ee670e9d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:04.807537 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210ba46-7ddc-41a8-87ce-b04ee670e9d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:04.807537 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210ba46-7ddc-41a8-87ce-b04ee670e9d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:04.807537 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210ba46-7ddc-41a8-87ce-b04ee670e9d4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:04.813787 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 294/604] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:04.814982 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b537ff-33b1-4510-84a9-423ff433cc0c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:04.817587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 311/605] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:04.822765 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210ba46-7ddc-41a8-87ce-b04ee670e9d4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:04.933259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b537ff-33b1-4510-84a9-423ff433cc0c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:04.946220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210ba46-7ddc-41a8-87ce-b04ee670e9d4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:04.971143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fa3a8-029b-4c49-b283-e8d438e84d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:04.972810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fa3a8-029b-4c49-b283-e8d438e84d99 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:04.973352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fa3a8-029b-4c49-b283-e8d438e84d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:04.973796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fa3a8-029b-4c49-b283-e8d438e84d99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:04.983038 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f4188-7400-4949-b04f-5e8a65eca533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:04.984138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f4188-7400-4949-b04f-5e8a65eca533 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:04.984415 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f4188-7400-4949-b04f-5e8a65eca533 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:04.984791 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f4188-7400-4949-b04f-5e8a65eca533 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:04.987760 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fa3a8-029b-4c49-b283-e8d438e84d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:04.992378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f4188-7400-4949-b04f-5e8a65eca533 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:04.994035 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f4188-7400-4949-b04f-5e8a65eca533 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:04.997342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e69fa3a8-029b-4c49-b283-e8d438e84d99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:04.997342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:04.997342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:04.997342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:04.997342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:04.997342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:04.997342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:04.997342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:04.997342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:04.997342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:04.997342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:04.997342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:04.997342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:04.997342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:04.997342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:04.997342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:04.999034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:04.999034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:04.999034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:04.999034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:04.999034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:04.999034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:04.999034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:04.999034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:04.999034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:04.999034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:04.999034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:04.999034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:04.999034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:04.999034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:04.999034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:04.999034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:05.000013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:05.000013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:05.000013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:05.000013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:05.000013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:05.000013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:05.000013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:05.000013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:05.000013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:05.000013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:05.000013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:05.000013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:05.002467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 295/606] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:16:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:05.003405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fa3a8-029b-4c49-b283-e8d438e84d99 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:05.018486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-738f4188-7400-4949-b04f-5e8a65eca533 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:05.018486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:05.018486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:05.018486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:05.018486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:05.018486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:05.018486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:05.018486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:05.018486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:05.018486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:05.018486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:05.018486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:05.018486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:05.018486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:05.018486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:05.019611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:05.019611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:05.019611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:05.019611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:05.019611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:05.019611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:05.019611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:05.019611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:05.019611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:05.019611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:05.019611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:05.019611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:05.019611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:05.019611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:05.019611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:05.019611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:05.019611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:05.020721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:05.020721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:05.020721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:05.020721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:05.020721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:05.020721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:05.020721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:05.020721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:05.022578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 312/607] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:05.023557 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f4188-7400-4949-b04f-5e8a65eca533 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:05.063146 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:05.084953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:05.135193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f4188-7400-4949-b04f-5e8a65eca533 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:05.147178 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fa3a8-029b-4c49-b283-e8d438e84d99 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:05.183647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81f5ed-7723-4ee3-958c-279369817c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:05.184303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81f5ed-7723-4ee3-958c-279369817c4f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:05.184587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81f5ed-7723-4ee3-958c-279369817c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:05.184865 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81f5ed-7723-4ee3-958c-279369817c4f None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:05.185777 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81f5ed-7723-4ee3-958c-279369817c4f None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:05.186136 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81f5ed-7723-4ee3-958c-279369817c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:05.186952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7deed1-0b90-4bed-b6d2-b58a5b3b2a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:05.187626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81f5ed-7723-4ee3-958c-279369817c4f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:05.188280 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7deed1-0b90-4bed-b6d2-b58a5b3b2a98 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:05.188758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7deed1-0b90-4bed-b6d2-b58a5b3b2a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:05.189255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7deed1-0b90-4bed-b6d2-b58a5b3b2a98 None admin] PATH_INFO: `/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/afefcf9ac054459c9585d8be3c604fc0/roles/b2b4f9b1ccfc4e63b260aa4d8c230bf6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:05.201458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 313/608] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:16:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:05.201458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81f5ed-7723-4ee3-958c-279369817c4f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:05.210324 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7deed1-0b90-4bed-b6d2-b58a5b3b2a98 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dffdba97abf4f59b12c4fbdc6245e9e, user_id=afefcf9ac054459c9585d8be3c604fc0, role_id=b2b4f9b1ccfc4e63b260aa4d8c230bf6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:05.212136 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7deed1-0b90-4bed-b6d2-b58a5b3b2a98 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:05.303939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 296/609] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:16:05 2022] PUT /identity/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/afefcf9ac054459c9585d8be3c604fc0/roles/b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:16:05.305204 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7deed1-0b90-4bed-b6d2-b58a5b3b2a98 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:05.327768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81f5ed-7723-4ee3-958c-279369817c4f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:05.350768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:05.382170 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e25510-dbe7-4a0a-89a5-7650722281ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:05.383898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e25510-dbe7-4a0a-89a5-7650722281ba None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:05.384578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e25510-dbe7-4a0a-89a5-7650722281ba None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:05.385019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e25510-dbe7-4a0a-89a5-7650722281ba None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:05.386734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e25510-dbe7-4a0a-89a5-7650722281ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:05.387371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e25510-dbe7-4a0a-89a5-7650722281ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:05.391178 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e25510-dbe7-4a0a-89a5-7650722281ba None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:05.415584 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 314/610] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:05.415584 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52735e-4d7c-42f4-a864-d7768587fa9e None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:05.415584 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52735e-4d7c-42f4-a864-d7768587fa9e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:05.415584 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52735e-4d7c-42f4-a864-d7768587fa9e None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:05.421405 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 315/611] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:05.422994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52735e-4d7c-42f4-a864-d7768587fa9e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:05.440059 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:05.456208 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7deed1-0b90-4bed-b6d2-b58a5b3b2a98 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:05.517677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e9c50-a2d9-4e9f-915d-dd8e8e0e905f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:05.520427 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e9c50-a2d9-4e9f-915d-dd8e8e0e905f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:05.520427 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e9c50-a2d9-4e9f-915d-dd8e8e0e905f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:05.520427 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e9c50-a2d9-4e9f-915d-dd8e8e0e905f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:05.531653 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e9c50-a2d9-4e9f-915d-dd8e8e0e905f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:05.533111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e9c50-a2d9-4e9f-915d-dd8e8e0e905f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:05.551131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52735e-4d7c-42f4-a864-d7768587fa9e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:05.553460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-1e0e9c50-a2d9-4e9f-915d-dd8e8e0e905f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:05.553460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:05.553460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:05.553460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:05.553460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:05.553460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:05.553460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:05.553460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:05.553460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:05.553460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:05.553460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:05.553460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:05.553460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:05.553460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:05.553460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:05.554570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:05.554570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:05.554570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:05.554570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:05.554570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:05.554570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:05.554570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:05.554570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:05.554570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:05.554570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:05.554570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:05.554570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:05.554570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:05.554570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:05.554570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:05.554570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:05.554570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:05.555529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:05.555529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:05.555529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:05.555529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:05.555529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 297/612] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:05.556217 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716afe5d-c3ba-45ee-b30e-011cf29496e2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:05.556507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716afe5d-c3ba-45ee-b30e-011cf29496e2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:05.556809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716afe5d-c3ba-45ee-b30e-011cf29496e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:05.578840 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-716afe5d-c3ba-45ee-b30e-011cf29496e2 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:05.580265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-716afe5d-c3ba-45ee-b30e-011cf29496e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:05.595369 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67f752-c751-45be-8606-c0c823a12e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:05.596403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67f752-c751-45be-8606-c0c823a12e04 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:05.596834 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67f752-c751-45be-8606-c0c823a12e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:05.597182 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67f752-c751-45be-8606-c0c823a12e04 None admin] PATH_INFO: `/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/ad436c2fecba4754875b7c7cb26852a5/roles/b2b4f9b1ccfc4e63b260aa4d8c230bf6` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:05.615251 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67f752-c751-45be-8606-c0c823a12e04 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dffdba97abf4f59b12c4fbdc6245e9e, user_id=ad436c2fecba4754875b7c7cb26852a5, role_id=b2b4f9b1ccfc4e63b260aa4d8c230bf6)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:05.617551 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67f752-c751-45be-8606-c0c823a12e04 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:05.656958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 298/613] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:16:05.657834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716afe5d-c3ba-45ee-b30e-011cf29496e2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:05.694589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 316/614] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:16:05 2022] PUT /identity/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/ad436c2fecba4754875b7c7cb26852a5/roles/b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:16:05.695982 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67f752-c751-45be-8606-c0c823a12e04 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:05.726757 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:05.743028 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:05.778512 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716afe5d-c3ba-45ee-b30e-011cf29496e2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:05.818671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8149a-b558-499d-973f-5047ef76bb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:05.819963 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8149a-b558-499d-973f-5047ef76bb1a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:05.820247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8149a-b558-499d-973f-5047ef76bb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:05.820534 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8149a-b558-499d-973f-5047ef76bb1a None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:05.821827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8149a-b558-499d-973f-5047ef76bb1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:05.822141 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8149a-b558-499d-973f-5047ef76bb1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:05.823658 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8149a-b558-499d-973f-5047ef76bb1a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:05.825285 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67f752-c751-45be-8606-c0c823a12e04 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:05.842081 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 299/615] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:05.849652 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8149a-b558-499d-973f-5047ef76bb1a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:05.874659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bf754-0b7b-41a1-9f84-831d5e493fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:05.875941 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bf754-0b7b-41a1-9f84-831d5e493fda None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:05.876462 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bf754-0b7b-41a1-9f84-831d5e493fda None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:05.876947 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bf754-0b7b-41a1-9f84-831d5e493fda None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:05.890627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bf754-0b7b-41a1-9f84-831d5e493fda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:05.899666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-ce9bf754-0b7b-41a1-9f84-831d5e493fda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:05.899666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:05.899666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:05.899666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:05.899666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:05.899666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:05.899666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:05.899666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:05.899666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:05.899666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:05.899666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:05.899666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:05.899666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:05.899666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:05.899666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:05.899666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:05.900728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:05.900728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:05.900728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:05.900728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:05.900728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:05.900728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:05.900728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:05.900728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:05.900728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:05.900728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:05.900728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:05.900728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:05.900728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:05.900728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:05.900728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:05.900728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:05.901586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:05.901586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:05.901586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:05.901586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:05.901586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:05.901586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:05.901586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:05.901586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:05.901586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:05.901586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:05.901586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:05.901586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:05.909452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 317/616] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:16:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:05.911445 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bf754-0b7b-41a1-9f84-831d5e493fda None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:06.020822 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:06.025719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8149a-b558-499d-973f-5047ef76bb1a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:06.037355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bf754-0b7b-41a1-9f84-831d5e493fda None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:06.072110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:06.075082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7911d-e67b-4534-bb41-8609b6a0da82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:06.075816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7911d-e67b-4534-bb41-8609b6a0da82 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:06.076872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7911d-e67b-4534-bb41-8609b6a0da82 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:06.077276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7911d-e67b-4534-bb41-8609b6a0da82 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:06.078142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7911d-e67b-4534-bb41-8609b6a0da82 None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:06.078514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7911d-e67b-4534-bb41-8609b6a0da82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:06.080050 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7911d-e67b-4534-bb41-8609b6a0da82 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:06.080639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a9c14-6ec0-4246-96f3-83dadace0cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:06.081938 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a9c14-6ec0-4246-96f3-83dadace0cef None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:06.086851 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a9c14-6ec0-4246-96f3-83dadace0cef None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:06.086851 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a9c14-6ec0-4246-96f3-83dadace0cef None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:06.089505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 318/617] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:16:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:06.090909 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c68f4-a590-4265-bbb7-02af1a2e744f None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:06.091267 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c68f4-a590-4265-bbb7-02af1a2e744f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:06.091666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c68f4-a590-4265-bbb7-02af1a2e744f None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:06.093237 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 319/618] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:06.097357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a9c14-6ec0-4246-96f3-83dadace0cef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:06.097714 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c68f4-a590-4265-bbb7-02af1a2e744f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:06.098997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a9c14-6ec0-4246-96f3-83dadace0cef None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:06.124767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-dc1a9c14-6ec0-4246-96f3-83dadace0cef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:16:06.124767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:06.124767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:06.124767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:06.124767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:06.124767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:06.124767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:06.124767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:06.124767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:06.124767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:06.124767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:06.124767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:06.124767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:06.124767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:06.124767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:06.124767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:06.125931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:06.127048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:06.127048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:06.127048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:06.127048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:06.127048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:06.127048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:06.127048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:06.127048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:06.127048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:16:06.127048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:06.131130 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 300/619] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:16:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:06.133276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11dede-8986-4de1-a5f4-bd3cedd35be8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:06.133716 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11dede-8986-4de1-a5f4-bd3cedd35be8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:06.133997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11dede-8986-4de1-a5f4-bd3cedd35be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:06.157901 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1c11dede-8986-4de1-a5f4-bd3cedd35be8 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:06.159389 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1c11dede-8986-4de1-a5f4-bd3cedd35be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:06.230755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c68f4-a590-4265-bbb7-02af1a2e744f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:06.252059 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 301/620] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:16:06.253486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11dede-8986-4de1-a5f4-bd3cedd35be8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:06.283902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5229b02-d1e7-492d-8028-d79b741b259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:06.284618 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5229b02-d1e7-492d-8028-d79b741b259c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:06.284896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5229b02-d1e7-492d-8028-d79b741b259c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:06.285165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5229b02-d1e7-492d-8028-d79b741b259c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:06.299812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5229b02-d1e7-492d-8028-d79b741b259c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:06.301559 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5229b02-d1e7-492d-8028-d79b741b259c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:06.321696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:06.326599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-f5229b02-d1e7-492d-8028-d79b741b259c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:06.326599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:06.326599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:06.326599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:06.326599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:06.326599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:06.326599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:06.326599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:06.326599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:06.326599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:06.326599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:06.326599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:06.326599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:06.326599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:06.326599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:06.327514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:06.327514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:06.327514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:06.327514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:06.327514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:06.327514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:06.327514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:06.327514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:06.327514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:06.327514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:06.327514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:06.327514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:06.327514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:06.327514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:06.327514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:06.327514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:06.327514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:06.328423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:06.328423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:06.328423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:06.328423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:06.328423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 320/621] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:06.329207 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5229b02-d1e7-492d-8028-d79b741b259c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:06.379416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11dede-8986-4de1-a5f4-bd3cedd35be8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:06.408038 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:06.421438 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c646768-c87c-40e9-af51-f95d76f6d384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:06.422651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c646768-c87c-40e9-af51-f95d76f6d384 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:06.423859 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c646768-c87c-40e9-af51-f95d76f6d384 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:06.424320 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c646768-c87c-40e9-af51-f95d76f6d384 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:06.425353 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c646768-c87c-40e9-af51-f95d76f6d384 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:06.425841 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c646768-c87c-40e9-af51-f95d76f6d384 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:06.427529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c646768-c87c-40e9-af51-f95d76f6d384 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:06.451037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 302/622] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Jun 17 07:16:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:06.452485 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c646768-c87c-40e9-af51-f95d76f6d384 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:06.457931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5229b02-d1e7-492d-8028-d79b741b259c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:06.500191 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db61e97-aec1-4834-99b4-446e9123000c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:06.501018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db61e97-aec1-4834-99b4-446e9123000c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:06.501403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db61e97-aec1-4834-99b4-446e9123000c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:06.501772 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db61e97-aec1-4834-99b4-446e9123000c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:06.515467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db61e97-aec1-4834-99b4-446e9123000c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:06.524438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-2db61e97-aec1-4834-99b4-446e9123000c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:06.524438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:06.524438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:06.524438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:06.524438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:06.524438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:06.524438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:06.524438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:06.524438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:06.524438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:06.524438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:06.524438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:06.524438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:06.524438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:06.524438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:06.524438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:06.525472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:06.525472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:06.525472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:06.525472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:06.525472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:06.525472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:06.525472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:06.525472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:06.525472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:06.525472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:06.525472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:06.525472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:06.525472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:06.525472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:06.525472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:06.525472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:06.526329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:06.526329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:06.526329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:06.526329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:06.526329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:06.526329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:06.526329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:06.526329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:06.526329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:06.526329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:06.526329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:06.526329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:06.527697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 321/623] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:16:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:06.530327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db61e97-aec1-4834-99b4-446e9123000c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:06.587608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c646768-c87c-40e9-af51-f95d76f6d384 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:06.611935 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:06.637606 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed44c1-54df-4063-b0b2-4cd6e0f316a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:06.638282 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed44c1-54df-4063-b0b2-4cd6e0f316a7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:06.638971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed44c1-54df-4063-b0b2-4cd6e0f316a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:06.639820 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed44c1-54df-4063-b0b2-4cd6e0f316a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:06.641034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed44c1-54df-4063-b0b2-4cd6e0f316a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:06.641369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed44c1-54df-4063-b0b2-4cd6e0f316a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:06.643027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed44c1-54df-4063-b0b2-4cd6e0f316a7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:06.667076 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 303/624] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:06.667076 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed44c1-54df-4063-b0b2-4cd6e0f316a7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:06.676358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db61e97-aec1-4834-99b4-446e9123000c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:06.721099 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b978734-2a88-4a7b-b7bf-2fbf597d152a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:06.721947 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b978734-2a88-4a7b-b7bf-2fbf597d152a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:06.722227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b978734-2a88-4a7b-b7bf-2fbf597d152a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:06.722503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b978734-2a88-4a7b-b7bf-2fbf597d152a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:06.726055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:06.735014 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b978734-2a88-4a7b-b7bf-2fbf597d152a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:06.736623 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b978734-2a88-4a7b-b7bf-2fbf597d152a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:06.760632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-0b978734-2a88-4a7b-b7bf-2fbf597d152a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:06.760632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:06.760632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:06.760632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:06.760632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:06.760632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:06.760632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:06.760632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:06.760632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:06.760632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:06.760632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:06.760632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:06.760632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:06.760632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:06.760632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:06.761650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:06.761650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:06.761650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:06.761650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:06.761650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:06.761650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:06.761650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:06.761650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:06.761650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:06.761650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:06.761650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:06.761650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:06.761650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:06.761650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:06.761650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:06.761650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:06.761650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:06.763202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:06.763202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:06.763202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:06.763202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:06.763202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 322/625] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:06.763202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b978734-2a88-4a7b-b7bf-2fbf597d152a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:06.806216 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed44c1-54df-4063-b0b2-4cd6e0f316a7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:06.856638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49acb1-dca7-4fca-9271-b8c2e0fef8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:06.858397 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49acb1-dca7-4fca-9271-b8c2e0fef8ff None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:06.858863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49acb1-dca7-4fca-9271-b8c2e0fef8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:06.859341 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49acb1-dca7-4fca-9271-b8c2e0fef8ff None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:06.861020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49acb1-dca7-4fca-9271-b8c2e0fef8ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:06.861538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49acb1-dca7-4fca-9271-b8c2e0fef8ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:06.863609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49acb1-dca7-4fca-9271-b8c2e0fef8ff None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:06.876183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 304/626] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:16:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:06.877609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49acb1-dca7-4fca-9271-b8c2e0fef8ff None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:06.881534 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b978734-2a88-4a7b-b7bf-2fbf597d152a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:06.894077 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:06.920282 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43a2e6-3ac0-4853-9b7f-b87396d5b332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:06.921480 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43a2e6-3ac0-4853-9b7f-b87396d5b332 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:06.923918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43a2e6-3ac0-4853-9b7f-b87396d5b332 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:06.923918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43a2e6-3ac0-4853-9b7f-b87396d5b332 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:06.939009 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43a2e6-3ac0-4853-9b7f-b87396d5b332 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:06.941202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43a2e6-3ac0-4853-9b7f-b87396d5b332 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:06.961153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-7d43a2e6-3ac0-4853-9b7f-b87396d5b332 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:16:06.961153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:06.961153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:06.961153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:06.961153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:06.961153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:06.961153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:06.961153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:06.961153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:06.961153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:06.961153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:06.961153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:06.961153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:06.961153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:06.961153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:06.961153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:06.962189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:06.963143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:06.963143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:06.963143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:06.963143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:06.963143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:06.963143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:06.963143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:06.963143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:06.963143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:16:06.963143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:06.971138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 323/627] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Jun 17 07:16:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:06.972672 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43a2e6-3ac0-4853-9b7f-b87396d5b332 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:06.999513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49acb1-dca7-4fca-9271-b8c2e0fef8ff None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:07.001225 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:07.042044 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa944b-d697-426f-868e-53268b5fdab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:07.042998 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa944b-d697-426f-868e-53268b5fdab2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:07.043966 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa944b-d697-426f-868e-53268b5fdab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:07.044399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa944b-d697-426f-868e-53268b5fdab2 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:07.045655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa944b-d697-426f-868e-53268b5fdab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:07.046115 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa944b-d697-426f-868e-53268b5fdab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:07.048642 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa944b-d697-426f-868e-53268b5fdab2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:07.065714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 305/628] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:07.066851 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa944b-d697-426f-868e-53268b5fdab2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:07.098823 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43a2e6-3ac0-4853-9b7f-b87396d5b332 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:07.138023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f58eac-1c0d-4e56-ae66-a1d7bf2f3d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:07.139785 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f58eac-1c0d-4e56-ae66-a1d7bf2f3d1a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:07.140173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f58eac-1c0d-4e56-ae66-a1d7bf2f3d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:07.140549 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f58eac-1c0d-4e56-ae66-a1d7bf2f3d1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:07.152719 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f58eac-1c0d-4e56-ae66-a1d7bf2f3d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:07.155213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f58eac-1c0d-4e56-ae66-a1d7bf2f3d1a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:07.174805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-f3f58eac-1c0d-4e56-ae66-a1d7bf2f3d1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:07.174805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:07.174805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:07.174805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:07.174805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:07.174805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:07.174805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:07.174805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:07.174805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:07.174805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:07.174805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:07.174805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:07.174805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:07.174805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:07.174805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:07.175927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:07.175927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:07.175927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:07.175927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:07.175927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:07.175927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:07.175927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:07.175927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:07.175927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:07.175927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:07.175927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:07.175927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:07.175927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:07.175927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:07.175927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:07.175927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:07.175927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:07.177065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:07.177065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:07.177065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:07.177065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:07.178801 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 324/629] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:07.179824 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f58eac-1c0d-4e56-ae66-a1d7bf2f3d1a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:07.200091 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa944b-d697-426f-868e-53268b5fdab2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:07.212639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:07.237940 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be2647-487b-462c-a2d8-4c268a392c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:07.238564 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be2647-487b-462c-a2d8-4c268a392c52 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:07.238843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be2647-487b-462c-a2d8-4c268a392c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:07.239117 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be2647-487b-462c-a2d8-4c268a392c52 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:07.240022 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be2647-487b-462c-a2d8-4c268a392c52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:07.240335 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be2647-487b-462c-a2d8-4c268a392c52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:07.241828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be2647-487b-462c-a2d8-4c268a392c52 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:07.266207 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 306/630] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Jun 17 07:16:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:07.266207 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be2647-487b-462c-a2d8-4c268a392c52 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:07.290882 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:07.326507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f58eac-1c0d-4e56-ae66-a1d7bf2f3d1a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:07.374359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683ae18-9a99-410d-965e-0329ae48a086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:07.375659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683ae18-9a99-410d-965e-0329ae48a086 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:07.376092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683ae18-9a99-410d-965e-0329ae48a086 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:07.376546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683ae18-9a99-410d-965e-0329ae48a086 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:07.377021 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be2647-487b-462c-a2d8-4c268a392c52 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:07.386007 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683ae18-9a99-410d-965e-0329ae48a086 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:07.388211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683ae18-9a99-410d-965e-0329ae48a086 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:07.409601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-1683ae18-9a99-410d-965e-0329ae48a086 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:07.409601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:07.409601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:07.409601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:07.409601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:07.409601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:07.409601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:07.409601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:07.409601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:07.409601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:07.409601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:07.409601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:07.409601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:07.409601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:07.409601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:07.410758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:07.410758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:07.410758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:07.410758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:07.410758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:07.410758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:07.410758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:07.410758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:07.410758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:07.410758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:07.410758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:07.410758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:07.410758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:07.410758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:07.410758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:07.410758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:07.410758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:07.411888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:07.411888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:07.411888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:07.411888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:07.411888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:07.411888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:07.411888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:07.411888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:07.414978 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 325/631] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:07.416079 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683ae18-9a99-410d-965e-0329ae48a086 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:07.424191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fdeae-1da0-4f81-8c64-628017cb277d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:07.425090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fdeae-1da0-4f81-8c64-628017cb277d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:07.425639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fdeae-1da0-4f81-8c64-628017cb277d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:07.426064 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fdeae-1da0-4f81-8c64-628017cb277d None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:07.427522 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fdeae-1da0-4f81-8c64-628017cb277d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:07.427997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fdeae-1da0-4f81-8c64-628017cb277d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:07.430021 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fdeae-1da0-4f81-8c64-628017cb277d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:07.447751 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 307/632] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:07.449235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fdeae-1da0-4f81-8c64-628017cb277d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:07.506671 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:07.526587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683ae18-9a99-410d-965e-0329ae48a086 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:07.559053 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:07.572887 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b1381-139a-4369-9a59-291059491cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:07.573946 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b1381-139a-4369-9a59-291059491cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:07.574714 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b1381-139a-4369-9a59-291059491cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:07.575300 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b1381-139a-4369-9a59-291059491cd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:07.581442 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fdeae-1da0-4f81-8c64-628017cb277d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:07.626376 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f1c6a-6735-4370-bb35-a51311183932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:07.627361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f1c6a-6735-4370-bb35-a51311183932 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:07.627821 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f1c6a-6735-4370-bb35-a51311183932 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:07.628246 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f1c6a-6735-4370-bb35-a51311183932 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:07.629244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f1c6a-6735-4370-bb35-a51311183932 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:07.629764 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f1c6a-6735-4370-bb35-a51311183932 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:07.631920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f1c6a-6735-4370-bb35-a51311183932 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:07.650392 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 308/633] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:07.651536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f1c6a-6735-4370-bb35-a51311183932 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:07.674468 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b1381-139a-4369-9a59-291059491cd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:07.676140 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b1381-139a-4369-9a59-291059491cd2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:07.767648 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:07.787510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f1c6a-6735-4370-bb35-a51311183932 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:07.792251 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 326/634] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:16:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:16:07.792251 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b1381-139a-4369-9a59-291059491cd2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:07.830058 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a495d7-bae6-444d-adbd-e02cb9f80568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:07.830853 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a495d7-bae6-444d-adbd-e02cb9f80568 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:07.831395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a495d7-bae6-444d-adbd-e02cb9f80568 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:07.831395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a495d7-bae6-444d-adbd-e02cb9f80568 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:07.839637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a495d7-bae6-444d-adbd-e02cb9f80568 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:07.841057 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a495d7-bae6-444d-adbd-e02cb9f80568 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:07.844790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:07.857727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-38a495d7-bae6-444d-adbd-e02cb9f80568 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 07:16:07.857727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:07.857727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:07.857727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:07.857727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:07.857727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:07.857727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:07.857727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:07.857727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:07.857727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:07.857727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:07.857727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:07.857727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:07.857727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:07.857727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:07.857727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:07.858724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:07.859666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:07.859666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:07.859666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:07.859666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:07.859666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:07.859666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:07.859666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:07.859666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:07.859666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 07:16:07.859666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:07.859666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 309/635] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:16:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:07.860777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6572a1b-639f-40ed-9333-030d426cd4d8 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:07.860777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6572a1b-639f-40ed-9333-030d426cd4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:07.860777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6572a1b-639f-40ed-9333-030d426cd4d8 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:07.862047 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 310/636] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:07.862611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6572a1b-639f-40ed-9333-030d426cd4d8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:07.907230 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b1381-139a-4369-9a59-291059491cd2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:07.949987 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da759dc-fdcd-43c3-a9a0-78eb8705b6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:07.950949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da759dc-fdcd-43c3-a9a0-78eb8705b6e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:07.951508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da759dc-fdcd-43c3-a9a0-78eb8705b6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:07.951971 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da759dc-fdcd-43c3-a9a0-78eb8705b6e2 None admin] PATH_INFO: `/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/a18b07c033224d2085773936dad33eec/roles/b2b4f9b1ccfc4e63b260aa4d8c230bf6` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:07.971206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da759dc-fdcd-43c3-a9a0-78eb8705b6e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dffdba97abf4f59b12c4fbdc6245e9e, user_id=a18b07c033224d2085773936dad33eec, role_id=b2b4f9b1ccfc4e63b260aa4d8c230bf6)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:07.973637 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da759dc-fdcd-43c3-a9a0-78eb8705b6e2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:07.976302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6572a1b-639f-40ed-9333-030d426cd4d8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:08.010747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bad40-17f2-4bbe-9027-9e553dd5836a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:08.011548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bad40-17f2-4bbe-9027-9e553dd5836a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:08.011831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bad40-17f2-4bbe-9027-9e553dd5836a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:08.012108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bad40-17f2-4bbe-9027-9e553dd5836a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:08.022448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73bad40-17f2-4bbe-9027-9e553dd5836a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:08.023889 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73bad40-17f2-4bbe-9027-9e553dd5836a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:08.040857 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 327/637] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:16:07 2022] PUT /identity/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/a18b07c033224d2085773936dad33eec/roles/b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:16:08.048546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da759dc-fdcd-43c3-a9a0-78eb8705b6e2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:08.048693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e73bad40-17f2-4bbe-9027-9e553dd5836a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:08.048693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:08.048693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:08.048693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:08.048693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:08.048693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:08.048693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:08.048693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:08.048693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:08.048693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:08.048693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:08.048693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:08.048693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:08.048693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:08.048693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:08.049688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:08.049688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:08.049688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:08.049688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:08.049688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:08.049688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:08.049688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:08.049688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:08.049688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:08.049688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:08.049688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:08.049688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:08.049688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:08.049688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:08.049688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:08.049688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:08.049688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:08.050638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:08.050638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:08.050638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:08.050638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:08.050638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 311/638] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:08.050638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b961c3-4f74-4ca9-a4f8-b8aecf01ef30 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:08.050638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b961c3-4f74-4ca9-a4f8-b8aecf01ef30 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:08.050638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b961c3-4f74-4ca9-a4f8-b8aecf01ef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:08.064976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-86b961c3-4f74-4ca9-a4f8-b8aecf01ef30 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:08.066240 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-86b961c3-4f74-4ca9-a4f8-b8aecf01ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:08.094996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:08.122532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:08.144337 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 312/639] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:16:08.146008 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41f0d4-35c0-43d9-bc86-ac9a00f14e1a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:08.146347 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41f0d4-35c0-43d9-bc86-ac9a00f14e1a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:08.146623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41f0d4-35c0-43d9-bc86-ac9a00f14e1a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:08.148038 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 313/640] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:08.148593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41f0d4-35c0-43d9-bc86-ac9a00f14e1a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:08.185790 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da759dc-fdcd-43c3-a9a0-78eb8705b6e2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:08.230140 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18bba8-b383-4185-8807-1cee8675d939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:08.230839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18bba8-b383-4185-8807-1cee8675d939 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:08.231122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18bba8-b383-4185-8807-1cee8675d939 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:08.231400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18bba8-b383-4185-8807-1cee8675d939 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:08.232771 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18bba8-b383-4185-8807-1cee8675d939 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:08.233077 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18bba8-b383-4185-8807-1cee8675d939 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:08.234655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18bba8-b383-4185-8807-1cee8675d939 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:08.258587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 328/641] 10.222.0.52 () {56 vars in 1137 bytes} [Fri Jun 17 07:16:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:08.258587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4509bc4-b633-4f41-b4ef-fbb3b4dd0688 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:08.258587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4509bc4-b633-4f41-b4ef-fbb3b4dd0688 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:08.258587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4509bc4-b633-4f41-b4ef-fbb3b4dd0688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:08.274884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41f0d4-35c0-43d9-bc86-ac9a00f14e1a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:08.277569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c4509bc4-b633-4f41-b4ef-fbb3b4dd0688 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:08.278778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c4509bc4-b633-4f41-b4ef-fbb3b4dd0688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:08.312857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e28713-f57f-469b-93e7-c2f7d349b864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:08.313558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e28713-f57f-469b-93e7-c2f7d349b864 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:08.313839 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e28713-f57f-469b-93e7-c2f7d349b864 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:08.314120 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e28713-f57f-469b-93e7-c2f7d349b864 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:08.314844 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e28713-f57f-469b-93e7-c2f7d349b864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:08.315154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e28713-f57f-469b-93e7-c2f7d349b864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:08.316541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e28713-f57f-469b-93e7-c2f7d349b864 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:08.332935 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 314/642] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:08.332935 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e28713-f57f-469b-93e7-c2f7d349b864 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:08.355569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 329/643] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:16:08.356653 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4509bc4-b633-4f41-b4ef-fbb3b4dd0688 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:08.382470 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:08.386403 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:08.445778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e28713-f57f-469b-93e7-c2f7d349b864 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:08.469816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4509bc4-b633-4f41-b4ef-fbb3b4dd0688 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:08.481732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dfad7-c446-4f72-94db-b01972b6b00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:08.483134 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dfad7-c446-4f72-94db-b01972b6b00b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:08.483417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dfad7-c446-4f72-94db-b01972b6b00b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:08.483687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dfad7-c446-4f72-94db-b01972b6b00b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:08.494678 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463dfad7-c446-4f72-94db-b01972b6b00b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:08.502603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-463dfad7-c446-4f72-94db-b01972b6b00b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:08.502603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:08.502603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:08.502603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:08.502603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:08.502603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:08.502603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:08.502603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:08.502603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:08.502603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:08.502603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:08.502603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:08.502603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:08.502603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:08.502603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:08.502603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:08.503614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:08.503614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:08.503614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:08.503614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:08.503614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:08.503614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:08.503614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:08.503614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:08.503614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:08.503614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:08.503614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:08.503614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:08.503614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:08.503614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:08.503614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:08.503614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:08.505192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:08.505192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:08.505192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:08.505192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:08.505192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:08.505192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:08.505192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:08.505192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:08.505192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:08.505192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:08.505192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:08.505192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:08.505192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 315/644] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:16:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:08.505192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dfad7-c446-4f72-94db-b01972b6b00b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:08.506302 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e75a65-a4cd-40c1-b7de-32d36ed16ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:08.506919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e75a65-a4cd-40c1-b7de-32d36ed16ebc None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:08.507197 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e75a65-a4cd-40c1-b7de-32d36ed16ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:08.507468 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e75a65-a4cd-40c1-b7de-32d36ed16ebc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:08.578431 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e75a65-a4cd-40c1-b7de-32d36ed16ebc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:08.579890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e75a65-a4cd-40c1-b7de-32d36ed16ebc None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:08.603474 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:08.616314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dfad7-c446-4f72-94db-b01972b6b00b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:08.617974 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:08.650628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6dd12-0617-4097-8af3-1943576f1742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:08.651420 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6dd12-0617-4097-8af3-1943576f1742 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:08.651702 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6dd12-0617-4097-8af3-1943576f1742 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:08.651976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6dd12-0617-4097-8af3-1943576f1742 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:08.659936 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6dd12-0617-4097-8af3-1943576f1742 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:08.662452 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6dd12-0617-4097-8af3-1943576f1742 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:08.676848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-14c6dd12-0617-4097-8af3-1943576f1742 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:08.676848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:08.676848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:08.676848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:08.676848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:08.676848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:08.676848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:08.676848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:08.676848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:08.676848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:08.676848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:08.676848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:08.676848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:08.676848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:08.676848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:08.678002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:08.678002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:08.678002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:08.678002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:08.678002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:08.678002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:08.678002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:08.678002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:08.678002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:08.678002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:08.678002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:08.678002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:08.678002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:08.678002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:08.678002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:08.678002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:08.678002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:08.679090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:08.679090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:08.679090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:08.679090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:08.679090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:08.679090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:08.679090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:08.679090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:08.679090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 316/645] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:08.679090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6dd12-0617-4097-8af3-1943576f1742 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:08.696805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 330/646] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:16:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:16:08.697907 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e75a65-a4cd-40c1-b7de-32d36ed16ebc None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:08.795205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6dd12-0617-4097-8af3-1943576f1742 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:08.803596 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e75a65-a4cd-40c1-b7de-32d36ed16ebc None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:08.823949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:08.833070 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3ab14-8644-4b81-a89f-6097ecd6b157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:08.836583 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3ab14-8644-4b81-a89f-6097ecd6b157 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:08.836583 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3ab14-8644-4b81-a89f-6097ecd6b157 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:08.836583 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3ab14-8644-4b81-a89f-6097ecd6b157 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:08.838717 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d23c6f-1c77-42ff-9999-c9ae0f947248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:08.839385 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23c6f-1c77-42ff-9999-c9ae0f947248 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:08.839684 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23c6f-1c77-42ff-9999-c9ae0f947248 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:08.839960 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23c6f-1c77-42ff-9999-c9ae0f947248 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:08.840852 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d23c6f-1c77-42ff-9999-c9ae0f947248 None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:08.841157 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d23c6f-1c77-42ff-9999-c9ae0f947248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:08.842955 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d23c6f-1c77-42ff-9999-c9ae0f947248 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:08.846083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3ab14-8644-4b81-a89f-6097ecd6b157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:08.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9ad3ab14-8644-4b81-a89f-6097ecd6b157 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:08.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:08.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:08.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:08.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:08.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:08.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:08.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:08.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:08.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:08.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:08.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:08.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:08.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:08.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:08.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:08.854843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:08.854843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:08.854843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:08.854843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:08.854843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:08.854843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:08.854843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:08.854843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:08.854843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:08.854843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:08.854843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:08.854843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:08.854843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:08.854843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:08.854843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:08.854843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:08.855715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:08.855715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:08.855715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:08.855715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:08.855715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:08.855715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:08.855715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:08.855715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:08.855715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:08.855715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:08.855715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:08.855715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:08.856359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 331/647] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:16:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:08.856923 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d23c6f-1c77-42ff-9999-c9ae0f947248 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:08.860209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 317/648] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:16:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:08.861541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3ab14-8644-4b81-a89f-6097ecd6b157 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:08.887524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:08.963953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d23c6f-1c77-42ff-9999-c9ae0f947248 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:08.966214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3ab14-8644-4b81-a89f-6097ecd6b157 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:08.999627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a7c7c-a12f-4041-9cc6-68db720021a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:09.000398 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a7c7c-a12f-4041-9cc6-68db720021a4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:09.000725 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a7c7c-a12f-4041-9cc6-68db720021a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:09.001071 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a7c7c-a12f-4041-9cc6-68db720021a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:09.001163 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85df88-9261-4fd5-83c7-1ea77838dead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:09.002012 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a7c7c-a12f-4041-9cc6-68db720021a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:09.002122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85df88-9261-4fd5-83c7-1ea77838dead None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:09.002413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85df88-9261-4fd5-83c7-1ea77838dead None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:09.002501 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a7c7c-a12f-4041-9cc6-68db720021a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:09.002793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85df88-9261-4fd5-83c7-1ea77838dead None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:09.004052 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a7c7c-a12f-4041-9cc6-68db720021a4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:09.015278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85df88-9261-4fd5-83c7-1ea77838dead None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:09.016772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85df88-9261-4fd5-83c7-1ea77838dead None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:09.022015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 332/649] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:09.022015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a7c7c-a12f-4041-9cc6-68db720021a4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:09.040168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-4b85df88-9261-4fd5-83c7-1ea77838dead None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:09.040168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:09.040168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:09.040168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:09.040168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:09.040168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:09.040168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:09.040168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:09.040168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:09.040168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:09.040168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:09.040168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:09.040168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:09.040168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:09.040168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:09.041245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:09.041245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:09.041245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:09.041245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:09.041245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:09.041245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:09.041245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:09.041245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:09.041245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:09.041245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:09.041245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:09.041245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:09.041245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:09.041245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:09.041245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:09.041245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:09.041245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:09.042351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:09.042351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:09.042351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:09.042351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:09.045873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 318/650] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:09.046711 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85df88-9261-4fd5-83c7-1ea77838dead None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:09.069802 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:09.125113 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:09.131820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a7c7c-a12f-4041-9cc6-68db720021a4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:09.152457 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85df88-9261-4fd5-83c7-1ea77838dead None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:09.171390 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5613a6-3be2-4677-8222-e5bfd0b97bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:09.172186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5613a6-3be2-4677-8222-e5bfd0b97bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:09.172463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5613a6-3be2-4677-8222-e5bfd0b97bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:09.172735 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5613a6-3be2-4677-8222-e5bfd0b97bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:09.183012 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5613a6-3be2-4677-8222-e5bfd0b97bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:09.184536 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5613a6-3be2-4677-8222-e5bfd0b97bd9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:09.191709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26ed62-3087-449e-82ea-c879695a44e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:09.192524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26ed62-3087-449e-82ea-c879695a44e5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:09.192870 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26ed62-3087-449e-82ea-c879695a44e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:09.193214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26ed62-3087-449e-82ea-c879695a44e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:09.194182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26ed62-3087-449e-82ea-c879695a44e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:09.194551 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26ed62-3087-449e-82ea-c879695a44e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:09.196055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26ed62-3087-449e-82ea-c879695a44e5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:09.203525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-cb5613a6-3be2-4677-8222-e5bfd0b97bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:09.203525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:09.203525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:09.203525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:09.203525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:09.203525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:09.203525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:09.203525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:09.203525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:09.203525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:09.203525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:09.203525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:09.203525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:09.203525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:09.203525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:09.204953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:09.204953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:09.204953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:09.204953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:09.204953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:09.204953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:09.204953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:09.204953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:09.204953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:09.204953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:09.204953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:09.204953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:09.204953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:09.204953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:09.204953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:09.204953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:09.204953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:09.206051 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:09.206051 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:09.206051 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:09.206051 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:09.206318 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 319/651] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:16:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:09.206920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26ed62-3087-449e-82ea-c879695a44e5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:09.210773 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 333/652] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:09.210773 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5613a6-3be2-4677-8222-e5bfd0b97bd9 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:09.313977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:09.316628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26ed62-3087-449e-82ea-c879695a44e5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:09.320991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5613a6-3be2-4677-8222-e5bfd0b97bd9 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:09.351159 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2492a3-266f-4815-87e4-972c002d375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:09.351847 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2492a3-266f-4815-87e4-972c002d375d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:09.352127 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2492a3-266f-4815-87e4-972c002d375d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:09.352402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2492a3-266f-4815-87e4-972c002d375d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:09.353233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2492a3-266f-4815-87e4-972c002d375d None admin] RBAC: Adding query filter params (role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=88e1572d22c048b09699a2fe50900f92) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:09.353574 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2492a3-266f-4815-87e4-972c002d375d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:09.355017 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2492a3-266f-4815-87e4-972c002d375d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:09.359020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:09.359933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3223a-f158-4280-a885-7f4c3f075e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:09.360966 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3223a-f158-4280-a885-7f4c3f075e99 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:09.361366 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3223a-f158-4280-a885-7f4c3f075e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:09.361744 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3223a-f158-4280-a885-7f4c3f075e99 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:09.369722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 320/653] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:16:09 2022] GET /identity/v3/role_assignments?user.id=88e1572d22c048b09699a2fe50900f92&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:09.369921 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3223a-f158-4280-a885-7f4c3f075e99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:09.369921 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3223a-f158-4280-a885-7f4c3f075e99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:09.379242 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2492a3-266f-4815-87e4-972c002d375d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:09.379395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3223a-f158-4280-a885-7f4c3f075e99 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:09.392797 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 334/654] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:09.393895 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3223a-f158-4280-a885-7f4c3f075e99 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:09.496723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2492a3-266f-4815-87e4-972c002d375d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:09.533392 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3223a-f158-4280-a885-7f4c3f075e99 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:09.546631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c7a6e-9a3c-4fd4-9e2c-600e039bdefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:09.547533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c7a6e-9a3c-4fd4-9e2c-600e039bdefd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:09.547873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c7a6e-9a3c-4fd4-9e2c-600e039bdefd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:09.548224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c7a6e-9a3c-4fd4-9e2c-600e039bdefd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:09.561306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c7a6e-9a3c-4fd4-9e2c-600e039bdefd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:09.562979 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c7a6e-9a3c-4fd4-9e2c-600e039bdefd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:09.571637 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e27c0-c437-4721-a28d-c4cb1ab91011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:09.572328 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e27c0-c437-4721-a28d-c4cb1ab91011 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:09.572675 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e27c0-c437-4721-a28d-c4cb1ab91011 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:09.573017 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e27c0-c437-4721-a28d-c4cb1ab91011 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:09.573896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e27c0-c437-4721-a28d-c4cb1ab91011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:09.575077 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e27c0-c437-4721-a28d-c4cb1ab91011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:09.577149 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e27c0-c437-4721-a28d-c4cb1ab91011 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:09.581796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-635c7a6e-9a3c-4fd4-9e2c-600e039bdefd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:09.581796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:09.581796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:09.581796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:09.581796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:09.581796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:09.581796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:09.581796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:09.581796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:09.581796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:09.581796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:09.581796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:09.581796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:09.581796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:09.581796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:09.582868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:09.582868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:09.582868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:09.582868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:09.582868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:09.582868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:09.582868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:09.582868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:09.582868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:09.582868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:09.582868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:09.582868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:09.582868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:09.582868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:09.582868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:09.582868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:09.582868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:09.583976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:09.583976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:09.583976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:09.583976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:09.587722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 321/655] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:09.588597 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c7a6e-9a3c-4fd4-9e2c-600e039bdefd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:09.594108 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 335/656] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:09.595141 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e27c0-c437-4721-a28d-c4cb1ab91011 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:09.613761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:09.660577 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:09.724307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c7a6e-9a3c-4fd4-9e2c-600e039bdefd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:09.728265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e27c0-c437-4721-a28d-c4cb1ab91011 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:09.759705 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ce33f-e51e-43a5-bea2-dc552e36461e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:09.760461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ce33f-e51e-43a5-bea2-dc552e36461e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:09.760740 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ce33f-e51e-43a5-bea2-dc552e36461e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:09.761011 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ce33f-e51e-43a5-bea2-dc552e36461e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:09.770905 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ce33f-e51e-43a5-bea2-dc552e36461e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:09.772349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ce33f-e51e-43a5-bea2-dc552e36461e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:09.779620 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58081610-1ff6-4ec8-9de2-20d7a5462268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:09.780605 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58081610-1ff6-4ec8-9de2-20d7a5462268 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:09.781092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58081610-1ff6-4ec8-9de2-20d7a5462268 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:09.781602 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58081610-1ff6-4ec8-9de2-20d7a5462268 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:09.782552 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58081610-1ff6-4ec8-9de2-20d7a5462268 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:09.783059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58081610-1ff6-4ec8-9de2-20d7a5462268 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:09.784663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58081610-1ff6-4ec8-9de2-20d7a5462268 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:09.788122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-4f5ce33f-e51e-43a5-bea2-dc552e36461e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:09.788122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:09.788122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:09.788122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:09.788122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:09.788122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:09.788122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:09.788122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:09.788122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:09.788122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:09.788122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:09.788122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:09.788122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:09.788122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:09.788122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:09.789014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:09.789014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:09.789014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:09.789014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:09.789014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:09.789014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:09.789014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:09.789014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:09.789014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:09.789014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:09.789014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:09.789014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:09.789014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:09.789014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:09.789014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:09.789014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:09.789014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:09.789951 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:09.789951 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:09.789951 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:09.789951 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:09.789951 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:09.789951 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:09.789951 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:09.789951 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:09.793944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 322/657] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:09.794837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ce33f-e51e-43a5-bea2-dc552e36461e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:09.802222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 336/658] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:09.803328 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58081610-1ff6-4ec8-9de2-20d7a5462268 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:09.905072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:09.924424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ce33f-e51e-43a5-bea2-dc552e36461e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:09.930785 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58081610-1ff6-4ec8-9de2-20d7a5462268 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:09.943236 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:09.969233 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f6d01-1edd-4d16-868e-b03b64dfd504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:09.970094 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f6d01-1edd-4d16-868e-b03b64dfd504 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:09.970495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f6d01-1edd-4d16-868e-b03b64dfd504 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:09.970891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f6d01-1edd-4d16-868e-b03b64dfd504 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:09.971858 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f6d01-1edd-4d16-868e-b03b64dfd504 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:09.972269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f6d01-1edd-4d16-868e-b03b64dfd504 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:09.973292 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93054086-7575-4357-9d4f-3ee375c12c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:09.973989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f6d01-1edd-4d16-868e-b03b64dfd504 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:09.974461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93054086-7575-4357-9d4f-3ee375c12c96 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:09.974909 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93054086-7575-4357-9d4f-3ee375c12c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:09.975329 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93054086-7575-4357-9d4f-3ee375c12c96 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:09.990212 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93054086-7575-4357-9d4f-3ee375c12c96 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:09.991881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93054086-7575-4357-9d4f-3ee375c12c96 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:09.992799 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 337/659] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:09.993740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f6d01-1edd-4d16-868e-b03b64dfd504 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:10.008999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-93054086-7575-4357-9d4f-3ee375c12c96 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 07:16:10.008999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:10.008999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:10.008999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:10.008999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:10.008999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:10.008999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:10.008999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:10.008999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:10.008999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:10.008999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:10.008999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:10.008999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:10.008999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:10.008999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:10.008999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:10.010175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:10.011180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:10.011180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:10.011180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:10.011180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:10.011180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:10.011180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:10.011180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:10.011180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:10.011180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 07:16:10.011180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:10.013949 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 323/660] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:16:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:10.014867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93054086-7575-4357-9d4f-3ee375c12c96 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:10.122505 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93054086-7575-4357-9d4f-3ee375c12c96 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:10.133752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f6d01-1edd-4d16-868e-b03b64dfd504 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:10.168709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2d036-b4cd-4f81-a408-d00ad32cef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:10.169712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2d036-b4cd-4f81-a408-d00ad32cef6e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:10.170170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2d036-b4cd-4f81-a408-d00ad32cef6e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:10.170619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2d036-b4cd-4f81-a408-d00ad32cef6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:10.171648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2d036-b4cd-4f81-a408-d00ad32cef6e None admin] RBAC: Adding query filter params (role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=bde4369f695745c199ce6c10d241b841) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:10.172146 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2d036-b4cd-4f81-a408-d00ad32cef6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:10.173799 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2d036-b4cd-4f81-a408-d00ad32cef6e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:10.181454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 324/661] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:16:10 2022] GET /identity/v3/role_assignments?user.id=bde4369f695745c199ce6c10d241b841&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:10.182884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2d036-b4cd-4f81-a408-d00ad32cef6e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:10.183919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467af4e-c158-42a4-a6df-c93eb858d70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:10.184734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467af4e-c158-42a4-a6df-c93eb858d70b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:10.185016 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467af4e-c158-42a4-a6df-c93eb858d70b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:10.185876 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467af4e-c158-42a4-a6df-c93eb858d70b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:10.189509 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:10.198155 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467af4e-c158-42a4-a6df-c93eb858d70b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:10.200270 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467af4e-c158-42a4-a6df-c93eb858d70b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:10.222122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-7467af4e-c158-42a4-a6df-c93eb858d70b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 07:16:10.222122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:10.222122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:10.222122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:10.222122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:10.222122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:10.222122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:10.222122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:10.222122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:10.222122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:10.222122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:10.222122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:10.222122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:10.222122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:10.222122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:10.222122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:10.223778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:10.224815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:10.224815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:10.224815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:10.224815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:10.224815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:10.224815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:10.224815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:10.224815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:10.224815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 07:16:10.224815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:10.225887 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 338/662] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:16:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:10.226497 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152b89a-70e3-420e-977a-e660cc107043 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:10.226784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152b89a-70e3-420e-977a-e660cc107043 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:10.227069 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152b89a-70e3-420e-977a-e660cc107043 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:10.229098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 339/663] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:10.234407 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152b89a-70e3-420e-977a-e660cc107043 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:10.235539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:10.318886 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2d036-b4cd-4f81-a408-d00ad32cef6e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:10.371889 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83bfb0-edb2-4a28-9555-e9d37652da3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:10.373777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83bfb0-edb2-4a28-9555-e9d37652da3c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:10.374078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83bfb0-edb2-4a28-9555-e9d37652da3c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:10.374370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83bfb0-edb2-4a28-9555-e9d37652da3c None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:10.375113 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152b89a-70e3-420e-977a-e660cc107043 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:10.375283 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83bfb0-edb2-4a28-9555-e9d37652da3c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:10.375603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83bfb0-edb2-4a28-9555-e9d37652da3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:10.377190 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83bfb0-edb2-4a28-9555-e9d37652da3c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:10.400220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 325/664] 10.222.0.52 () {56 vars in 1137 bytes} [Fri Jun 17 07:16:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:10.401703 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746deefa-af1c-4fcc-a95d-0f1a26d3a368 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:10.401992 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746deefa-af1c-4fcc-a95d-0f1a26d3a368 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:10.402575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746deefa-af1c-4fcc-a95d-0f1a26d3a368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:10.420549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-746deefa-af1c-4fcc-a95d-0f1a26d3a368 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:10.421680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-746deefa-af1c-4fcc-a95d-0f1a26d3a368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:10.430126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb39ff-729a-4243-9949-9f9f80946561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:10.430804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb39ff-729a-4243-9949-9f9f80946561 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:10.431090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb39ff-729a-4243-9949-9f9f80946561 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:10.431369 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb39ff-729a-4243-9949-9f9f80946561 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:10.432242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb39ff-729a-4243-9949-9f9f80946561 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:10.432550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb39ff-729a-4243-9949-9f9f80946561 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:10.434082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb39ff-729a-4243-9949-9f9f80946561 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:10.455611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 340/665] 10.222.0.52 () {56 vars in 1139 bytes} [Fri Jun 17 07:16:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:10.456947 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb39ff-729a-4243-9949-9f9f80946561 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:10.502817 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 326/666] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:16:10.504005 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746deefa-af1c-4fcc-a95d-0f1a26d3a368 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:10.535575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:10.539725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:10.599297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb39ff-729a-4243-9949-9f9f80946561 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:10.635853 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746deefa-af1c-4fcc-a95d-0f1a26d3a368 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:10.649586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fa199-b62f-4277-8bcb-8a7f92ca0216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:10.650217 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fa199-b62f-4277-8bcb-8a7f92ca0216 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:10.650581 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fa199-b62f-4277-8bcb-8a7f92ca0216 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:10.651010 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fa199-b62f-4277-8bcb-8a7f92ca0216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:10.675375 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78ab37-f47b-496d-a1d4-ecb9b7b44ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:10.676405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78ab37-f47b-496d-a1d4-ecb9b7b44ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:10.676872 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78ab37-f47b-496d-a1d4-ecb9b7b44ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:10.677372 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78ab37-f47b-496d-a1d4-ecb9b7b44ef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:10.728881 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fa199-b62f-4277-8bcb-8a7f92ca0216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:10.730477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fa199-b62f-4277-8bcb-8a7f92ca0216 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:10.755461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78ab37-f47b-496d-a1d4-ecb9b7b44ef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:10.758025 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78ab37-f47b-496d-a1d4-ecb9b7b44ef6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:10.786309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:10.792136 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:10.842093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 341/667] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:16:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:16:10.843547 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fa199-b62f-4277-8bcb-8a7f92ca0216 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:10.894093 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 327/668] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:16:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:16:10.894958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78ab37-f47b-496d-a1d4-ecb9b7b44ef6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:10.954828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fa199-b62f-4277-8bcb-8a7f92ca0216 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:10.997838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42508fc4-845f-4bc7-9763-b7b1e76a1eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:10.999087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42508fc4-845f-4bc7-9763-b7b1e76a1eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:10.999428 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42508fc4-845f-4bc7-9763-b7b1e76a1eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:10.999712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42508fc4-845f-4bc7-9763-b7b1e76a1eb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:11.009589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78ab37-f47b-496d-a1d4-ecb9b7b44ef6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:11.013026 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42508fc4-845f-4bc7-9763-b7b1e76a1eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:11.022647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-42508fc4-845f-4bc7-9763-b7b1e76a1eb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:11.022647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:11.022647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:11.022647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:11.022647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:11.022647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:11.022647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:11.022647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:11.022647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:11.022647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:11.022647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:11.022647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:11.022647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:11.022647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:11.022647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:11.022647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:11.023612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:11.023612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:11.023612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:11.023612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:11.023612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:11.023612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:11.023612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:11.023612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:11.023612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:11.023612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:11.023612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:11.023612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:11.023612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:11.023612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:11.023612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:11.023612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:11.024456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:11.024456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:11.024456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:11.024456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:11.024456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:11.024456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:11.024456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:11.024456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:11.024456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:11.024456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:11.024456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:11.024456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:11.029346 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 342/669] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:16:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:11.030160 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42508fc4-845f-4bc7-9763-b7b1e76a1eb2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:11.040544 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:11.052667 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d646a-9b3f-496c-b922-d72208ed6e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:11.053857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d646a-9b3f-496c-b922-d72208ed6e6e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:11.054436 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d646a-9b3f-496c-b922-d72208ed6e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:11.054914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d646a-9b3f-496c-b922-d72208ed6e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:11.066851 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d646a-9b3f-496c-b922-d72208ed6e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:11.068665 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d646a-9b3f-496c-b922-d72208ed6e6e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:11.088369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ad5d646a-9b3f-496c-b922-d72208ed6e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:11.088369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:11.088369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:11.088369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:11.088369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:11.088369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:11.088369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:11.088369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:11.088369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:11.088369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:11.088369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:11.088369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:11.088369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:11.088369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:11.088369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:11.089296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:11.089296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:11.089296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:11.089296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:11.089296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:11.089296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:11.089296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:11.089296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:11.089296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:11.089296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:11.089296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:11.089296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:11.089296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:11.089296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:11.089296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:11.089296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:11.089296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:11.090506 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:11.090506 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:11.090506 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:11.090506 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:11.092711 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 328/670] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:11.093732 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:11.094121 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d646a-9b3f-496c-b922-d72208ed6e6e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:11.161118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42508fc4-845f-4bc7-9763-b7b1e76a1eb2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:11.199756 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758af96-11d9-43cc-9f05-9a7b4d786c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:11.201487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758af96-11d9-43cc-9f05-9a7b4d786c8d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:11.202022 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758af96-11d9-43cc-9f05-9a7b4d786c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:11.202523 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758af96-11d9-43cc-9f05-9a7b4d786c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:11.210634 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d646a-9b3f-496c-b922-d72208ed6e6e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:11.214781 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758af96-11d9-43cc-9f05-9a7b4d786c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:11.216530 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758af96-11d9-43cc-9f05-9a7b4d786c8d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:11.234595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-5758af96-11d9-43cc-9f05-9a7b4d786c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:11.234595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:11.234595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:11.234595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:11.234595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:11.234595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:11.234595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:11.234595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:11.234595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:11.234595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:11.234595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:11.234595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:11.234595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:11.234595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:11.234595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:11.235944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:11.235944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:11.235944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:11.235944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:11.235944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:11.235944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:11.235944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:11.235944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:11.235944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:11.235944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:11.235944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:11.235944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:11.235944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:11.235944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:11.235944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:11.235944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:11.235944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:11.236830 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:11.236830 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:11.236830 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:11.236830 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:11.239126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 343/671] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:11.240206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758af96-11d9-43cc-9f05-9a7b4d786c8d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:11.249995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae3391-f57f-40c3-a656-54ea5d3a59e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:11.251113 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae3391-f57f-40c3-a656-54ea5d3a59e3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:11.251400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae3391-f57f-40c3-a656-54ea5d3a59e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:11.251670 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae3391-f57f-40c3-a656-54ea5d3a59e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:11.252417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae3391-f57f-40c3-a656-54ea5d3a59e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:11.252721 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae3391-f57f-40c3-a656-54ea5d3a59e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:11.254487 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae3391-f57f-40c3-a656-54ea5d3a59e3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:11.270618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 329/672] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:16:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:11.271590 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae3391-f57f-40c3-a656-54ea5d3a59e3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:11.313638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:11.342997 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:11.378056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758af96-11d9-43cc-9f05-9a7b4d786c8d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:11.381766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae3391-f57f-40c3-a656-54ea5d3a59e3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:11.420882 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275bb60-e589-4e8f-abad-6866c8448f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:11.421697 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275bb60-e589-4e8f-abad-6866c8448f5c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:11.421936 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275bb60-e589-4e8f-abad-6866c8448f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:11.422228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275bb60-e589-4e8f-abad-6866c8448f5c None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:11.422956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275bb60-e589-4e8f-abad-6866c8448f5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:11.423265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275bb60-e589-4e8f-abad-6866c8448f5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:11.425036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275bb60-e589-4e8f-abad-6866c8448f5c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:11.430454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8e830-e2fd-4bc2-9e33-6cec5653d07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:11.431368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8e830-e2fd-4bc2-9e33-6cec5653d07c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:11.431888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8e830-e2fd-4bc2-9e33-6cec5653d07c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:11.432908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8e830-e2fd-4bc2-9e33-6cec5653d07c None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:11.433879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8e830-e2fd-4bc2-9e33-6cec5653d07c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:11.434835 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8e830-e2fd-4bc2-9e33-6cec5653d07c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:11.436737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8e830-e2fd-4bc2-9e33-6cec5653d07c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:11.437802 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 330/673] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:11.438872 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275bb60-e589-4e8f-abad-6866c8448f5c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:11.454063 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 344/674] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:11.455598 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8e830-e2fd-4bc2-9e33-6cec5653d07c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:11.555491 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:11.559598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275bb60-e589-4e8f-abad-6866c8448f5c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:11.593366 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8e830-e2fd-4bc2-9e33-6cec5653d07c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:11.598211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26967f94-b9e7-4248-afed-3dddc88910b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:11.599367 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26967f94-b9e7-4248-afed-3dddc88910b9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:11.599901 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26967f94-b9e7-4248-afed-3dddc88910b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:11.600378 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26967f94-b9e7-4248-afed-3dddc88910b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:11.611633 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26967f94-b9e7-4248-afed-3dddc88910b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:11.613438 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26967f94-b9e7-4248-afed-3dddc88910b9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:11.621736 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:11.632813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-26967f94-b9e7-4248-afed-3dddc88910b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:11.632813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:11.632813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:11.632813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:11.632813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:11.632813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:11.632813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:11.632813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:11.632813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:11.632813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:11.632813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:11.632813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:11.632813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:11.632813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:11.632813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:11.633747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:11.633747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:11.633747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:11.633747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:11.633747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:11.633747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:11.633747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:11.633747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:11.633747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:11.633747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:11.633747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:11.633747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:11.633747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:11.633747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:11.633747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:11.633747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:11.633747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:11.634683 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:11.634683 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:11.634683 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:11.634683 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:11.636222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62976e3-416d-4d44-a246-aef7891fa3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:11.642045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62976e3-416d-4d44-a246-aef7891fa3fa None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:11.642045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62976e3-416d-4d44-a246-aef7891fa3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:11.642045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62976e3-416d-4d44-a246-aef7891fa3fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:11.642651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 331/675] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:11.643727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26967f94-b9e7-4248-afed-3dddc88910b9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:11.645799 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62976e3-416d-4d44-a246-aef7891fa3fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:11.647573 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62976e3-416d-4d44-a246-aef7891fa3fa None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:11.669387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-f62976e3-416d-4d44-a246-aef7891fa3fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:11.669387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:11.669387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:11.669387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:11.669387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:11.669387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:11.669387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:11.669387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:11.669387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:11.669387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:11.669387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:11.669387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:11.669387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:11.669387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:11.669387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:11.670491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:11.670491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:11.670491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:11.670491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:11.670491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:11.670491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:11.670491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:11.670491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:11.670491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:11.670491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:11.670491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:11.670491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:11.670491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:11.670491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:11.670491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:11.670491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:11.670491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:11.671463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:11.671463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:11.671463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:11.671463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:11.671463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:11.671463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:11.671463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:11.671463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:11.674852 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 345/676] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:11.675864 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62976e3-416d-4d44-a246-aef7891fa3fa None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:11.765890 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26967f94-b9e7-4248-afed-3dddc88910b9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:11.804530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd16e5-5290-45b7-8b4f-c7005672ab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:11.805771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd16e5-5290-45b7-8b4f-c7005672ab8a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:11.806231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd16e5-5290-45b7-8b4f-c7005672ab8a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:11.806653 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd16e5-5290-45b7-8b4f-c7005672ab8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:11.813810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd16e5-5290-45b7-8b4f-c7005672ab8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:11.815438 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd16e5-5290-45b7-8b4f-c7005672ab8a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:11.817673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62976e3-416d-4d44-a246-aef7891fa3fa None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:11.830611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-28cd16e5-5290-45b7-8b4f-c7005672ab8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:11.830611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:11.830611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:11.830611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:11.830611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:11.830611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:11.830611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:11.830611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:11.830611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:11.830611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:11.830611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:11.830611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:11.830611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:11.830611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:11.830611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:11.831654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:11.831654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:11.831654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:11.831654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:11.831654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:11.831654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:11.831654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:11.831654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:11.831654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:11.831654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:11.831654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:11.831654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:11.831654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:11.831654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:11.831654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:11.831654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:11.831654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:11.832742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:11.832742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:11.832742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:11.832742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:11.832742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:11.832742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:11.832742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:11.832742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:11.834742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 332/677] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:11.835655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd16e5-5290-45b7-8b4f-c7005672ab8a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:11.850547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:11.856232 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663e0b1-bd82-4a3a-bcd6-c0eeb32c14f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:11.865758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663e0b1-bd82-4a3a-bcd6-c0eeb32c14f8 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:11.865758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663e0b1-bd82-4a3a-bcd6-c0eeb32c14f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:11.865758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663e0b1-bd82-4a3a-bcd6-c0eeb32c14f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:11.865758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663e0b1-bd82-4a3a-bcd6-c0eeb32c14f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:11.865758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663e0b1-bd82-4a3a-bcd6-c0eeb32c14f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:11.865758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663e0b1-bd82-4a3a-bcd6-c0eeb32c14f8 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:11.876711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 346/678] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:11.876711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a51a2-55b3-4b6a-886c-1f51a422868f None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:11.876711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a51a2-55b3-4b6a-886c-1f51a422868f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:11.876711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a51a2-55b3-4b6a-886c-1f51a422868f None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:11.876711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 347/679] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:11.876711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a51a2-55b3-4b6a-886c-1f51a422868f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:11.929527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:11.956454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd16e5-5290-45b7-8b4f-c7005672ab8a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:11.987954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a51a2-55b3-4b6a-886c-1f51a422868f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:11.997858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e5de1-f1d0-4245-aa42-de1f4c743512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:11.998764 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e5de1-f1d0-4245-aa42-de1f4c743512 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:11.999514 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e5de1-f1d0-4245-aa42-de1f4c743512 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:12.000225 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e5de1-f1d0-4245-aa42-de1f4c743512 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:12.001178 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e5de1-f1d0-4245-aa42-de1f4c743512 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:12.001833 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e5de1-f1d0-4245-aa42-de1f4c743512 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:12.004126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e5de1-f1d0-4245-aa42-de1f4c743512 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:12.020386 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 333/680] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:12.021509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e5de1-f1d0-4245-aa42-de1f4c743512 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:12.027693 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85adc97-7c26-459d-b680-1c770a8ac79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:12.028364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85adc97-7c26-459d-b680-1c770a8ac79f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:12.028645 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85adc97-7c26-459d-b680-1c770a8ac79f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:12.029519 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85adc97-7c26-459d-b680-1c770a8ac79f None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:12.030311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85adc97-7c26-459d-b680-1c770a8ac79f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:12.030620 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85adc97-7c26-459d-b680-1c770a8ac79f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:12.032060 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85adc97-7c26-459d-b680-1c770a8ac79f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:12.043887 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 348/681] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:12.045254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d342c65-9409-406d-b722-834ffa79913e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:12.045571 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d342c65-9409-406d-b722-834ffa79913e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:12.045847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d342c65-9409-406d-b722-834ffa79913e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:12.063606 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8d342c65-9409-406d-b722-834ffa79913e None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:12.064702 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8d342c65-9409-406d-b722-834ffa79913e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:12.108659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:12.145352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 349/682] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:16:12.145352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d342c65-9409-406d-b722-834ffa79913e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:12.153108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e5de1-f1d0-4245-aa42-de1f4c743512 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:12.172093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:12.198434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364ee70-7794-4081-81d3-fa3f40a488ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:12.199232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364ee70-7794-4081-81d3-fa3f40a488ee None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:12.199515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364ee70-7794-4081-81d3-fa3f40a488ee None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:12.199782 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364ee70-7794-4081-81d3-fa3f40a488ee None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:12.208028 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364ee70-7794-4081-81d3-fa3f40a488ee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:12.209503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364ee70-7794-4081-81d3-fa3f40a488ee None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:12.224875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6364ee70-7794-4081-81d3-fa3f40a488ee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:16:12.224875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:12.224875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:12.224875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:12.224875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:12.224875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:12.224875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:12.224875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:12.224875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:12.224875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:12.224875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:12.224875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:12.224875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:12.224875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:12.224875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:12.224875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:12.226126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:12.227432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:12.227432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:12.227432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:12.227432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:12.227432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:12.227432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:12.227432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:12.227432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:12.227432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:16:12.227432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:12.227432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 334/683] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:16:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:12.227432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364ee70-7794-4081-81d3-fa3f40a488ee None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:12.250826 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d342c65-9409-406d-b722-834ffa79913e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:12.289194 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c3ba5-a594-41ef-b58b-d4913295c16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:12.290142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c3ba5-a594-41ef-b58b-d4913295c16d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:12.290577 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c3ba5-a594-41ef-b58b-d4913295c16d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:12.291008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c3ba5-a594-41ef-b58b-d4913295c16d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:12.292007 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c3ba5-a594-41ef-b58b-d4913295c16d None admin] RBAC: Adding query filter params (role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=ad436c2fecba4754875b7c7cb26852a5) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:12.292473 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c3ba5-a594-41ef-b58b-d4913295c16d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:12.294266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c3ba5-a594-41ef-b58b-d4913295c16d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:12.301485 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 350/684] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:16:12 2022] GET /identity/v3/role_assignments?user.id=ad436c2fecba4754875b7c7cb26852a5&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:12.302672 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c3ba5-a594-41ef-b58b-d4913295c16d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:12.339943 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364ee70-7794-4081-81d3-fa3f40a488ee None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:12.374498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:12.381192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463e0ef-98da-42e4-8d56-00d72e808e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:12.381988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463e0ef-98da-42e4-8d56-00d72e808e0b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:12.382564 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463e0ef-98da-42e4-8d56-00d72e808e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:12.382564 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463e0ef-98da-42e4-8d56-00d72e808e0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:12.383433 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463e0ef-98da-42e4-8d56-00d72e808e0b None admin] RBAC: Adding query filter params (role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=afefcf9ac054459c9585d8be3c604fc0) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:12.383750 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463e0ef-98da-42e4-8d56-00d72e808e0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:12.385233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463e0ef-98da-42e4-8d56-00d72e808e0b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:12.395095 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 335/685] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:16:12 2022] GET /identity/v3/role_assignments?user.id=afefcf9ac054459c9585d8be3c604fc0&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:12.396637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463e0ef-98da-42e4-8d56-00d72e808e0b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:12.499131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:12.506848 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c3ba5-a594-41ef-b58b-d4913295c16d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:12.557228 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dde53f-88af-45aa-b20b-9c8f08ba8ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:12.558272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dde53f-88af-45aa-b20b-9c8f08ba8ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:12.558626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dde53f-88af-45aa-b20b-9c8f08ba8ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:12.558902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dde53f-88af-45aa-b20b-9c8f08ba8ee6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:12.577590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dde53f-88af-45aa-b20b-9c8f08ba8ee6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:12.587187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-d4dde53f-88af-45aa-b20b-9c8f08ba8ee6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:16:12.587187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:12.587187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:12.587187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:12.587187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:12.587187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:12.587187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:12.587187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:12.587187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:12.587187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:12.587187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:12.587187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:12.587187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:12.587187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:12.587187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:12.587187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:12.588309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:12.588309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:12.588309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:12.588309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:12.588309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:12.588309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:12.588309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:12.588309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:12.588309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:12.588309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:12.588309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:12.588309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:12.588309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:12.588309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:12.588309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:12.588309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:12.589156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:12.589156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:12.589156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:12.589156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:12.589156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:12.589156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:12.589156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:12.589156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:12.589156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:12.589156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:12.589156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:16:12.589156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:12.591638 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 351/686] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:16:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:12.594820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353afa2-6727-4c57-905f-a8cd15db7fb2 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:12.596441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353afa2-6727-4c57-905f-a8cd15db7fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:12.596441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353afa2-6727-4c57-905f-a8cd15db7fb2 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:12.596835 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 352/687] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:12.598353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353afa2-6727-4c57-905f-a8cd15db7fb2 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:12.604875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463e0ef-98da-42e4-8d56-00d72e808e0b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:12.651378 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437c19a-c950-425b-adb0-dbb3bc080ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:12.652087 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437c19a-c950-425b-adb0-dbb3bc080ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:12.652367 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437c19a-c950-425b-adb0-dbb3bc080ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:12.652642 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437c19a-c950-425b-adb0-dbb3bc080ea0 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:12.654169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437c19a-c950-425b-adb0-dbb3bc080ea0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:12.654169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437c19a-c950-425b-adb0-dbb3bc080ea0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:12.655720 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437c19a-c950-425b-adb0-dbb3bc080ea0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:12.678643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 336/688] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Jun 17 07:16:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:12.680432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0da2e-4692-40e3-8dd2-2ef94c3d5f61 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:12.680932 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0da2e-4692-40e3-8dd2-2ef94c3d5f61 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:12.681464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0da2e-4692-40e3-8dd2-2ef94c3d5f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:12.701267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b5a0da2e-4692-40e3-8dd2-2ef94c3d5f61 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:12.702840 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b5a0da2e-4692-40e3-8dd2-2ef94c3d5f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:12.738287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353afa2-6727-4c57-905f-a8cd15db7fb2 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:12.775450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad12ca-e414-4bc0-a511-836441987151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:12.775933 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:12.776134 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad12ca-e414-4bc0-a511-836441987151 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:12.776450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad12ca-e414-4bc0-a511-836441987151 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:12.776727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad12ca-e414-4bc0-a511-836441987151 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:12.777748 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad12ca-e414-4bc0-a511-836441987151 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:12.777860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad12ca-e414-4bc0-a511-836441987151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:12.780141 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad12ca-e414-4bc0-a511-836441987151 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:12.794487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 353/689] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:16:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:12.794487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad12ca-e414-4bc0-a511-836441987151 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:12.805169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 337/690] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:16:12.806240 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0da2e-4692-40e3-8dd2-2ef94c3d5f61 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:12.827580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:12.920023 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0da2e-4692-40e3-8dd2-2ef94c3d5f61 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:12.944395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad12ca-e414-4bc0-a511-836441987151 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:12.955668 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf952ef-2ede-45dc-a273-85edd1ad2cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:12.956652 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf952ef-2ede-45dc-a273-85edd1ad2cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:12.957057 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf952ef-2ede-45dc-a273-85edd1ad2cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:12.957753 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf952ef-2ede-45dc-a273-85edd1ad2cf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:12.969094 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf952ef-2ede-45dc-a273-85edd1ad2cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:12.970582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf952ef-2ede-45dc-a273-85edd1ad2cf8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:12.989182 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ab67e-9974-4ec0-9f33-7e57fcdd062a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:12.990119 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ab67e-9974-4ec0-9f33-7e57fcdd062a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:12.990553 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ab67e-9974-4ec0-9f33-7e57fcdd062a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:12.990781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5cf952ef-2ede-45dc-a273-85edd1ad2cf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:12.990781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:12.990781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:12.990781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:12.990781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:12.990781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:12.990781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:12.990781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:12.990781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:12.990781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:12.990781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:12.990781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:12.990781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:12.990781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:12.990781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:12.991719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:12.991719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:12.991719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:12.991719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:12.991719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:12.991719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:12.991719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:12.991719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:12.991719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:12.991719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:12.991719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:12.991719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:12.991719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:12.991719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:12.991719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:12.991719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:12.991719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:12.992625 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:12.992625 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:12.992625 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:12.992625 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:12.993348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ab67e-9974-4ec0-9f33-7e57fcdd062a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:12.994203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 338/691] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:12.995181 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf952ef-2ede-45dc-a273-85edd1ad2cf8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:13.034129 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:13.090943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ab67e-9974-4ec0-9f33-7e57fcdd062a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:13.092832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ab67e-9974-4ec0-9f33-7e57fcdd062a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:13.109274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf952ef-2ede-45dc-a273-85edd1ad2cf8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:13.114594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:13.148641 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2ab09-7f80-4549-87d4-6ddaad3bae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:13.149779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2ab09-7f80-4549-87d4-6ddaad3bae34 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:13.150264 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2ab09-7f80-4549-87d4-6ddaad3bae34 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:13.150700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2ab09-7f80-4549-87d4-6ddaad3bae34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:13.162667 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2ab09-7f80-4549-87d4-6ddaad3bae34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:13.164446 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2ab09-7f80-4549-87d4-6ddaad3bae34 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:13.183692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9cb2ab09-7f80-4549-87d4-6ddaad3bae34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:13.183692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:13.183692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:13.183692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:13.183692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:13.183692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:13.183692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:13.183692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:13.183692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:13.183692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:13.183692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:13.183692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:13.183692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:13.183692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:13.183692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:13.184772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:13.184772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:13.184772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:13.184772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:13.184772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:13.184772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:13.184772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:13.184772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:13.184772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:13.184772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:13.184772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:13.184772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:13.184772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:13.184772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:13.184772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:13.184772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:13.184772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:13.186442 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:13.186442 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:13.186442 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:13.186442 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:13.192856 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 339/692] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:13.194068 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2ab09-7f80-4549-87d4-6ddaad3bae34 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:13.200041 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 354/693] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:16:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:16:13.201484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ab67e-9974-4ec0-9f33-7e57fcdd062a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:13.289219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:13.306428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2ab09-7f80-4549-87d4-6ddaad3bae34 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:13.310728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ab67e-9974-4ec0-9f33-7e57fcdd062a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:13.331142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:13.346556 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98250145-6241-4c5c-8003-6011059e8f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:13.346718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c67edf-d9fb-46c0-bd5e-0f2d35c3ec92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:13.347243 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98250145-6241-4c5c-8003-6011059e8f07 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:13.347602 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98250145-6241-4c5c-8003-6011059e8f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:13.356762 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c67edf-d9fb-46c0-bd5e-0f2d35c3ec92 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:13.356952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98250145-6241-4c5c-8003-6011059e8f07 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:13.357107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c67edf-d9fb-46c0-bd5e-0f2d35c3ec92 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:13.357107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c67edf-d9fb-46c0-bd5e-0f2d35c3ec92 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:13.357107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c67edf-d9fb-46c0-bd5e-0f2d35c3ec92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:13.357377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98250145-6241-4c5c-8003-6011059e8f07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:13.357480 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c67edf-d9fb-46c0-bd5e-0f2d35c3ec92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:13.357565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98250145-6241-4c5c-8003-6011059e8f07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:13.357652 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c67edf-d9fb-46c0-bd5e-0f2d35c3ec92 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:13.357733 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98250145-6241-4c5c-8003-6011059e8f07 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:13.368382 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 340/694] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:13.369255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 355/695] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:13.369662 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c67edf-d9fb-46c0-bd5e-0f2d35c3ec92 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:13.373357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98250145-6241-4c5c-8003-6011059e8f07 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:13.477339 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c67edf-d9fb-46c0-bd5e-0f2d35c3ec92 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:13.480836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98250145-6241-4c5c-8003-6011059e8f07 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:13.514978 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac71de-8741-4c3d-a51c-8d25b1d4fb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:13.516039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac71de-8741-4c3d-a51c-8d25b1d4fb2b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:13.516473 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac71de-8741-4c3d-a51c-8d25b1d4fb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:13.516887 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac71de-8741-4c3d-a51c-8d25b1d4fb2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:13.517720 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf1285-b538-4d4d-8606-d8e53ca29154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:13.518761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf1285-b538-4d4d-8606-d8e53ca29154 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:13.519132 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf1285-b538-4d4d-8606-d8e53ca29154 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:13.519508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf1285-b538-4d4d-8606-d8e53ca29154 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:13.527001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf1285-b538-4d4d-8606-d8e53ca29154 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:13.528563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf1285-b538-4d4d-8606-d8e53ca29154 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:13.529721 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac71de-8741-4c3d-a51c-8d25b1d4fb2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:13.531355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac71de-8741-4c3d-a51c-8d25b1d4fb2b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:13.538226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:13.544440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-bdcf1285-b538-4d4d-8606-d8e53ca29154 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:16:13.544440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:13.544440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:13.544440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:13.544440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:13.544440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:13.544440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:13.544440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:13.544440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:13.544440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:13.544440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:13.544440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:13.544440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:13.544440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:13.544440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:13.544440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:13.545403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:13.546371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:13.546371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:13.546371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:13.546371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:13.546371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:13.546371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:13.546371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:13.546371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:13.546371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:16:13.546371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:13.550411 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 356/696] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Jun 17 07:16:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:13.551337 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf1285-b538-4d4d-8606-d8e53ca29154 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:13.557000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a7ac71de-8741-4c3d-a51c-8d25b1d4fb2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:13.557000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:13.557000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:13.557000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:13.557000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:13.557000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:13.557000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:13.557000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:13.557000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:13.557000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:13.557000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:13.557000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:13.557000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:13.557000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:13.557000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:13.558273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:13.558273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:13.558273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:13.558273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:13.558273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:13.558273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:13.558273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:13.558273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:13.558273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:13.558273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:13.558273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:13.558273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:13.558273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:13.558273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:13.558273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:13.558273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:13.558273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:13.559183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:13.559183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:13.559183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:13.559183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:13.559183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 341/697] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:13.559183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac71de-8741-4c3d-a51c-8d25b1d4fb2b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:13.608278 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:13.659363 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf1285-b538-4d4d-8606-d8e53ca29154 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:13.670790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac71de-8741-4c3d-a51c-8d25b1d4fb2b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:13.707430 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e33c8-1e0f-4750-b350-f75d7906e97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:13.707937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf523a-0747-419e-a0f9-c290fc376dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:13.708635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e33c8-1e0f-4750-b350-f75d7906e97c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:13.708743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf523a-0747-419e-a0f9-c290fc376dc1 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:13.709019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf523a-0747-419e-a0f9-c290fc376dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:13.709388 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf523a-0747-419e-a0f9-c290fc376dc1 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:13.709590 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e33c8-1e0f-4750-b350-f75d7906e97c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:13.710025 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e33c8-1e0f-4750-b350-f75d7906e97c None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:13.710294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf523a-0747-419e-a0f9-c290fc376dc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:13.711242 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e33c8-1e0f-4750-b350-f75d7906e97c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:13.711721 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e33c8-1e0f-4750-b350-f75d7906e97c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:13.711868 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf523a-0747-419e-a0f9-c290fc376dc1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:13.713475 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e33c8-1e0f-4750-b350-f75d7906e97c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:13.732937 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 342/698] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Jun 17 07:16:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:13.734096 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e33c8-1e0f-4750-b350-f75d7906e97c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:13.791881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:13.810828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 357/699] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:16:13 2022] POST /identity/v3/users => generated 254 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:16:13.810828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf523a-0747-419e-a0f9-c290fc376dc1 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:13.872584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e33c8-1e0f-4750-b350-f75d7906e97c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:13.941398 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b471f-de09-40e0-9b72-68b5883c5acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:13.942079 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b471f-de09-40e0-9b72-68b5883c5acd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:13.942358 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b471f-de09-40e0-9b72-68b5883c5acd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:13.942627 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b471f-de09-40e0-9b72-68b5883c5acd None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:13.943350 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b471f-de09-40e0-9b72-68b5883c5acd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:13.943653 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b471f-de09-40e0-9b72-68b5883c5acd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:13.945079 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b471f-de09-40e0-9b72-68b5883c5acd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:13.959493 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 343/700] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:13.965077 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b471f-de09-40e0-9b72-68b5883c5acd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:14.004395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:14.015576 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf523a-0747-419e-a0f9-c290fc376dc1 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:14.072167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd642e-8501-4842-be13-e4411b504894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:14.072876 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd642e-8501-4842-be13-e4411b504894 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:14.073161 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd642e-8501-4842-be13-e4411b504894 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:14.073463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd642e-8501-4842-be13-e4411b504894 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:14.108314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b471f-de09-40e0-9b72-68b5883c5acd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:14.126947 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:14.150423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc45ab5-58f9-4153-8246-971d22d69d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:14.150788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd642e-8501-4842-be13-e4411b504894 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:14.151790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc45ab5-58f9-4153-8246-971d22d69d55 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:14.152260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd642e-8501-4842-be13-e4411b504894 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:14.152501 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc45ab5-58f9-4153-8246-971d22d69d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:14.152983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc45ab5-58f9-4153-8246-971d22d69d55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:14.160921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc45ab5-58f9-4153-8246-971d22d69d55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:14.162739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc45ab5-58f9-4153-8246-971d22d69d55 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:14.179185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-0bc45ab5-58f9-4153-8246-971d22d69d55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:14.179185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:14.179185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:14.179185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:14.179185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:14.179185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:14.179185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:14.179185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:14.179185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:14.179185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:14.179185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:14.179185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:14.179185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:14.179185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:14.179185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:14.180125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:14.180125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:14.180125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:14.180125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:14.180125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:14.180125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:14.180125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:14.180125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:14.180125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:14.180125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:14.180125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:14.180125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:14.180125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:14.180125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:14.180125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:14.180125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:14.180125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:14.181027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:14.181027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:14.181027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:14.181027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:14.181027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:14.181027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:14.181027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:14.181027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:14.183536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 344/701] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:14.191644 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc45ab5-58f9-4153-8246-971d22d69d55 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:14.274751 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:14.286930 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 358/702] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:16:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:16:14.295493 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd642e-8501-4842-be13-e4411b504894 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:14.318939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc45ab5-58f9-4153-8246-971d22d69d55 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:14.357364 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb99d5b-6e90-47e1-b4e1-bdb7a023fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:14.358513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb99d5b-6e90-47e1-b4e1-bdb7a023fe19 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:14.358978 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb99d5b-6e90-47e1-b4e1-bdb7a023fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:14.359433 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb99d5b-6e90-47e1-b4e1-bdb7a023fe19 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:14.360394 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb99d5b-6e90-47e1-b4e1-bdb7a023fe19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:14.360883 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb99d5b-6e90-47e1-b4e1-bdb7a023fe19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:14.362690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb99d5b-6e90-47e1-b4e1-bdb7a023fe19 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:14.376475 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 345/703] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:14.386631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb99d5b-6e90-47e1-b4e1-bdb7a023fe19 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:14.415603 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd642e-8501-4842-be13-e4411b504894 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:14.428878 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:14.485522 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6de10-65e4-4be9-b72c-8e39a36ee75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:14.486510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6de10-65e4-4be9-b72c-8e39a36ee75b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:14.486724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6de10-65e4-4be9-b72c-8e39a36ee75b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:14.486972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6de10-65e4-4be9-b72c-8e39a36ee75b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:14.502585 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb99d5b-6e90-47e1-b4e1-bdb7a023fe19 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:14.507416 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6de10-65e4-4be9-b72c-8e39a36ee75b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:14.508903 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6de10-65e4-4be9-b72c-8e39a36ee75b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:14.539015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-9de6de10-65e4-4be9-b72c-8e39a36ee75b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:14.539015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:14.539015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:14.539015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:14.539015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:14.539015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:14.539015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:14.539015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:14.539015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:14.539015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:14.539015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:14.539015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:14.539015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:14.539015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:14.539015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:14.539954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:14.539954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:14.539954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:14.539954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:14.539954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:14.539954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:14.539954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:14.539954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:14.539954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:14.539954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:14.539954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:14.539954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:14.539954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:14.539954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:14.539954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:14.539954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:14.539954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:14.540851 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:14.540851 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:14.540851 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:14.540851 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:14.543109 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16eb48c-27fa-46f5-b5d6-94dfb76ecf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:14.544001 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eb48c-27fa-46f5-b5d6-94dfb76ecf39 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:14.545123 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eb48c-27fa-46f5-b5d6-94dfb76ecf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:14.545631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eb48c-27fa-46f5-b5d6-94dfb76ecf39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:14.545887 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 359/704] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:14.547009 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16eb48c-27fa-46f5-b5d6-94dfb76ecf39 None admin] RBAC: Adding query filter params (role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=a18b07c033224d2085773936dad33eec) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:14.547545 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16eb48c-27fa-46f5-b5d6-94dfb76ecf39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:14.549256 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16eb48c-27fa-46f5-b5d6-94dfb76ecf39 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:14.551059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6de10-65e4-4be9-b72c-8e39a36ee75b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:14.556971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 346/705] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:16:14 2022] GET /identity/v3/role_assignments?user.id=a18b07c033224d2085773936dad33eec&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:14.630202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:14.675569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba546a-439f-4245-afc5-b145aaef3125 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:14.675915 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba546a-439f-4245-afc5-b145aaef3125 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:14.676122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba546a-439f-4245-afc5-b145aaef3125 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:14.677815 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 347/706] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:16:14.683492 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f2a1a-1f8a-42df-8e30-1588ae3449c2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:14.683780 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f2a1a-1f8a-42df-8e30-1588ae3449c2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:14.684056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f2a1a-1f8a-42df-8e30-1588ae3449c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:14.702921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-fd1f2a1a-1f8a-42df-8e30-1588ae3449c2 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:14.704168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fd1f2a1a-1f8a-42df-8e30-1588ae3449c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:14.771663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6de10-65e4-4be9-b72c-8e39a36ee75b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:14.784179 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 348/707] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:16:14.801900 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73a42b-e462-4164-ae6c-cd2344eb72a8 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:14.802173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73a42b-e462-4164-ae6c-cd2344eb72a8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:14.802379 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73a42b-e462-4164-ae6c-cd2344eb72a8 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:14.803866 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 349/708] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:16:14.809789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc82bb-102b-4d29-815e-e1e047e98316 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:14.810892 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc82bb-102b-4d29-815e-e1e047e98316 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:14.811377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc82bb-102b-4d29-815e-e1e047e98316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:14.816337 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258e144-cb0f-4c5f-9f8f-b1ab5820ec11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:14.817004 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258e144-cb0f-4c5f-9f8f-b1ab5820ec11 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:14.817503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258e144-cb0f-4c5f-9f8f-b1ab5820ec11 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:14.817782 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258e144-cb0f-4c5f-9f8f-b1ab5820ec11 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:14.818509 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258e144-cb0f-4c5f-9f8f-b1ab5820ec11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:14.818818 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258e144-cb0f-4c5f-9f8f-b1ab5820ec11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:14.820206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258e144-cb0f-4c5f-9f8f-b1ab5820ec11 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:14.832233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f8fc82bb-102b-4d29-815e-e1e047e98316 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:14.833545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 360/709] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:14.834083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f8fc82bb-102b-4d29-815e-e1e047e98316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:14.834450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258e144-cb0f-4c5f-9f8f-b1ab5820ec11 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:14.865249 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:14.928564 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 350/710] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:16:14.934181 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc82bb-102b-4d29-815e-e1e047e98316 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:14.963959 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258e144-cb0f-4c5f-9f8f-b1ab5820ec11 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:14.973285 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:15.006871 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d5fb9-f36b-4b2f-be1e-99fdebb03fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:15.007946 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d5fb9-f36b-4b2f-be1e-99fdebb03fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:15.008228 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d5fb9-f36b-4b2f-be1e-99fdebb03fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:15.008809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d5fb9-f36b-4b2f-be1e-99fdebb03fd3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:15.009945 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d5fb9-f36b-4b2f-be1e-99fdebb03fd3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:15.011847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d5fb9-f36b-4b2f-be1e-99fdebb03fd3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:15.033290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-846d5fb9-f36b-4b2f-be1e-99fdebb03fd3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:16:15.033290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:15.033290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:15.033290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:15.033290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:15.033290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:15.033290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:15.033290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:15.033290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:16:15.033290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:15.033290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:15.033290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:15.033290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:15.033290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:15.033290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:15.033290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:15.034347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:15.034347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:15.034347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:15.034347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:15.034347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:15.034347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:15.034347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:15.034347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:15.034347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:15.034347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:15.034347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:15.034347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:15.034347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:15.034347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:15.034347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:15.034347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:15.035222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:15.035222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:15.035222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:15.035222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:15.035222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:15.035222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:15.035222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:15.035222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:15.035222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:15.035222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:15.035222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:15.035222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:15.035222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:15.035222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:16:15.035222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:15.036756 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 361/711] 10.222.0.52 () {56 vars in 1129 bytes} [Fri Jun 17 07:16:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:15.036756 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d5fb9-f36b-4b2f-be1e-99fdebb03fd3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:15.057597 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc82bb-102b-4d29-815e-e1e047e98316 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:15.100839 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda92aeb-9b39-4f27-9a18-2e0a618af5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:15.101945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda92aeb-9b39-4f27-9a18-2e0a618af5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:15.102661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda92aeb-9b39-4f27-9a18-2e0a618af5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:15.102942 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda92aeb-9b39-4f27-9a18-2e0a618af5c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:15.112115 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda92aeb-9b39-4f27-9a18-2e0a618af5c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:15.114314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda92aeb-9b39-4f27-9a18-2e0a618af5c4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:15.133598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-bda92aeb-9b39-4f27-9a18-2e0a618af5c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:15.133598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:15.133598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:15.133598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:15.133598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:15.133598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:15.133598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:15.133598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:15.133598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:15.133598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:15.133598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:15.133598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:15.133598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:15.133598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:15.133598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:15.135635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:15.135635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:15.135635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:15.135635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:15.135635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:15.135635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:15.135635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:15.135635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:15.135635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:15.135635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:15.135635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:15.135635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:15.135635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:15.135635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:15.135635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:15.135635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:15.135635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:15.137015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:15.137015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:15.137015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:15.137015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:15.137015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:15.137015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:15.137015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:15.137015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:15.137015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 351/712] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:15.137015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda92aeb-9b39-4f27-9a18-2e0a618af5c4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:15.164713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d5fb9-f36b-4b2f-be1e-99fdebb03fd3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:15.171099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:15.204250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee204d-ce0f-4664-a78d-352d1838c1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:15.205141 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee204d-ce0f-4664-a78d-352d1838c1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:15.205449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee204d-ce0f-4664-a78d-352d1838c1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:15.205722 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee204d-ce0f-4664-a78d-352d1838c1e7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:15.206719 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee204d-ce0f-4664-a78d-352d1838c1e7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:15.207869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee204d-ce0f-4664-a78d-352d1838c1e7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:15.221696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-e1ee204d-ce0f-4664-a78d-352d1838c1e7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:16:15.221696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:15.221696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:15.221696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:15.221696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:15.221696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:15.221696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:15.221696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:15.221696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:16:15.221696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:15.221696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:15.221696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:15.221696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:15.221696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:15.221696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:15.221696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:15.221696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:15.222779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:15.222779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:15.222779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:15.222779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:15.222779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:15.222779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:15.222779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:15.222779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:15.222779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:15.222779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:15.222779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:15.222779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:15.222779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:15.222779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:15.222779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:15.222779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:15.223613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:15.223613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:15.223613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:15.223613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:15.223613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:15.223613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:15.223613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:15.223613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:15.223613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:15.223613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:15.223613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:15.223613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:15.223613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:16:15.223613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:15.223613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 362/713] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:15 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:15.224409 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee204d-ce0f-4664-a78d-352d1838c1e7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:15.267713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:15.284161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda92aeb-9b39-4f27-9a18-2e0a618af5c4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:15.328289 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6153934-2a62-43f5-928d-88bef811d24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:15.329083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6153934-2a62-43f5-928d-88bef811d24e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:15.329474 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6153934-2a62-43f5-928d-88bef811d24e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:15.329796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6153934-2a62-43f5-928d-88bef811d24e None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:15.330524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6153934-2a62-43f5-928d-88bef811d24e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:15.331250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6153934-2a62-43f5-928d-88bef811d24e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:15.332442 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6153934-2a62-43f5-928d-88bef811d24e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:15.337868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 352/714] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Jun 17 07:16:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:15.338938 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6153934-2a62-43f5-928d-88bef811d24e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:15.347846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee204d-ce0f-4664-a78d-352d1838c1e7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:15.409100 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7063f84-8b7f-4927-b8ee-c2acf8c23980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:15.409821 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7063f84-8b7f-4927-b8ee-c2acf8c23980 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:15.410079 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7063f84-8b7f-4927-b8ee-c2acf8c23980 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:15.410356 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7063f84-8b7f-4927-b8ee-c2acf8c23980 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:15.411139 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7063f84-8b7f-4927-b8ee-c2acf8c23980 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:15.411448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7063f84-8b7f-4927-b8ee-c2acf8c23980 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:15.412895 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7063f84-8b7f-4927-b8ee-c2acf8c23980 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:15.427918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 363/715] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:15.428809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7063f84-8b7f-4927-b8ee-c2acf8c23980 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:15.461565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:15.481755 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6153934-2a62-43f5-928d-88bef811d24e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:15.531010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62837989-3551-4b94-8fc3-f93b1e33b5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:15.532857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62837989-3551-4b94-8fc3-f93b1e33b5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:15.533631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62837989-3551-4b94-8fc3-f93b1e33b5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:15.534112 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62837989-3551-4b94-8fc3-f93b1e33b5e7 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:15.535211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62837989-3551-4b94-8fc3-f93b1e33b5e7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:15.536117 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62837989-3551-4b94-8fc3-f93b1e33b5e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:15.538035 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62837989-3551-4b94-8fc3-f93b1e33b5e7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:15.544586 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 353/716] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Jun 17 07:16:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:15.545762 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62837989-3551-4b94-8fc3-f93b1e33b5e7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:15.555184 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:15.563153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7063f84-8b7f-4927-b8ee-c2acf8c23980 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:15.607787 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018fdd8-74ff-4f2a-822b-49818a7f272b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:15.608387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018fdd8-74ff-4f2a-822b-49818a7f272b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:15.608672 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018fdd8-74ff-4f2a-822b-49818a7f272b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:15.608967 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018fdd8-74ff-4f2a-822b-49818a7f272b None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:15.609957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018fdd8-74ff-4f2a-822b-49818a7f272b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:15.610268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018fdd8-74ff-4f2a-822b-49818a7f272b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:15.611825 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018fdd8-74ff-4f2a-822b-49818a7f272b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:15.619396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 364/717] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Jun 17 07:16:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:15.620830 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018fdd8-74ff-4f2a-822b-49818a7f272b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:15.691429 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62837989-3551-4b94-8fc3-f93b1e33b5e7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:15.769735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c994e-e4d9-4a9f-adba-de4fea534cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:15.770411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c994e-e4d9-4a9f-adba-de4fea534cbf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:15.770692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c994e-e4d9-4a9f-adba-de4fea534cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:15.770966 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c994e-e4d9-4a9f-adba-de4fea534cbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:15.771808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c994e-e4d9-4a9f-adba-de4fea534cbf None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=88e1572d22c048b09699a2fe50900f92) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:15.772121 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c994e-e4d9-4a9f-adba-de4fea534cbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:15.773602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c994e-e4d9-4a9f-adba-de4fea534cbf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:15.793846 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 354/718] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:16:15 2022] GET /identity/v3/role_assignments?user.id=88e1572d22c048b09699a2fe50900f92&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:15.827514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018fdd8-74ff-4f2a-822b-49818a7f272b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:15.867211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631c5ef-0b0f-4269-8297-b04338a212bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:15.868268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631c5ef-0b0f-4269-8297-b04338a212bd None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:15.868767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631c5ef-0b0f-4269-8297-b04338a212bd None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:15.869250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631c5ef-0b0f-4269-8297-b04338a212bd None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:15.870202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631c5ef-0b0f-4269-8297-b04338a212bd None admin] RBAC: Adding query filter params (type=network) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:15.870735 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631c5ef-0b0f-4269-8297-b04338a212bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:15.872591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631c5ef-0b0f-4269-8297-b04338a212bd None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:15.878880 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 365/719] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Jun 17 07:16:15 2022] GET /identity/v3/services?type=network => generated 124 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:16.633927 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4127-a689-4a79-afed-c3528350a3c0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:16.634452 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4127-a689-4a79-afed-c3528350a3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:16.634452 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4127-a689-4a79-afed-c3528350a3c0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:16.635833 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 355/720] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:16.641931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4f74c-1613-4a1d-a841-04196c3f7c0f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:16.642340 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4f74c-1613-4a1d-a841-04196c3f7c0f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:16.642534 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4f74c-1613-4a1d-a841-04196c3f7c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:16.662317 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-2cc4f74c-1613-4a1d-a841-04196c3f7c0f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:16.663526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2cc4f74c-1613-4a1d-a841-04196c3f7c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:16.700135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:16.771741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 366/721] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:16:16.812571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e4127-a689-4a79-afed-c3528350a3c0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:16.828215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:16.951284 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e4127-a689-4a79-afed-c3528350a3c0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:16.992983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d539f-48d1-45c5-b2cd-a29df5dd6fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:16.993828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d539f-48d1-45c5-b2cd-a29df5dd6fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:16.994110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d539f-48d1-45c5-b2cd-a29df5dd6fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:16.994384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d539f-48d1-45c5-b2cd-a29df5dd6fc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:17.015765 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d539f-48d1-45c5-b2cd-a29df5dd6fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:17.023579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d63d539f-48d1-45c5-b2cd-a29df5dd6fc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:17.023579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:17.023579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:17.023579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:17.023579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:17.023579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:17.023579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:17.023579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:17.023579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:17.023579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:17.023579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:17.023579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:17.023579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:17.023579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:17.023579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:17.023579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:17.024548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:17.024548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:17.024548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:17.024548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:17.024548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:17.024548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:17.024548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:17.024548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:17.024548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:17.024548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:17.024548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:17.024548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:17.024548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:17.024548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:17.024548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:17.024548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:17.025455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:17.025455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:17.025455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:17.025455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:17.025455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:17.025455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:17.025455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:17.025455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:17.025455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:17.025455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:17.025455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:17.025455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:17.025455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 356/722] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:16:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:17.031566 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4f74c-1613-4a1d-a841-04196c3f7c0f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:17.131449 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1929ff-06fb-47ff-9066-f3b34120d442 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:17.131770 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1929ff-06fb-47ff-9066-f3b34120d442 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:17.132010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1929ff-06fb-47ff-9066-f3b34120d442 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:17.136281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 357/723] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:17.151079 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ecef1-a89e-493b-82d0-f027d8e18d69 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:17.151079 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ecef1-a89e-493b-82d0-f027d8e18d69 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:17.151380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ecef1-a89e-493b-82d0-f027d8e18d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:17.161111 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4f74c-1613-4a1d-a841-04196c3f7c0f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:17.198368 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c26ecef1-a89e-493b-82d0-f027d8e18d69 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:17.199205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc0840-c8eb-4bcc-ae33-8b6d8489f74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:17.199590 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c26ecef1-a89e-493b-82d0-f027d8e18d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:17.200341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc0840-c8eb-4bcc-ae33-8b6d8489f74c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:17.201122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc0840-c8eb-4bcc-ae33-8b6d8489f74c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:17.201833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc0840-c8eb-4bcc-ae33-8b6d8489f74c None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:17.202910 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc0840-c8eb-4bcc-ae33-8b6d8489f74c None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:17.203417 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc0840-c8eb-4bcc-ae33-8b6d8489f74c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:17.204983 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc0840-c8eb-4bcc-ae33-8b6d8489f74c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:17.214319 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 367/724] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:16:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:17.222493 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc0840-c8eb-4bcc-ae33-8b6d8489f74c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:17.256722 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:17.305956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 358/725] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 17 07:16:17.333632 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ecef1-a89e-493b-82d0-f027d8e18d69 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:17.337048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:17.389580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc0840-c8eb-4bcc-ae33-8b6d8489f74c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:17.435562 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4aa9a-1d78-4444-bcd9-b52b2c23a434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:17.436739 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4aa9a-1d78-4444-bcd9-b52b2c23a434 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:17.437245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4aa9a-1d78-4444-bcd9-b52b2c23a434 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:17.437860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4aa9a-1d78-4444-bcd9-b52b2c23a434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:17.449444 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4aa9a-1d78-4444-bcd9-b52b2c23a434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:17.452151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4aa9a-1d78-4444-bcd9-b52b2c23a434 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:17.477927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-fad4aa9a-1d78-4444-bcd9-b52b2c23a434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:17.477927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:17.477927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:17.477927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:17.477927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:17.477927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:17.477927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:17.477927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:17.477927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:17.477927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:17.477927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:17.477927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:17.477927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:17.477927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:17.477927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:17.478992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:17.478992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:17.478992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:17.478992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:17.478992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:17.478992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:17.478992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:17.478992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:17.478992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:17.478992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:17.478992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:17.478992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:17.478992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:17.478992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:17.478992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:17.478992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:17.478992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:17.479896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:17.479896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:17.479896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:17.479896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:17.482254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 368/726] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:17.487839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4aa9a-1d78-4444-bcd9-b52b2c23a434 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:17.544569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ecef1-a89e-493b-82d0-f027d8e18d69 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:17.559558 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:17.594844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4aa9a-1d78-4444-bcd9-b52b2c23a434 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:17.629902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3d11a-a307-4cfb-b63d-b8cd716f7ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:17.630922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d11a-a307-4cfb-b63d-b8cd716f7ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:17.631406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d11a-a307-4cfb-b63d-b8cd716f7ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:17.631901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d11a-a307-4cfb-b63d-b8cd716f7ba5 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:17.632815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3d11a-a307-4cfb-b63d-b8cd716f7ba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:17.633341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3d11a-a307-4cfb-b63d-b8cd716f7ba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:17.635191 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3d11a-a307-4cfb-b63d-b8cd716f7ba5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:17.642867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb5b94-2382-486b-8653-5d1453bbc852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:17.643372 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb5b94-2382-486b-8653-5d1453bbc852 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:17.643617 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb5b94-2382-486b-8653-5d1453bbc852 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:17.643884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb5b94-2382-486b-8653-5d1453bbc852 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:17.650413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 369/727] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:17.656321 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3d11a-a307-4cfb-b63d-b8cd716f7ba5 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:17.693927 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb5b94-2382-486b-8653-5d1453bbc852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:17.710250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e0eb5b94-2382-486b-8653-5d1453bbc852 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:16:17.710250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:17.710250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:17.710250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:17.710250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:17.710250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:17.710250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:17.710250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:17.710250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:17.710250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:17.710250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:17.710250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:17.710250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:17.710250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:17.710250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:17.710250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:17.711201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:17.711201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:17.711201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:17.711201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:17.711201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:17.711201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:17.711201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:17.711201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:17.711201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:17.711201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:17.711201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:17.711201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:17.711201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:17.711201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:17.711201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:17.711201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:17.712045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:17.712045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:17.712045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:17.712045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:17.712045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:17.712045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:17.712045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:17.712045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:17.712045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:17.712045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:17.712045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:16:17.712045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:17.712045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 359/728] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:16:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:17.724957 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb5b94-2382-486b-8653-5d1453bbc852 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:17.829415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:17.832361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3d11a-a307-4cfb-b63d-b8cd716f7ba5 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:17.869716 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:17.877712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83254c65-ef96-4ef7-9d05-817f7a460e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:17.878864 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83254c65-ef96-4ef7-9d05-817f7a460e6c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:17.879439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83254c65-ef96-4ef7-9d05-817f7a460e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:17.879915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83254c65-ef96-4ef7-9d05-817f7a460e6c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:17.887811 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83254c65-ef96-4ef7-9d05-817f7a460e6c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:17.889852 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83254c65-ef96-4ef7-9d05-817f7a460e6c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:17.906374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-83254c65-ef96-4ef7-9d05-817f7a460e6c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:16:17.906374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:17.906374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:17.906374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:17.906374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:17.906374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:17.906374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:17.906374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:17.906374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:17.906374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:17.906374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:17.906374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:17.906374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:17.906374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:17.906374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:17.906374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:17.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:17.908330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:17.908330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:17.908330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:17.908330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:17.908330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:17.908330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:17.908330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:17.908330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:17.908330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:16:17.908330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:17.911023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 370/729] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Jun 17 07:16:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:17.916593 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83254c65-ef96-4ef7-9d05-817f7a460e6c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:17.918458 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb5b94-2382-486b-8653-5d1453bbc852 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:18.011015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77432b5-b089-4ed6-9285-f64440ca9602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:18.011624 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77432b5-b089-4ed6-9285-f64440ca9602 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:18.011908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77432b5-b089-4ed6-9285-f64440ca9602 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:18.012183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77432b5-b089-4ed6-9285-f64440ca9602 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:18.013601 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77432b5-b089-4ed6-9285-f64440ca9602 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:18.013933 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77432b5-b089-4ed6-9285-f64440ca9602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:18.015395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77432b5-b089-4ed6-9285-f64440ca9602 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:18.023514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83254c65-ef96-4ef7-9d05-817f7a460e6c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:18.032295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 360/730] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:16:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:18.039762 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77432b5-b089-4ed6-9285-f64440ca9602 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:18.075962 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e517f-cb28-4ff6-9512-1949afd6cada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:18.082164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e517f-cb28-4ff6-9512-1949afd6cada None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:18.082451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e517f-cb28-4ff6-9512-1949afd6cada None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:18.082734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e517f-cb28-4ff6-9512-1949afd6cada None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:18.083595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e517f-cb28-4ff6-9512-1949afd6cada None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:18.083949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e517f-cb28-4ff6-9512-1949afd6cada None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:18.085682 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e517f-cb28-4ff6-9512-1949afd6cada None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:18.131353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 371/731] 10.222.0.52 () {56 vars in 1149 bytes} [Fri Jun 17 07:16:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:18.136995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e517f-cb28-4ff6-9512-1949afd6cada None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:18.249925 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77432b5-b089-4ed6-9285-f64440ca9602 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:18.262389 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:18.297657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:18.308914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2ab5c-d19e-45e8-912d-63494ec0da97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:18.309845 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2ab5c-d19e-45e8-912d-63494ec0da97 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:18.310097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2ab5c-d19e-45e8-912d-63494ec0da97 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:18.310411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2ab5c-d19e-45e8-912d-63494ec0da97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:18.321890 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2ab5c-d19e-45e8-912d-63494ec0da97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:18.323450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2ab5c-d19e-45e8-912d-63494ec0da97 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:18.332733 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e517f-cb28-4ff6-9512-1949afd6cada None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:18.341990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-bac2ab5c-d19e-45e8-912d-63494ec0da97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:18.341990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:18.341990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:18.341990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:18.341990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:18.341990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:18.341990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:18.341990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:18.341990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:18.341990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:18.341990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:18.341990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:18.341990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:18.341990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:18.341990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:18.343104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:18.343104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:18.343104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:18.343104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:18.343104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:18.343104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:18.343104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:18.343104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:18.343104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:18.343104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:18.343104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:18.343104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:18.343104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:18.343104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:18.343104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:18.343104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:18.343104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:18.344029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:18.344029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:18.344029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:18.344029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:18.344029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 361/732] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:18.344960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b26cd2-3726-459e-8723-7b51cc8e0efc None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:18.345244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b26cd2-3726-459e-8723-7b51cc8e0efc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:18.345545 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b26cd2-3726-459e-8723-7b51cc8e0efc None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:18.351174 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 362/733] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:18.352078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b26cd2-3726-459e-8723-7b51cc8e0efc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:18.374389 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751f835-4ce1-45a1-a326-d1ce4d42cb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:18.375040 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751f835-4ce1-45a1-a326-d1ce4d42cb76 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:18.375321 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751f835-4ce1-45a1-a326-d1ce4d42cb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:18.375597 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751f835-4ce1-45a1-a326-d1ce4d42cb76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:18.472433 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751f835-4ce1-45a1-a326-d1ce4d42cb76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:18.473968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751f835-4ce1-45a1-a326-d1ce4d42cb76 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:18.492231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b26cd2-3726-459e-8723-7b51cc8e0efc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:18.523377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:18.534397 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ac944-6052-4113-930a-8f91b01b67f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:18.535069 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ac944-6052-4113-930a-8f91b01b67f4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:18.535353 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ac944-6052-4113-930a-8f91b01b67f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:18.535632 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ac944-6052-4113-930a-8f91b01b67f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:18.536358 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ac944-6052-4113-930a-8f91b01b67f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:18.536667 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ac944-6052-4113-930a-8f91b01b67f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:18.538072 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ac944-6052-4113-930a-8f91b01b67f4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:18.551501 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 363/734] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:18.552855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9ebdc-b3be-432b-bd3c-95f2322a5490 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:18.553145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9ebdc-b3be-432b-bd3c-95f2322a5490 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:18.553457 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9ebdc-b3be-432b-bd3c-95f2322a5490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:18.572602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4fe9ebdc-b3be-432b-bd3c-95f2322a5490 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:18.573872 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4fe9ebdc-b3be-432b-bd3c-95f2322a5490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:18.589927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 372/735] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:16:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:16:18.592315 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c8830-8ac1-433d-b298-e8406834e3fa None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:18.592599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c8830-8ac1-433d-b298-e8406834e3fa None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:18.592868 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c8830-8ac1-433d-b298-e8406834e3fa None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:18.598144 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 373/736] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:18.598144 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c8830-8ac1-433d-b298-e8406834e3fa None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:18.613785 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:18.652719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 364/737] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:16:18.653613 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9ebdc-b3be-432b-bd3c-95f2322a5490 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:18.707824 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c8830-8ac1-433d-b298-e8406834e3fa None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:18.741840 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64780c80-de5d-4ce7-905e-b05ae2b0bdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:18.742624 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64780c80-de5d-4ce7-905e-b05ae2b0bdc2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:18.743151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64780c80-de5d-4ce7-905e-b05ae2b0bdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:18.743151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64780c80-de5d-4ce7-905e-b05ae2b0bdc2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:18.750968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64780c80-de5d-4ce7-905e-b05ae2b0bdc2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:18.752412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64780c80-de5d-4ce7-905e-b05ae2b0bdc2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:18.758759 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9ebdc-b3be-432b-bd3c-95f2322a5490 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:18.766794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-64780c80-de5d-4ce7-905e-b05ae2b0bdc2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:16:18.766794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:18.766794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:18.766794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:18.766794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:18.766794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:18.766794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:18.766794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:18.766794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:18.766794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:18.766794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:18.766794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:18.766794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:18.766794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:18.766794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:18.766794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:18.767819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:18.768804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:18.768804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:18.768804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:18.768804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:18.768804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:18.768804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:18.768804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:18.768804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:18.768804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:16:18.768804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:18.768804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 374/738] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:16:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:18.769441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285c74-6f86-4a48-a827-addc4e3e3e17 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:18.769441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285c74-6f86-4a48-a827-addc4e3e3e17 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:18.769740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285c74-6f86-4a48-a827-addc4e3e3e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:18.779901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:18.785745 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-02285c74-6f86-4a48-a827-addc4e3e3e17 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:18.786913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-02285c74-6f86-4a48-a827-addc4e3e3e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:18.796990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623e299-5946-46ff-8ad2-8cc9e2288767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:18.797817 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e299-5946-46ff-8ad2-8cc9e2288767 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:18.809088 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e299-5946-46ff-8ad2-8cc9e2288767 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:18.809088 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e299-5946-46ff-8ad2-8cc9e2288767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:18.809088 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e299-5946-46ff-8ad2-8cc9e2288767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:18.809885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e299-5946-46ff-8ad2-8cc9e2288767 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:18.827689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8623e299-5946-46ff-8ad2-8cc9e2288767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:18.827689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:18.827689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:18.827689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:18.827689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:18.827689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:18.827689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:18.827689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:18.827689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:18.827689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:18.827689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:18.827689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:18.827689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:18.827689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:18.827689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:18.828593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:18.828593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:18.828593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:18.828593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:18.828593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:18.828593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:18.828593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:18.828593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:18.828593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:18.828593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:18.828593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:18.828593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:18.828593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:18.828593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:18.828593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:18.828593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:18.828593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:18.829511 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:18.829511 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:18.829511 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:18.829511 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:18.829511 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 365/739] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:18.830213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebb87c-9857-42d4-8b61-a1b337066a7b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:18.830448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebb87c-9857-42d4-8b61-a1b337066a7b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:18.830732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebb87c-9857-42d4-8b61-a1b337066a7b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:18.832102 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 366/740] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:18.832653 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebb87c-9857-42d4-8b61-a1b337066a7b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:18.853306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:18.856674 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 375/741] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:16:18.857915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02285c74-6f86-4a48-a827-addc4e3e3e17 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:18.940165 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebb87c-9857-42d4-8b61-a1b337066a7b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:18.957877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02285c74-6f86-4a48-a827-addc4e3e3e17 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:18.976113 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588511c-76fc-4ada-bab8-3aa52d4b68d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:18.976771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588511c-76fc-4ada-bab8-3aa52d4b68d8 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:18.977048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588511c-76fc-4ada-bab8-3aa52d4b68d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:18.977316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588511c-76fc-4ada-bab8-3aa52d4b68d8 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:18.978048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588511c-76fc-4ada-bab8-3aa52d4b68d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:18.979397 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588511c-76fc-4ada-bab8-3aa52d4b68d8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:18.991692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741127c7-746d-4a3d-ac6b-44cc37d0b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:18.992363 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741127c7-746d-4a3d-ac6b-44cc37d0b45b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:18.992646 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741127c7-746d-4a3d-ac6b-44cc37d0b45b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:18.992923 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741127c7-746d-4a3d-ac6b-44cc37d0b45b None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:18.993795 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741127c7-746d-4a3d-ac6b-44cc37d0b45b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:18.994102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741127c7-746d-4a3d-ac6b-44cc37d0b45b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:18.995533 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741127c7-746d-4a3d-ac6b-44cc37d0b45b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:18.998689 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:19.012816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 376/742] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Jun 17 07:16:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:19.014473 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741127c7-746d-4a3d-ac6b-44cc37d0b45b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:19.048788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 367/743] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Jun 17 07:16:18 2022] POST /identity/v3/services => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:16:19.050198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8992c-a783-4646-913c-58d3c0a16d83 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:19.050489 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8992c-a783-4646-913c-58d3c0a16d83 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:19.050768 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8992c-a783-4646-913c-58d3c0a16d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:19.068922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b7c8992c-a783-4646-913c-58d3c0a16d83 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:19.070219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b7c8992c-a783-4646-913c-58d3c0a16d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:19.127756 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741127c7-746d-4a3d-ac6b-44cc37d0b45b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:19.169636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 368/744] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:16:19.169636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8992c-a783-4646-913c-58d3c0a16d83 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:19.174244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:19.181795 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb5a5a-5e3f-4557-a214-0612aace80bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:19.182834 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb5a5a-5e3f-4557-a214-0612aace80bf None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:19.183324 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb5a5a-5e3f-4557-a214-0612aace80bf None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:19.183851 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb5a5a-5e3f-4557-a214-0612aace80bf None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:19.185689 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb5a5a-5e3f-4557-a214-0612aace80bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:19.186605 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb5a5a-5e3f-4557-a214-0612aace80bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:19.188329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb5a5a-5e3f-4557-a214-0612aace80bf None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:19.203641 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 377/745] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:19.204618 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb5a5a-5e3f-4557-a214-0612aace80bf None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:19.288422 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:19.330759 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8992c-a783-4646-913c-58d3c0a16d83 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:19.335824 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb5a5a-5e3f-4557-a214-0612aace80bf None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:19.369310 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cebd4-9e53-4aa4-b650-c9272e00951d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:19.370574 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cebd4-9e53-4aa4-b650-c9272e00951d None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:19.371087 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cebd4-9e53-4aa4-b650-c9272e00951d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:19.371491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975102fa-d46b-4ed3-9963-3ea2e3a41364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:19.371789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cebd4-9e53-4aa4-b650-c9272e00951d None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:19.372134 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975102fa-d46b-4ed3-9963-3ea2e3a41364 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:19.372443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975102fa-d46b-4ed3-9963-3ea2e3a41364 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:19.372717 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975102fa-d46b-4ed3-9963-3ea2e3a41364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:19.373750 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cebd4-9e53-4aa4-b650-c9272e00951d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:19.375459 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cebd4-9e53-4aa4-b650-c9272e00951d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:19.446347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975102fa-d46b-4ed3-9963-3ea2e3a41364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:19.448182 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975102fa-d46b-4ed3-9963-3ea2e3a41364 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:19.453769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 369/746] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Jun 17 07:16:19 2022] POST /identity/v3/services => generated 240 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:16:19.454789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cebd4-9e53-4aa4-b650-c9272e00951d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:19.532342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:19.598543 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:19.646159 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 378/747] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:16:19 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:16:19.648008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975102fa-d46b-4ed3-9963-3ea2e3a41364 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:19.662261 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cebd4-9e53-4aa4-b650-c9272e00951d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:19.703388 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eabe23-fd23-49ea-b97d-dae297559c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:19.704183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eabe23-fd23-49ea-b97d-dae297559c69 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:19.704457 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eabe23-fd23-49ea-b97d-dae297559c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:19.704728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eabe23-fd23-49ea-b97d-dae297559c69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:19.715442 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eabe23-fd23-49ea-b97d-dae297559c69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:19.726237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-26eabe23-fd23-49ea-b97d-dae297559c69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:16:19.726237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:19.726237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:19.726237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:19.726237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:19.726237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:19.726237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:19.726237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:19.726237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:19.726237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:19.726237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:19.726237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:19.726237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:19.726237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:19.726237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:19.726237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:19.727395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:19.727395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:19.727395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:19.727395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:19.727395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:19.727395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:19.727395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:19.727395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:19.727395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:19.727395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:19.727395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:19.727395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:19.727395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:19.727395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:19.727395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:19.727395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:19.728317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:19.728317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:19.728317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:19.728317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:19.728317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:19.728317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:19.728317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:19.728317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:19.728317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:19.728317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:19.728317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:16:19.728317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:19.728317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 370/748] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:16:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:19.729122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eabe23-fd23-49ea-b97d-dae297559c69 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:19.773629 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975102fa-d46b-4ed3-9963-3ea2e3a41364 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:19.811827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaed3f7-1fdf-4e2f-b2d8-6b028bf9bd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:19.812930 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaed3f7-1fdf-4e2f-b2d8-6b028bf9bd6d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:19.813389 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaed3f7-1fdf-4e2f-b2d8-6b028bf9bd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:19.813838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaed3f7-1fdf-4e2f-b2d8-6b028bf9bd6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:19.820924 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaed3f7-1fdf-4e2f-b2d8-6b028bf9bd6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:19.822412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaed3f7-1fdf-4e2f-b2d8-6b028bf9bd6d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:19.841741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-acaed3f7-1fdf-4e2f-b2d8-6b028bf9bd6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:19.841741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:19.841741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:19.841741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:19.841741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:19.841741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:19.841741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:19.841741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:19.841741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:19.841741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:19.841741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:19.841741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:19.841741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:19.841741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:19.841741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:19.842749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:19.842749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:19.842749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:19.842749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:19.842749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:19.842749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:19.842749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:19.842749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:19.842749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:19.842749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:19.842749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:19.842749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:19.842749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:19.842749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:19.842749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:19.842749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:19.842749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:19.843655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:19.843655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:19.843655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:19.843655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:19.843655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:19.843655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:19.843655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:19.843655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:19.843655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 379/749] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:19.844617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaed3f7-1fdf-4e2f-b2d8-6b028bf9bd6d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:19.862296 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:19.864036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eabe23-fd23-49ea-b97d-dae297559c69 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:19.895326 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:19.901969 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b22e04-bcd1-487e-ba1b-6c38093187c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:19.903068 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b22e04-bcd1-487e-ba1b-6c38093187c1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:19.904194 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b22e04-bcd1-487e-ba1b-6c38093187c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:19.904784 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b22e04-bcd1-487e-ba1b-6c38093187c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:19.916470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b22e04-bcd1-487e-ba1b-6c38093187c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:19.918262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b22e04-bcd1-487e-ba1b-6c38093187c1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:19.938836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-14b22e04-bcd1-487e-ba1b-6c38093187c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:19.938836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:19.938836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:19.938836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:19.938836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:19.938836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:19.938836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:19.938836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:19.938836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:19.938836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:19.938836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:19.938836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:19.938836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:19.938836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:19.938836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:19.939814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:19.939814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:19.939814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:19.939814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:19.939814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:19.939814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:19.939814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:19.939814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:19.939814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:19.939814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:19.939814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:19.939814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:19.939814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:19.939814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:19.939814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:19.939814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:19.939814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:19.940709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:19.940709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:19.940709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:19.940709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:19.947433 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 371/750] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:19.948658 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b22e04-bcd1-487e-ba1b-6c38093187c1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:19.954578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaed3f7-1fdf-4e2f-b2d8-6b028bf9bd6d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:19.991789 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ab6eb-956f-4bd3-a778-65b606a58f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:19.992541 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ab6eb-956f-4bd3-a778-65b606a58f5b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:19.992827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ab6eb-956f-4bd3-a778-65b606a58f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:19.993100 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ab6eb-956f-4bd3-a778-65b606a58f5b None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:19.993935 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ab6eb-956f-4bd3-a778-65b606a58f5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:19.994244 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ab6eb-956f-4bd3-a778-65b606a58f5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:19.995615 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ab6eb-956f-4bd3-a778-65b606a58f5b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:20.005015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 380/751] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:16:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:20.005868 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ab6eb-956f-4bd3-a778-65b606a58f5b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:20.057894 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b22e04-bcd1-487e-ba1b-6c38093187c1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:20.093173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a287baa-9837-4539-adf7-ea9335730155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:20.094251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a287baa-9837-4539-adf7-ea9335730155 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:20.094739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a287baa-9837-4539-adf7-ea9335730155 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:20.095218 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a287baa-9837-4539-adf7-ea9335730155 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:20.096203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a287baa-9837-4539-adf7-ea9335730155 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:20.096714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a287baa-9837-4539-adf7-ea9335730155 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:20.098466 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a287baa-9837-4539-adf7-ea9335730155 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:20.101433 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:20.112681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 372/752] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:20.113915 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a287baa-9837-4539-adf7-ea9335730155 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:20.130453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ab6eb-956f-4bd3-a778-65b606a58f5b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:20.147252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:20.177931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddcc33-3cf0-4fe3-8b1b-0fe7490d7412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:20.179106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddcc33-3cf0-4fe3-8b1b-0fe7490d7412 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:20.179396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddcc33-3cf0-4fe3-8b1b-0fe7490d7412 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:20.179675 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddcc33-3cf0-4fe3-8b1b-0fe7490d7412 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:20.180679 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddcc33-3cf0-4fe3-8b1b-0fe7490d7412 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:20.180993 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddcc33-3cf0-4fe3-8b1b-0fe7490d7412 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:20.182585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddcc33-3cf0-4fe3-8b1b-0fe7490d7412 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:20.203952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 381/753] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:20.203952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddcc33-3cf0-4fe3-8b1b-0fe7490d7412 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:20.228018 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a287baa-9837-4539-adf7-ea9335730155 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:20.268546 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3ffcb-55ce-4ecf-92f6-f8c62f8af105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:20.269743 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3ffcb-55ce-4ecf-92f6-f8c62f8af105 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:20.270231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3ffcb-55ce-4ecf-92f6-f8c62f8af105 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:20.270765 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3ffcb-55ce-4ecf-92f6-f8c62f8af105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:20.281838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3ffcb-55ce-4ecf-92f6-f8c62f8af105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:20.283568 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3ffcb-55ce-4ecf-92f6-f8c62f8af105 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:20.302788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b3c3ffcb-55ce-4ecf-92f6-f8c62f8af105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:20.302788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:20.302788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:20.302788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:20.302788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:20.302788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:20.302788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:20.302788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:20.302788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:20.302788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:20.302788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:20.302788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:20.302788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:20.302788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:20.302788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:20.303733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:20.303733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:20.303733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:20.303733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:20.303733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:20.303733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:20.303733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:20.303733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:20.303733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:20.303733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:20.303733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:20.303733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:20.303733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:20.303733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:20.303733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:20.303733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:20.303733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:20.304651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:20.304651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:20.304651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:20.304651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:20.306599 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 373/754] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:20.307582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3ffcb-55ce-4ecf-92f6-f8c62f8af105 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:20.344272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddcc33-3cf0-4fe3-8b1b-0fe7490d7412 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:20.392231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02419cdf-a056-4dbd-b3d8-5fd2253c0fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:20.393270 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419cdf-a056-4dbd-b3d8-5fd2253c0fce None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:20.393582 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419cdf-a056-4dbd-b3d8-5fd2253c0fce None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:20.393858 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419cdf-a056-4dbd-b3d8-5fd2253c0fce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:20.394693 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02419cdf-a056-4dbd-b3d8-5fd2253c0fce None admin] RBAC: Adding query filter params (role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=9144d74a341b4e08ae353b384fe1186e) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:20.395030 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02419cdf-a056-4dbd-b3d8-5fd2253c0fce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:20.397271 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02419cdf-a056-4dbd-b3d8-5fd2253c0fce None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:20.401264 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:20.402432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:20.406542 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 382/755] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:16:20 2022] GET /identity/v3/role_assignments?user.id=9144d74a341b4e08ae353b384fe1186e&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:20.407357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02419cdf-a056-4dbd-b3d8-5fd2253c0fce None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:20.421154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3ffcb-55ce-4ecf-92f6-f8c62f8af105 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:20.489446 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8abbef-10b9-4c26-938e-50a819a3d8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:20.490678 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8abbef-10b9-4c26-938e-50a819a3d8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:20.491164 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8abbef-10b9-4c26-938e-50a819a3d8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:20.491653 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8abbef-10b9-4c26-938e-50a819a3d8e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:20.503180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8abbef-10b9-4c26-938e-50a819a3d8e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:20.505933 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8abbef-10b9-4c26-938e-50a819a3d8e2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:20.530884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-dc8abbef-10b9-4c26-938e-50a819a3d8e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:20.530884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:20.530884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:20.530884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:20.530884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:20.530884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:20.530884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:20.530884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:20.530884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:20.530884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:20.530884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:20.530884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:20.530884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:20.530884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:20.530884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:20.531858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:20.531858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:20.531858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:20.531858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:20.531858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:20.531858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:20.531858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:20.531858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:20.531858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:20.531858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:20.531858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:20.531858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:20.531858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:20.531858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:20.531858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:20.531858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:20.531858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:20.532769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:20.532769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:20.532769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:20.532769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:20.532769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:20.532769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:20.532769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:20.532769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:20.543757 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 374/756] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:20.554818 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8abbef-10b9-4c26-938e-50a819a3d8e2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:20.618059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02419cdf-a056-4dbd-b3d8-5fd2253c0fce None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:20.691189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3eb4fa-6308-4f7c-ad3f-4d9308394b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:20.691749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3eb4fa-6308-4f7c-ad3f-4d9308394b5c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:20.692034 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3eb4fa-6308-4f7c-ad3f-4d9308394b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:20.692311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3eb4fa-6308-4f7c-ad3f-4d9308394b5c None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:20.693041 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3eb4fa-6308-4f7c-ad3f-4d9308394b5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:20.693372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3eb4fa-6308-4f7c-ad3f-4d9308394b5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:20.694765 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3eb4fa-6308-4f7c-ad3f-4d9308394b5c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:20.719863 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 383/757] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:20.725802 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3eb4fa-6308-4f7c-ad3f-4d9308394b5c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:20.749045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8abbef-10b9-4c26-938e-50a819a3d8e2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:20.829777 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:20.880757 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3eb4fa-6308-4f7c-ad3f-4d9308394b5c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:20.917704 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d25c6-e7cf-48ea-a560-952fa9363f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:20.918515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d25c6-e7cf-48ea-a560-952fa9363f93 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:20.918798 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d25c6-e7cf-48ea-a560-952fa9363f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:20.919646 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d25c6-e7cf-48ea-a560-952fa9363f93 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:20.937709 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d25c6-e7cf-48ea-a560-952fa9363f93 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:20.939090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d25c6-e7cf-48ea-a560-952fa9363f93 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:20.958240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-c55d25c6-e7cf-48ea-a560-952fa9363f93 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:16:20.958240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:20.958240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:20.958240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:20.958240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:20.958240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:20.958240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:20.958240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:20.958240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:20.958240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:20.958240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:20.958240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:20.958240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:20.958240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:20.958240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:20.958240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:20.959252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:20.960206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:20.960206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:20.960206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:20.960206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:20.960206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:20.960206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:20.960206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:20.960206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:20.960206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:16:20.960206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:20.960206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 384/758] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Jun 17 07:16:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:20.966654 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d25c6-e7cf-48ea-a560-952fa9363f93 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:21.018446 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c2464-2626-4d26-82f9-9b137ee6284d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:21.019477 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c2464-2626-4d26-82f9-9b137ee6284d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:21.019979 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c2464-2626-4d26-82f9-9b137ee6284d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:21.020467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c2464-2626-4d26-82f9-9b137ee6284d None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:21.021544 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c2464-2626-4d26-82f9-9b137ee6284d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:21.022082 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c2464-2626-4d26-82f9-9b137ee6284d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:21.023814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c2464-2626-4d26-82f9-9b137ee6284d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:21.037604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 375/759] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:21.043671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c2464-2626-4d26-82f9-9b137ee6284d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:21.048465 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:21.114459 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d25c6-e7cf-48ea-a560-952fa9363f93 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:21.143288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:21.152591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcd9ac-596f-488c-8f3e-7bfef6fa90a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:21.153260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcd9ac-596f-488c-8f3e-7bfef6fa90a3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:21.153614 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcd9ac-596f-488c-8f3e-7bfef6fa90a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:21.153895 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcd9ac-596f-488c-8f3e-7bfef6fa90a3 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:21.154973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcd9ac-596f-488c-8f3e-7bfef6fa90a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:21.155276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcd9ac-596f-488c-8f3e-7bfef6fa90a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:21.156761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcd9ac-596f-488c-8f3e-7bfef6fa90a3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:21.177512 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 385/760] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Jun 17 07:16:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:21.183638 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcd9ac-596f-488c-8f3e-7bfef6fa90a3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:21.292987 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcd9ac-596f-488c-8f3e-7bfef6fa90a3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:21.315343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c2464-2626-4d26-82f9-9b137ee6284d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:21.330906 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2882722-d093-4d95-9044-2a42ec1c706e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:21.337371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2882722-d093-4d95-9044-2a42ec1c706e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:21.337371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2882722-d093-4d95-9044-2a42ec1c706e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:21.337371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2882722-d093-4d95-9044-2a42ec1c706e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:21.346145 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2882722-d093-4d95-9044-2a42ec1c706e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:21.348256 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2882722-d093-4d95-9044-2a42ec1c706e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:21.369902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-a2882722-d093-4d95-9044-2a42ec1c706e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:21.369902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:21.369902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:21.369902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:21.369902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:21.369902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:21.369902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:21.369902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:21.369902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:21.369902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:21.369902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:21.369902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:21.369902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:21.369902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:21.369902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:21.370879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:21.370879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:21.370879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:21.370879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:21.370879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:21.370879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:21.370879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:21.370879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:21.370879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:21.370879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:21.370879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:21.370879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:21.370879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:21.370879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:21.370879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:21.370879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:21.370879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:21.371776 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:21.371776 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:21.371776 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:21.371776 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:21.371776 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 386/761] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:21.377570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2882722-d093-4d95-9044-2a42ec1c706e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:21.411082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:21.425867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cd246-2612-48bd-a1a3-67c58b4f6a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:21.426541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cd246-2612-48bd-a1a3-67c58b4f6a19 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:21.427150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cd246-2612-48bd-a1a3-67c58b4f6a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:21.427435 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cd246-2612-48bd-a1a3-67c58b4f6a19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:21.428613 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3cd246-2612-48bd-a1a3-67c58b4f6a19 None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=a18b07c033224d2085773936dad33eec) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:21.428935 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3cd246-2612-48bd-a1a3-67c58b4f6a19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:21.430967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3cd246-2612-48bd-a1a3-67c58b4f6a19 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:21.438770 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 376/762] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:16:21 2022] GET /identity/v3/role_assignments?user.id=a18b07c033224d2085773936dad33eec&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 259 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:21.441233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bd556-bc45-42f8-a3e1-48e3055ed333 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:21.441554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bd556-bc45-42f8-a3e1-48e3055ed333 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:21.441833 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bd556-bc45-42f8-a3e1-48e3055ed333 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:21.444218 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 377/763] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:21.457645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aa899-ce54-4433-a6ef-551bea238bcc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:21.457981 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aa899-ce54-4433-a6ef-551bea238bcc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:21.458207 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aa899-ce54-4433-a6ef-551bea238bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:21.501984 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2882722-d093-4d95-9044-2a42ec1c706e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:21.506543 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4e2aa899-ce54-4433-a6ef-551bea238bcc None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:21.507788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4e2aa899-ce54-4433-a6ef-551bea238bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:21.541967 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df15e28-4c67-45fa-9fb5-e923912a5d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:21.542642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df15e28-4c67-45fa-9fb5-e923912a5d9f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:21.542921 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df15e28-4c67-45fa-9fb5-e923912a5d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:21.543249 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df15e28-4c67-45fa-9fb5-e923912a5d9f None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:21.543914 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df15e28-4c67-45fa-9fb5-e923912a5d9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:21.544395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df15e28-4c67-45fa-9fb5-e923912a5d9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:21.546069 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df15e28-4c67-45fa-9fb5-e923912a5d9f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:21.558980 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 387/764] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:21.566438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df15e28-4c67-45fa-9fb5-e923912a5d9f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:21.644740 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 378/765] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:21.645727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:21.667948 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aa899-ce54-4433-a6ef-551bea238bcc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:21.692066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:21.704146 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df15e28-4c67-45fa-9fb5-e923912a5d9f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:21.742585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f6f72-d61f-4d36-b836-2166128c9cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:21.743387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6f72-d61f-4d36-b836-2166128c9cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:21.743669 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6f72-d61f-4d36-b836-2166128c9cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:21.743946 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6f72-d61f-4d36-b836-2166128c9cf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:21.752287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f6f72-d61f-4d36-b836-2166128c9cf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:21.753771 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f6f72-d61f-4d36-b836-2166128c9cf7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:21.782266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-4e6f6f72-d61f-4d36-b836-2166128c9cf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:21.782266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:21.782266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:21.782266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:21.782266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:21.782266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:21.782266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:21.782266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:21.782266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:21.782266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:21.782266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:21.782266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:21.782266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:21.782266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:21.782266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:21.783226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:21.783226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:21.783226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:21.783226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:21.783226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:21.783226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:21.783226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:21.783226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:21.783226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:21.783226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:21.783226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:21.783226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:21.783226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:21.783226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:21.783226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:21.783226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:21.783226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:21.784565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:21.784565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:21.784565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:21.784565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:21.784565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:21.784565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:21.784565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:21.784565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:21.784565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 388/766] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:21.789282 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f6f72-d61f-4d36-b836-2166128c9cf7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:21.856302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aa899-ce54-4433-a6ef-551bea238bcc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:21.924854 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880be0c-34df-4461-906a-d5638df25918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:21.927011 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880be0c-34df-4461-906a-d5638df25918 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:21.927661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880be0c-34df-4461-906a-d5638df25918 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:21.929280 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880be0c-34df-4461-906a-d5638df25918 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:21.930179 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880be0c-34df-4461-906a-d5638df25918 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:21.932049 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880be0c-34df-4461-906a-d5638df25918 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:21.961399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9880be0c-34df-4461-906a-d5638df25918 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:16:21.961399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:21.961399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:21.961399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:21.961399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:21.961399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:21.961399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:21.961399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:21.961399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:16:21.961399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:21.961399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:21.961399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:21.961399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:21.961399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:21.961399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:21.961399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:21.962423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:21.962423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:21.962423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:21.962423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:21.962423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:21.962423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:21.962423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:21.962423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:21.962423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:21.962423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:21.962423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:21.962423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:21.962423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:21.962423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:21.962423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:21.962423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:21.963295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:21.963295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:21.963295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:21.963295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:21.963295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:21.963295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:21.963295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:21.963295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:21.963295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:21.963295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:21.963295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:21.963295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:21.963295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:21.963295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:16:21.963295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:21.970956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 379/767] 10.222.0.52 () {56 vars in 1129 bytes} [Fri Jun 17 07:16:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:21.980469 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880be0c-34df-4461-906a-d5638df25918 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:21.995001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f6f72-d61f-4d36-b836-2166128c9cf7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:22.032783 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76059af5-a896-44e5-9e12-8f9bf47523ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:22.033557 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76059af5-a896-44e5-9e12-8f9bf47523ee None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:22.034164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76059af5-a896-44e5-9e12-8f9bf47523ee None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:22.034274 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76059af5-a896-44e5-9e12-8f9bf47523ee None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:22.034995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76059af5-a896-44e5-9e12-8f9bf47523ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:22.035309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76059af5-a896-44e5-9e12-8f9bf47523ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:22.036915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76059af5-a896-44e5-9e12-8f9bf47523ee None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:22.050921 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 389/768] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:22.052232 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710b9d3-8681-46dc-9fdf-50577fab5d64 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:22.052558 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710b9d3-8681-46dc-9fdf-50577fab5d64 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:22.052843 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710b9d3-8681-46dc-9fdf-50577fab5d64 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:22.059249 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 390/769] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:22.062416 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710b9d3-8681-46dc-9fdf-50577fab5d64 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:22.078030 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:22.094290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:22.133422 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880be0c-34df-4461-906a-d5638df25918 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:22.170235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ce5a0-218a-4ca8-bb5e-e53cf34cdfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:22.171194 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ce5a0-218a-4ca8-bb5e-e53cf34cdfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:22.171621 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ce5a0-218a-4ca8-bb5e-e53cf34cdfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:22.172035 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ce5a0-218a-4ca8-bb5e-e53cf34cdfa7 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:22.172971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ce5a0-218a-4ca8-bb5e-e53cf34cdfa7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:22.173457 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ce5a0-218a-4ca8-bb5e-e53cf34cdfa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:22.175074 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ce5a0-218a-4ca8-bb5e-e53cf34cdfa7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:22.177849 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710b9d3-8681-46dc-9fdf-50577fab5d64 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:22.185609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 380/770] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Jun 17 07:16:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:22.188244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f70f68-a086-485c-8254-c5ebaaa52829 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:22.188988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f70f68-a086-485c-8254-c5ebaaa52829 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:22.189571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f70f68-a086-485c-8254-c5ebaaa52829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:22.207910 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-62f70f68-a086-485c-8254-c5ebaaa52829 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:22.209529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-62f70f68-a086-485c-8254-c5ebaaa52829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:22.217504 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ecf21-bfd7-4322-9ce6-0cc5a1b3c66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:22.218609 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ecf21-bfd7-4322-9ce6-0cc5a1b3c66b None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:22.218987 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ecf21-bfd7-4322-9ce6-0cc5a1b3c66b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:22.219407 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ecf21-bfd7-4322-9ce6-0cc5a1b3c66b None admin] PATH_INFO: `/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/88e1572d22c048b09699a2fe50900f92/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:22.221645 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ecf21-bfd7-4322-9ce6-0cc5a1b3c66b None admin] RBAC: Authorizing `identity:create_grant(project_id=0dffdba97abf4f59b12c4fbdc6245e9e, user_id=88e1572d22c048b09699a2fe50900f92, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:22.223335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ecf21-bfd7-4322-9ce6-0cc5a1b3c66b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:22.280903 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 381/771] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:22.282096 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f70f68-a086-485c-8254-c5ebaaa52829 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:22.299758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 391/772] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:16:22 2022] PUT /identity/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/88e1572d22c048b09699a2fe50900f92/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:16:22.346980 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ecf21-bfd7-4322-9ce6-0cc5a1b3c66b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:22.373201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:22.446614 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:22.468081 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f70f68-a086-485c-8254-c5ebaaa52829 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:22.495981 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ecf21-bfd7-4322-9ce6-0cc5a1b3c66b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:22.532371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b7671-29bb-42d0-9c08-ead4ed3152e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:22.533097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b7671-29bb-42d0-9c08-ead4ed3152e8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:22.533411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b7671-29bb-42d0-9c08-ead4ed3152e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:22.533685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b7671-29bb-42d0-9c08-ead4ed3152e8 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:22.534387 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b7671-29bb-42d0-9c08-ead4ed3152e8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:22.534690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b7671-29bb-42d0-9c08-ead4ed3152e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:22.536051 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b7671-29bb-42d0-9c08-ead4ed3152e8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:22.545301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 382/773] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Jun 17 07:16:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:22.550062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b7671-29bb-42d0-9c08-ead4ed3152e8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:22.562223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd2a17-d343-4c28-b13b-57832aa09555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:22.562932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd2a17-d343-4c28-b13b-57832aa09555 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:22.563218 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd2a17-d343-4c28-b13b-57832aa09555 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:22.563499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd2a17-d343-4c28-b13b-57832aa09555 None admin] PATH_INFO: `/v3/services/network` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:22.564159 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd2a17-d343-4c28-b13b-57832aa09555 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:22.565980 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd2a17-d343-4c28-b13b-57832aa09555 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:22.585112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-92dd2a17-d343-4c28-b13b-57832aa09555 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:16:22.585112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:22.585112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:22.585112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:22.585112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:22.585112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:22.585112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:22.585112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:22.585112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:16:22.585112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:22.585112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:22.585112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:22.585112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:22.585112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:22.585112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:22.585112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:22.585112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:22.586205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:22.586205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:22.586205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:22.586205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:22.586205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:22.586205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:22.586205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:22.586205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:22.586205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:22.586205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:22.586205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:22.586205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:22.586205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:22.586205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:22.586205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:22.586205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:22.587067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:22.587067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:22.587067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:22.587067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:22.587067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:22.587067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:22.587067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:22.587067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:22.587067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:22.587067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:22.587067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:22.587067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:22.587067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:16:22.587067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:22.587067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 392/774] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:22 2022] GET /identity/v3/services/network => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:22.593493 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd2a17-d343-4c28-b13b-57832aa09555 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:22.724541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b7671-29bb-42d0-9c08-ead4ed3152e8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:22.769689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:22.796840 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd2a17-d343-4c28-b13b-57832aa09555 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:22.800282 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cc785-f20f-4880-9fcd-db49d4a0bec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:22.801225 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cc785-f20f-4880-9fcd-db49d4a0bec1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:22.801734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cc785-f20f-4880-9fcd-db49d4a0bec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:22.802190 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cc785-f20f-4880-9fcd-db49d4a0bec1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:22.803179 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cc785-f20f-4880-9fcd-db49d4a0bec1 None admin] RBAC: Adding query filter params (interface=public, service_id=55feb9fcc9d14346958ce77b7a53a6ec, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:22.803670 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cc785-f20f-4880-9fcd-db49d4a0bec1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:22.805248 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cc785-f20f-4880-9fcd-db49d4a0bec1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:22.815247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 383/775] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Jun 17 07:16:22 2022] GET /identity/v3/endpoints?service_id=55feb9fcc9d14346958ce77b7a53a6ec&interface=public®ion_id=RegionOne => generated 194 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:22.816834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568b1cc-e8b2-49df-a360-9dc8540fd515 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:22.817279 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568b1cc-e8b2-49df-a360-9dc8540fd515 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:22.817724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568b1cc-e8b2-49df-a360-9dc8540fd515 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:22.823381 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 384/776] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:22.824438 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568b1cc-e8b2-49df-a360-9dc8540fd515 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:22.837240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbb2dd-fec5-4e16-bb01-7c4c2dbf88a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:22.838113 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbb2dd-fec5-4e16-bb01-7c4c2dbf88a3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:22.838500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbb2dd-fec5-4e16-bb01-7c4c2dbf88a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:22.838847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbb2dd-fec5-4e16-bb01-7c4c2dbf88a3 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:22.839675 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbb2dd-fec5-4e16-bb01-7c4c2dbf88a3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:22.840050 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbb2dd-fec5-4e16-bb01-7c4c2dbf88a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:22.842459 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbb2dd-fec5-4e16-bb01-7c4c2dbf88a3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:22.843820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:22.848692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 393/777] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Jun 17 07:16:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:22.850185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd72c2d-a6bb-4f94-9c10-c24c8fed8781 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:22.850531 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd72c2d-a6bb-4f94-9c10-c24c8fed8781 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:22.850817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd72c2d-a6bb-4f94-9c10-c24c8fed8781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:22.869144 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-efd72c2d-a6bb-4f94-9c10-c24c8fed8781 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:22.870668 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-efd72c2d-a6bb-4f94-9c10-c24c8fed8781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:22.949357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 394/778] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:22.949357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd72c2d-a6bb-4f94-9c10-c24c8fed8781 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:22.974994 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568b1cc-e8b2-49df-a360-9dc8540fd515 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:23.027541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce585d3-309a-4104-bde5-3f0001dbbd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:23.029202 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce585d3-309a-4104-bde5-3f0001dbbd8f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:23.029557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce585d3-309a-4104-bde5-3f0001dbbd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:23.030023 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce585d3-309a-4104-bde5-3f0001dbbd8f None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:23.031031 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce585d3-309a-4104-bde5-3f0001dbbd8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:23.033056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce585d3-309a-4104-bde5-3f0001dbbd8f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:23.041090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 385/779] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Jun 17 07:16:22 2022] GET /identity/v3/services => generated 772 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:23.041997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce585d3-309a-4104-bde5-3f0001dbbd8f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:23.076427 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd72c2d-a6bb-4f94-9c10-c24c8fed8781 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:23.115337 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:23.121594 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:23.126531 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0009f5-df50-4783-9f79-170b2302f91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:23.127484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0009f5-df50-4783-9f79-170b2302f91a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:23.127940 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0009f5-df50-4783-9f79-170b2302f91a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:23.128363 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0009f5-df50-4783-9f79-170b2302f91a None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:23.129247 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0009f5-df50-4783-9f79-170b2302f91a None admin] RBAC: Adding query filter params (type=network) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:23.129737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0009f5-df50-4783-9f79-170b2302f91a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:23.131728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0009f5-df50-4783-9f79-170b2302f91a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:23.139201 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 395/780] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Jun 17 07:16:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:23.145630 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0009f5-df50-4783-9f79-170b2302f91a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:23.264470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce585d3-309a-4104-bde5-3f0001dbbd8f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:23.285630 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0009f5-df50-4783-9f79-170b2302f91a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:23.307509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff72f7-c85e-4287-8885-ed25ab7730ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:23.308603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff72f7-c85e-4287-8885-ed25ab7730ea None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:23.308903 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff72f7-c85e-4287-8885-ed25ab7730ea None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:23.309162 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff72f7-c85e-4287-8885-ed25ab7730ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:23.322653 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff72f7-c85e-4287-8885-ed25ab7730ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:23.328668 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117d841-9d29-465d-8282-736b1fef4db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:23.329339 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117d841-9d29-465d-8282-736b1fef4db0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:23.329628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117d841-9d29-465d-8282-736b1fef4db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:23.329902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117d841-9d29-465d-8282-736b1fef4db0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:23.330692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117d841-9d29-465d-8282-736b1fef4db0 None admin] RBAC: Adding query filter params (interface=public, service_id=762ff8f9bc1d44c396f54b1b448db695, region_id=RegionOne) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:23.330998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117d841-9d29-465d-8282-736b1fef4db0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:23.332252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-75ff72f7-c85e-4287-8885-ed25ab7730ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:23.332252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:23.332252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:23.332252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:23.332252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:23.332252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:23.332252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:23.332252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:23.332252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:23.332252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:23.332252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:23.332252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:23.332252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:23.332252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:23.332252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:23.332252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:23.333371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:23.333371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:23.333371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:23.333371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:23.333371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:23.333371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:23.333371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:23.333371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:23.333371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:23.333371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:23.333371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:23.333371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:23.333371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:23.333371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:23.333371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:23.333371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:23.334432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:23.334432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:23.334432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:23.334432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:23.334432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:23.334432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:23.334432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:23.334432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:23.334432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:23.334432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:23.334432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:23.334432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:23.335134 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117d841-9d29-465d-8282-736b1fef4db0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:23.336781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 386/781] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:16:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:23.340229 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 396/782] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Jun 17 07:16:23 2022] GET /identity/v3/endpoints?service_id=762ff8f9bc1d44c396f54b1b448db695&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:23.346040 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117d841-9d29-465d-8282-736b1fef4db0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:23.346273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff72f7-c85e-4287-8885-ed25ab7730ea None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:23.415326 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:23.473195 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117d841-9d29-465d-8282-736b1fef4db0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:23.491968 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff72f7-c85e-4287-8885-ed25ab7730ea None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:23.504505 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:23.534466 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc134eea-8347-4865-9c90-4b73b7365032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:23.535369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc134eea-8347-4865-9c90-4b73b7365032 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:23.535796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc134eea-8347-4865-9c90-4b73b7365032 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:23.536228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc134eea-8347-4865-9c90-4b73b7365032 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:23.537069 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc134eea-8347-4865-9c90-4b73b7365032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:23.537925 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ae224-e007-4d72-8410-df09e2c5e35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:23.538710 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ae224-e007-4d72-8410-df09e2c5e35b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:23.539042 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc134eea-8347-4865-9c90-4b73b7365032 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:23.539170 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ae224-e007-4d72-8410-df09e2c5e35b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:23.539519 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ae224-e007-4d72-8410-df09e2c5e35b None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:23.540363 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ae224-e007-4d72-8410-df09e2c5e35b None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:23.540761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ae224-e007-4d72-8410-df09e2c5e35b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:23.542253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ae224-e007-4d72-8410-df09e2c5e35b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:23.547133 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 387/783] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Jun 17 07:16:23 2022] GET /identity/v3/services => generated 772 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:23.567649 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 397/784] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:16:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:23.573089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc134eea-8347-4865-9c90-4b73b7365032 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:23.741920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc134eea-8347-4865-9c90-4b73b7365032 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:23.793276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699f5b7-4fca-44f2-a7bf-7d13f93e18bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:23.794801 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699f5b7-4fca-44f2-a7bf-7d13f93e18bc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:23.795410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699f5b7-4fca-44f2-a7bf-7d13f93e18bc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:23.795889 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699f5b7-4fca-44f2-a7bf-7d13f93e18bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:23.813613 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699f5b7-4fca-44f2-a7bf-7d13f93e18bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:23.815421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699f5b7-4fca-44f2-a7bf-7d13f93e18bc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:23.844361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5699f5b7-4fca-44f2-a7bf-7d13f93e18bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:23.844361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:23.844361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:23.844361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:23.844361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:23.844361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:23.844361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:23.844361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:23.844361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:23.844361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:23.844361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:23.844361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:23.844361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:23.844361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:23.844361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:23.845345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:23.845345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:23.845345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:23.845345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:23.845345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:23.845345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:23.845345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:23.845345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:23.845345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:23.845345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:23.845345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:23.845345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:23.845345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:23.845345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:23.845345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:23.845345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:23.845345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:23.846301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:23.846301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:23.846301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:23.846301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:23.848250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 388/785] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:23.855204 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ae224-e007-4d72-8410-df09e2c5e35b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:23.976417 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ae224-e007-4d72-8410-df09e2c5e35b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:23.998782 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:24.028335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78387e-ccf6-4ca3-86fa-ce668bf7e440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:24.030171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78387e-ccf6-4ca3-86fa-ce668bf7e440 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:24.030665 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78387e-ccf6-4ca3-86fa-ce668bf7e440 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:24.031142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78387e-ccf6-4ca3-86fa-ce668bf7e440 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:24.032207 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78387e-ccf6-4ca3-86fa-ce668bf7e440 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:24.032759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78387e-ccf6-4ca3-86fa-ce668bf7e440 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:24.034378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78387e-ccf6-4ca3-86fa-ce668bf7e440 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:24.055828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 398/786] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:24.061341 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699f5b7-4fca-44f2-a7bf-7d13f93e18bc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:24.064116 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e325b-fc34-4a17-a576-2955085c650c None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:24.064559 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e325b-fc34-4a17-a576-2955085c650c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:24.065229 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e325b-fc34-4a17-a576-2955085c650c None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:24.067677 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 399/787] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:24.073292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db42b9-cc34-4331-8ad1-9115c4de4626 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:24.073805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db42b9-cc34-4331-8ad1-9115c4de4626 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:24.074228 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db42b9-cc34-4331-8ad1-9115c4de4626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:24.090337 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:24.104588 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-04db42b9-cc34-4331-8ad1-9115c4de4626 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:24.107665 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-04db42b9-cc34-4331-8ad1-9115c4de4626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:24.221454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 400/788] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:24.244208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db42b9-cc34-4331-8ad1-9115c4de4626 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:24.253056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699f5b7-4fca-44f2-a7bf-7d13f93e18bc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:24.330018 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67b12b-5236-43dc-9645-c62739dded07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:24.330849 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67b12b-5236-43dc-9645-c62739dded07 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:24.331131 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67b12b-5236-43dc-9645-c62739dded07 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:24.331405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67b12b-5236-43dc-9645-c62739dded07 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:24.347026 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67b12b-5236-43dc-9645-c62739dded07 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:24.349976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67b12b-5236-43dc-9645-c62739dded07 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:24.377800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9d67b12b-5236-43dc-9645-c62739dded07 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:16:24.377800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:24.377800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:24.377800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:24.377800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:24.377800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:24.377800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:24.377800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:24.377800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:24.377800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:24.377800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:24.377800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:24.377800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:24.377800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:24.377800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:24.377800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:24.378842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:24.379792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:24.379792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:24.379792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:24.379792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:24.379792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:24.379792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:24.379792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:24.379792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:24.379792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:16:24.379792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:24.384337 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db42b9-cc34-4331-8ad1-9115c4de4626 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:24.387056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 389/789] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Jun 17 07:16:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:24.393438 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67b12b-5236-43dc-9645-c62739dded07 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:24.404610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:24.455652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33a952-583f-468a-9a91-d3b8951b4985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:24.456650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33a952-583f-468a-9a91-d3b8951b4985 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:24.457035 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33a952-583f-468a-9a91-d3b8951b4985 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:24.457448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33a952-583f-468a-9a91-d3b8951b4985 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:24.478740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33a952-583f-468a-9a91-d3b8951b4985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:24.492488 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:24.495021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-ab33a952-583f-468a-9a91-d3b8951b4985 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:16:24.495021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:24.495021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:24.495021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:24.495021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:24.495021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:24.495021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:24.495021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:24.495021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:24.495021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:24.495021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:24.495021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:24.495021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:24.495021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:24.495021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:24.495021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:24.496006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:24.496006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:24.496006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:24.496006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:24.496006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:24.496006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:24.496006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:24.496006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:24.496006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:24.496006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:24.496006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:24.496006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:24.496006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:24.496006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:24.496006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:24.496006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:24.501589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:24.501589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:24.501589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:24.501589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:24.501589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:24.501589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:24.501589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:24.501589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:24.501589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:24.501589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:24.501589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:16:24.501589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:24.501589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 401/790] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:16:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:24.521610 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67b12b-5236-43dc-9645-c62739dded07 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:24.521696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33a952-583f-468a-9a91-d3b8951b4985 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:24.582720 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee841069-f267-4797-83a0-f99abb53f567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:24.583823 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee841069-f267-4797-83a0-f99abb53f567 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:24.585010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee841069-f267-4797-83a0-f99abb53f567 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:24.585625 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee841069-f267-4797-83a0-f99abb53f567 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:24.588477 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee841069-f267-4797-83a0-f99abb53f567 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:24.589227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee841069-f267-4797-83a0-f99abb53f567 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:24.592463 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee841069-f267-4797-83a0-f99abb53f567 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:24.627728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 390/791] 10.222.0.52 () {56 vars in 1149 bytes} [Fri Jun 17 07:16:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:24.630959 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee841069-f267-4797-83a0-f99abb53f567 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:24.729126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33a952-583f-468a-9a91-d3b8951b4985 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:24.801002 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8f9c9-89d7-4da7-a6dc-ea8414d1b248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:24.802044 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8f9c9-89d7-4da7-a6dc-ea8414d1b248 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:24.802568 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8f9c9-89d7-4da7-a6dc-ea8414d1b248 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:24.802972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8f9c9-89d7-4da7-a6dc-ea8414d1b248 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:24.803882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d8f9c9-89d7-4da7-a6dc-ea8414d1b248 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:24.804327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d8f9c9-89d7-4da7-a6dc-ea8414d1b248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:24.805978 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d8f9c9-89d7-4da7-a6dc-ea8414d1b248 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:24.820257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee841069-f267-4797-83a0-f99abb53f567 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:24.820588 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 402/792] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:16:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:24.821977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8f9c9-89d7-4da7-a6dc-ea8414d1b248 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:24.854400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d63f8f-9494-43c1-b4ea-fb1927151046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:24.855154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d63f8f-9494-43c1-b4ea-fb1927151046 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:24.855530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d63f8f-9494-43c1-b4ea-fb1927151046 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:24.855901 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d63f8f-9494-43c1-b4ea-fb1927151046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:24.858007 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:24.867512 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d63f8f-9494-43c1-b4ea-fb1927151046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:24.869106 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d63f8f-9494-43c1-b4ea-fb1927151046 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:24.870949 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:24.887730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-34d63f8f-9494-43c1-b4ea-fb1927151046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:24.887730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:24.887730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:24.887730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:24.887730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:24.887730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:24.887730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:24.887730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:24.887730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:24.887730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:24.887730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:24.887730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:24.887730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:24.887730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:24.887730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:24.889114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:24.889114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:24.889114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:24.889114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:24.889114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:24.889114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:24.889114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:24.889114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:24.889114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:24.889114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:24.889114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:24.889114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:24.889114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:24.889114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:24.889114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:24.889114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:24.889114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:24.890167 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:24.890167 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:24.890167 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:24.890167 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:24.891298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 391/793] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:24.897083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0ecb1-9670-4d84-b2c9-8ab6509a8787 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:24.897490 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0ecb1-9670-4d84-b2c9-8ab6509a8787 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:24.897834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0ecb1-9670-4d84-b2c9-8ab6509a8787 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:24.899399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 392/794] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:24.900171 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0ecb1-9670-4d84-b2c9-8ab6509a8787 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:24.937113 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8f9c9-89d7-4da7-a6dc-ea8414d1b248 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:24.975457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af852b-6818-4597-9823-d972995f250a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:24.976543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af852b-6818-4597-9823-d972995f250a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:24.977125 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af852b-6818-4597-9823-d972995f250a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:24.977610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af852b-6818-4597-9823-d972995f250a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:24.989907 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af852b-6818-4597-9823-d972995f250a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:24.991847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af852b-6818-4597-9823-d972995f250a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:25.010992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-69af852b-6818-4597-9823-d972995f250a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:25.010992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:25.010992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:25.010992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:25.010992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:25.010992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:25.010992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:25.010992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:25.010992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:25.010992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:25.010992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:25.010992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:25.010992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:25.010992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:25.010992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:25.011942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:25.011942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:25.011942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:25.011942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:25.011942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:25.011942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:25.011942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:25.011942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:25.011942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:25.011942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:25.011942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:25.011942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:25.011942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:25.011942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:25.011942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:25.011942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:25.011942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:25.012898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:25.012898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:25.012898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:25.012898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:25.013452 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0ecb1-9670-4d84-b2c9-8ab6509a8787 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:25.020093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 403/795] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:25.021785 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d5bf-ee8b-4b9a-a965-720542437b36 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:25.022323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d5bf-ee8b-4b9a-a965-720542437b36 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:25.022787 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d5bf-ee8b-4b9a-a965-720542437b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:25.041779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-50e3d5bf-ee8b-4b9a-a965-720542437b36 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:25.043365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-50e3d5bf-ee8b-4b9a-a965-720542437b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:25.049132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99043b44-697b-4f5f-aaec-1f2317f41836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:25.049894 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99043b44-697b-4f5f-aaec-1f2317f41836 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:25.050232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99043b44-697b-4f5f-aaec-1f2317f41836 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:25.050568 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99043b44-697b-4f5f-aaec-1f2317f41836 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:25.051346 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99043b44-697b-4f5f-aaec-1f2317f41836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:25.051714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99043b44-697b-4f5f-aaec-1f2317f41836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:25.053124 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99043b44-697b-4f5f-aaec-1f2317f41836 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:25.069680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 393/796] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:25.070660 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99043b44-697b-4f5f-aaec-1f2317f41836 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:25.123362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 404/797] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:25.124923 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3d5bf-ee8b-4b9a-a965-720542437b36 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:25.133520 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:25.142524 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:25.203274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99043b44-697b-4f5f-aaec-1f2317f41836 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:25.241818 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b42178-c822-4f24-a66f-a3bdf1045435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:25.242593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b42178-c822-4f24-a66f-a3bdf1045435 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:25.242959 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b42178-c822-4f24-a66f-a3bdf1045435 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:25.243304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b42178-c822-4f24-a66f-a3bdf1045435 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:25.244107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b42178-c822-4f24-a66f-a3bdf1045435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:25.244596 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b42178-c822-4f24-a66f-a3bdf1045435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:25.246089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b42178-c822-4f24-a66f-a3bdf1045435 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:25.266504 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 394/798] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:25.266504 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b42178-c822-4f24-a66f-a3bdf1045435 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:25.369128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b42178-c822-4f24-a66f-a3bdf1045435 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:25.374533 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3d5bf-ee8b-4b9a-a965-720542437b36 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:25.383793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:25.408479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863605cf-c7bd-4b70-bed7-3188de727b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:25.409107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863605cf-c7bd-4b70-bed7-3188de727b2f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:25.409480 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863605cf-c7bd-4b70-bed7-3188de727b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:25.409871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863605cf-c7bd-4b70-bed7-3188de727b2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:25.417212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe147e9-4417-497d-b8bc-e3b53ed823bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:25.418255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe147e9-4417-497d-b8bc-e3b53ed823bf None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:25.418836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe147e9-4417-497d-b8bc-e3b53ed823bf None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:25.419288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe147e9-4417-497d-b8bc-e3b53ed823bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:25.421305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863605cf-c7bd-4b70-bed7-3188de727b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:25.427082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe147e9-4417-497d-b8bc-e3b53ed823bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:25.429266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe147e9-4417-497d-b8bc-e3b53ed823bf None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:25.429416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-863605cf-c7bd-4b70-bed7-3188de727b2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:16:25.429416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:25.429416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:25.429416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:25.429416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:25.429416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:25.429416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:25.429416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:25.429416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:25.429416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:25.429416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:25.429416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:25.429416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:25.429416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:25.429416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:25.429416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:25.430276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:25.430276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:25.430276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:25.430276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:25.430276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:25.430276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:25.430276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:25.430276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:25.430276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:25.430276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:25.430276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:25.430276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:25.430276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:25.430276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:25.430276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:25.430276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:25.431118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:25.431118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:25.431118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:25.431118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:25.431118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:25.431118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:25.431118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:25.431118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:25.431118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:25.431118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:25.431118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:16:25.431118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:25.433403 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 395/799] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:16:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:25.434449 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863605cf-c7bd-4b70-bed7-3188de727b2f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:25.453167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-afe147e9-4417-497d-b8bc-e3b53ed823bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:25.453167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:25.453167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:25.453167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:25.453167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:25.453167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:25.453167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:25.453167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:25.453167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:25.453167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:25.453167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:25.453167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:25.453167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:25.453167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:25.453167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:25.454342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:25.454342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:25.454342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:25.454342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:25.454342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:25.454342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:25.454342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:25.454342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:25.454342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:25.454342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:25.454342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:25.454342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:25.454342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:25.454342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:25.454342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:25.454342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:25.454342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:25.455231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:25.455231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:25.455231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:25.455231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:25.455231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:25.455231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:25.455231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:25.455231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:25.458203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 405/800] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:25.459398 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe147e9-4417-497d-b8bc-e3b53ed823bf None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:25.541768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:25.549818 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863605cf-c7bd-4b70-bed7-3188de727b2f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:25.572179 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe147e9-4417-497d-b8bc-e3b53ed823bf None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:25.586983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee7442-09f4-4e41-b621-885568d15039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:25.588159 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee7442-09f4-4e41-b621-885568d15039 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:25.588594 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee7442-09f4-4e41-b621-885568d15039 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:25.588872 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee7442-09f4-4e41-b621-885568d15039 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:25.597534 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee7442-09f4-4e41-b621-885568d15039 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:25.598965 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee7442-09f4-4e41-b621-885568d15039 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:25.608949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009cf13-9b11-45bc-b3cc-c5547fb27f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:25.609646 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009cf13-9b11-45bc-b3cc-c5547fb27f9b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:25.609930 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009cf13-9b11-45bc-b3cc-c5547fb27f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:25.610200 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009cf13-9b11-45bc-b3cc-c5547fb27f9b None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:25.610934 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009cf13-9b11-45bc-b3cc-c5547fb27f9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:25.611231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009cf13-9b11-45bc-b3cc-c5547fb27f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:25.612582 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009cf13-9b11-45bc-b3cc-c5547fb27f9b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:25.614191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-4fee7442-09f4-4e41-b621-885568d15039 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:16:25.614191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:25.614191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:25.614191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:25.614191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:25.614191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:25.614191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:25.614191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:25.614191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:25.614191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:25.614191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:25.614191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:25.614191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:25.614191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:25.614191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:25.614191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:25.615083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:25.616020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:25.616020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:25.616020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:25.616020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:25.616020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:25.616020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:25.616020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:25.616020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:25.616020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:16:25.616020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:25.616020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 396/801] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:16:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:25.617159 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee7442-09f4-4e41-b621-885568d15039 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:25.631375 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 406/802] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:16:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:25.631375 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43868b5b-64aa-439e-9343-5f2bf08d187b None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:25.631375 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43868b5b-64aa-439e-9343-5f2bf08d187b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:25.631375 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43868b5b-64aa-439e-9343-5f2bf08d187b None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:25.631375 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 407/803] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:25.631375 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43868b5b-64aa-439e-9343-5f2bf08d187b None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:25.658820 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:25.738224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee7442-09f4-4e41-b621-885568d15039 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:25.744938 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43868b5b-64aa-439e-9343-5f2bf08d187b None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:25.775768 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0cf4d-35eb-4e16-adee-ff37af4d0343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:25.776434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0cf4d-35eb-4e16-adee-ff37af4d0343 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:25.776716 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0cf4d-35eb-4e16-adee-ff37af4d0343 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:25.776986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0cf4d-35eb-4e16-adee-ff37af4d0343 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:25.777803 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0cf4d-35eb-4e16-adee-ff37af4d0343 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:25.778282 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0cf4d-35eb-4e16-adee-ff37af4d0343 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:25.779568 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0cf4d-35eb-4e16-adee-ff37af4d0343 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:25.783140 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee325ff9-6dd3-480c-8f94-10804cb3d4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:25.783924 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee325ff9-6dd3-480c-8f94-10804cb3d4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:25.784424 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee325ff9-6dd3-480c-8f94-10804cb3d4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:25.784791 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee325ff9-6dd3-480c-8f94-10804cb3d4b0 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:25.785747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee325ff9-6dd3-480c-8f94-10804cb3d4b0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:25.786721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee325ff9-6dd3-480c-8f94-10804cb3d4b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:25.788750 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee325ff9-6dd3-480c-8f94-10804cb3d4b0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:25.790991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:25.796196 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 397/804] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:25.796196 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0cf4d-35eb-4e16-adee-ff37af4d0343 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:25.813673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 408/805] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Jun 17 07:16:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:25.815092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223c3bf-4cca-4e34-9c44-c45b0053a6ae None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:25.815381 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223c3bf-4cca-4e34-9c44-c45b0053a6ae None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:25.815658 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223c3bf-4cca-4e34-9c44-c45b0053a6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:25.833354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d223c3bf-4cca-4e34-9c44-c45b0053a6ae None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:25.837842 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d223c3bf-4cca-4e34-9c44-c45b0053a6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:25.897126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:25.904857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0cf4d-35eb-4e16-adee-ff37af4d0343 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:25.912110 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 409/806] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:25.912904 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223c3bf-4cca-4e34-9c44-c45b0053a6ae None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:25.954223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63a5be-b04d-421d-9a1e-6bf56e269b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:25.955424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63a5be-b04d-421d-9a1e-6bf56e269b0d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:25.955707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63a5be-b04d-421d-9a1e-6bf56e269b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:25.955978 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63a5be-b04d-421d-9a1e-6bf56e269b0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:25.966785 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63a5be-b04d-421d-9a1e-6bf56e269b0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:25.968221 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63a5be-b04d-421d-9a1e-6bf56e269b0d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:25.986219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-fc63a5be-b04d-421d-9a1e-6bf56e269b0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:25.986219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:25.986219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:25.986219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:25.986219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:25.986219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:25.986219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:25.986219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:25.986219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:25.986219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:25.986219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:25.986219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:25.986219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:25.986219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:25.986219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:25.987152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:25.987152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:25.987152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:25.987152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:25.987152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:25.987152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:25.987152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:25.987152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:25.987152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:25.987152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:25.987152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:25.987152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:25.987152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:25.987152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:25.987152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:25.987152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:25.987152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:25.988092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:25.988092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:25.988092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:25.988092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:25.992079 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 398/807] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:25.992823 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63a5be-b04d-421d-9a1e-6bf56e269b0d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:26.017649 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223c3bf-4cca-4e34-9c44-c45b0053a6ae None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:26.042520 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:26.055067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c6e90-31b1-4b1b-ad31-910d6cdc9419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:26.055943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c6e90-31b1-4b1b-ad31-910d6cdc9419 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:26.056241 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c6e90-31b1-4b1b-ad31-910d6cdc9419 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:26.056495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c6e90-31b1-4b1b-ad31-910d6cdc9419 None admin] PATH_INFO: `/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/9144d74a341b4e08ae353b384fe1186e/roles/b2b4f9b1ccfc4e63b260aa4d8c230bf6` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:26.071587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c6e90-31b1-4b1b-ad31-910d6cdc9419 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dffdba97abf4f59b12c4fbdc6245e9e, user_id=9144d74a341b4e08ae353b384fe1186e, role_id=b2b4f9b1ccfc4e63b260aa4d8c230bf6)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:26.073095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c6e90-31b1-4b1b-ad31-910d6cdc9419 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:26.094252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63a5be-b04d-421d-9a1e-6bf56e269b0d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:26.128780 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9668a81-c758-4598-8d6a-94ddeff3cb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:26.129663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9668a81-c758-4598-8d6a-94ddeff3cb71 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:26.129941 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9668a81-c758-4598-8d6a-94ddeff3cb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:26.130213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9668a81-c758-4598-8d6a-94ddeff3cb71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:26.140239 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9668a81-c758-4598-8d6a-94ddeff3cb71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:26.141716 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9668a81-c758-4598-8d6a-94ddeff3cb71 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:26.148319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:26.158827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a9668a81-c758-4598-8d6a-94ddeff3cb71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:26.158827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:26.158827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:26.158827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:26.158827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:26.158827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:26.158827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:26.158827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:26.158827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:26.158827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:26.158827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:26.158827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:26.158827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:26.158827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:26.158827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:26.159954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:26.159954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:26.159954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:26.159954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:26.159954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:26.159954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:26.159954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:26.159954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:26.159954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:26.159954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:26.159954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:26.159954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:26.159954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:26.159954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:26.159954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:26.159954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:26.159954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:26.165831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:26.165831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:26.165831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:26.165831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:26.165831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 399/808] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:26.165831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9668a81-c758-4598-8d6a-94ddeff3cb71 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:26.183930 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 410/809] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:16:25 2022] PUT /identity/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/9144d74a341b4e08ae353b384fe1186e/roles/b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:16:26.186424 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c6e90-31b1-4b1b-ad31-910d6cdc9419 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:26.301728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9668a81-c758-4598-8d6a-94ddeff3cb71 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:26.319764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c6e90-31b1-4b1b-ad31-910d6cdc9419 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:26.342646 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670b24d-1d15-45d0-83c7-998d63a8617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:26.343514 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b24d-1d15-45d0-83c7-998d63a8617c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:26.343798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b24d-1d15-45d0-83c7-998d63a8617c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:26.344077 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b24d-1d15-45d0-83c7-998d63a8617c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:26.344856 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670b24d-1d15-45d0-83c7-998d63a8617c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:26.346404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670b24d-1d15-45d0-83c7-998d63a8617c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:26.360798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-2670b24d-1d15-45d0-83c7-998d63a8617c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:16:26.360798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:26.360798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:26.360798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:26.360798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:26.360798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:26.360798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:26.360798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:26.360798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:16:26.360798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:26.360798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:26.360798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:26.360798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:26.360798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:26.360798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:26.360798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:26.361810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:26.361810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:26.361810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:26.361810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:26.361810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:26.361810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:26.361810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:26.361810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:26.361810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:26.361810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:26.361810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:26.361810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:26.361810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:26.361810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:26.361810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:26.361810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:26.362648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:26.362648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:26.362648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:26.362648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:26.362648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:26.362648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:26.362648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:26.362648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:26.362648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:26.362648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:26.362648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:26.362648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:26.362648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:26.362648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:16:26.362648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:26.362648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 400/810] 10.222.0.52 () {56 vars in 1129 bytes} [Fri Jun 17 07:16:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:26.363504 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92294736-a255-4b57-9ad0-f0b0ded1b4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:26.363600 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670b24d-1d15-45d0-83c7-998d63a8617c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:26.363671 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294736-a255-4b57-9ad0-f0b0ded1b4aa None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:26.363671 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294736-a255-4b57-9ad0-f0b0ded1b4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:26.363671 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294736-a255-4b57-9ad0-f0b0ded1b4aa None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:26.364493 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92294736-a255-4b57-9ad0-f0b0ded1b4aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:26.364651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92294736-a255-4b57-9ad0-f0b0ded1b4aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:26.366014 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92294736-a255-4b57-9ad0-f0b0ded1b4aa None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:26.379952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 411/811] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:26.382193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a1e3c-2a02-4566-9b62-1a4be383a473 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:26.382483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a1e3c-2a02-4566-9b62-1a4be383a473 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:26.382759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a1e3c-2a02-4566-9b62-1a4be383a473 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:26.384302 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 412/812] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:26.385010 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a1e3c-2a02-4566-9b62-1a4be383a473 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:26.425345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:26.433116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:26.475642 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670b24d-1d15-45d0-83c7-998d63a8617c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:26.502131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a1e3c-2a02-4566-9b62-1a4be383a473 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:26.511893 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68f1ff-0291-41cc-8f4e-686831530482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:26.512660 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68f1ff-0291-41cc-8f4e-686831530482 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:26.513394 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68f1ff-0291-41cc-8f4e-686831530482 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:26.513874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68f1ff-0291-41cc-8f4e-686831530482 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:26.514600 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68f1ff-0291-41cc-8f4e-686831530482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:26.514909 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68f1ff-0291-41cc-8f4e-686831530482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:26.516328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68f1ff-0291-41cc-8f4e-686831530482 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:26.536302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 401/813] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:26.536302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68f1ff-0291-41cc-8f4e-686831530482 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:26.539697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d784b-8088-4361-9b00-c9edee3af292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:26.540399 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d784b-8088-4361-9b00-c9edee3af292 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:26.540676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d784b-8088-4361-9b00-c9edee3af292 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:26.540949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d784b-8088-4361-9b00-c9edee3af292 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:26.541690 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d784b-8088-4361-9b00-c9edee3af292 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:26.541996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d784b-8088-4361-9b00-c9edee3af292 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:26.543383 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d784b-8088-4361-9b00-c9edee3af292 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:26.548662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 413/814] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Jun 17 07:16:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:26.549898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b238931-a012-4758-9b76-55fab69d26ba None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:26.550182 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b238931-a012-4758-9b76-55fab69d26ba None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:26.550457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b238931-a012-4758-9b76-55fab69d26ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:26.566671 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-7b238931-a012-4758-9b76-55fab69d26ba None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:26.567864 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7b238931-a012-4758-9b76-55fab69d26ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:26.639385 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 414/815] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:26.640251 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b238931-a012-4758-9b76-55fab69d26ba None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:26.655555 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68f1ff-0291-41cc-8f4e-686831530482 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:26.686832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:26.689265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:26.701383 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb9902-b17c-41a7-9679-5013998a67a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:26.702264 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb9902-b17c-41a7-9679-5013998a67a8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:26.702599 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb9902-b17c-41a7-9679-5013998a67a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:26.702927 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb9902-b17c-41a7-9679-5013998a67a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:26.710367 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb9902-b17c-41a7-9679-5013998a67a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:26.711883 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb9902-b17c-41a7-9679-5013998a67a8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:26.727384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5ccb9902-b17c-41a7-9679-5013998a67a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:16:26.727384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:26.727384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:26.727384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:26.727384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:26.727384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:26.727384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:26.727384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:26.727384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:26.727384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:26.727384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:26.727384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:26.727384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:26.727384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:26.727384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:26.727384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:26.728417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:26.729582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:26.729582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:26.729582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:26.729582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:26.729582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:26.729582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:26.729582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:26.729582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:26.729582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:16:26.729582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:26.729582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 402/816] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Jun 17 07:16:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:26.730181 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb9902-b17c-41a7-9679-5013998a67a8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:26.770186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b238931-a012-4758-9b76-55fab69d26ba None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:26.805088 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806b868-b901-48dd-8cbb-dc3eb9906c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:26.806004 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806b868-b901-48dd-8cbb-dc3eb9906c98 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:26.806280 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806b868-b901-48dd-8cbb-dc3eb9906c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:26.806551 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806b868-b901-48dd-8cbb-dc3eb9906c98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:26.814968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806b868-b901-48dd-8cbb-dc3eb9906c98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:26.816409 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806b868-b901-48dd-8cbb-dc3eb9906c98 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:26.830284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-6806b868-b901-48dd-8cbb-dc3eb9906c98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:26.830284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:26.830284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:26.830284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:26.830284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:26.830284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:26.830284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:26.830284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:26.830284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:26.830284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:26.830284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:26.830284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:26.830284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:26.830284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:26.830284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:26.831387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:26.831387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:26.831387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:26.831387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:26.831387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:26.831387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:26.831387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:26.831387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:26.831387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:26.831387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:26.831387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:26.831387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:26.831387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:26.831387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:26.831387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:26.831387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:26.831387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:26.832484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:26.832484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:26.832484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:26.832484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:26.832484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:26.832484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:26.832484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:26.832484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:26.834613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 415/817] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:26.835527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806b868-b901-48dd-8cbb-dc3eb9906c98 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:26.842978 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb9902-b17c-41a7-9679-5013998a67a8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:26.877846 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebc706-0c85-43ec-83c6-de7f9d4398a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:26.878511 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebc706-0c85-43ec-83c6-de7f9d4398a0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:26.878792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebc706-0c85-43ec-83c6-de7f9d4398a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:26.879064 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebc706-0c85-43ec-83c6-de7f9d4398a0 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:26.879757 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebc706-0c85-43ec-83c6-de7f9d4398a0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:26.880059 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebc706-0c85-43ec-83c6-de7f9d4398a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:26.881426 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebc706-0c85-43ec-83c6-de7f9d4398a0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:26.886192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 403/818] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Jun 17 07:16:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:26.891960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebc706-0c85-43ec-83c6-de7f9d4398a0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:26.929358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:26.942898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:26.946683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806b868-b901-48dd-8cbb-dc3eb9906c98 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:26.982202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6533ab-2b93-4fbb-97ee-f9474656367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:26.983001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6533ab-2b93-4fbb-97ee-f9474656367a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:26.983331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6533ab-2b93-4fbb-97ee-f9474656367a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:26.983601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6533ab-2b93-4fbb-97ee-f9474656367a None admin] PATH_INFO: `/v3/services/network` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:26.984249 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6533ab-2b93-4fbb-97ee-f9474656367a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:26.985626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6533ab-2b93-4fbb-97ee-f9474656367a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:26.996325 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebc706-0c85-43ec-83c6-de7f9d4398a0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:26.997928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-3f6533ab-2b93-4fbb-97ee-f9474656367a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:16:26.997928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:26.997928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:26.997928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:26.997928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:26.997928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:26.997928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:26.997928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:26.997928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:16:26.997928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:26.997928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:26.997928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:26.997928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:26.997928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:26.997928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:26.997928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:26.997928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:26.998994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:26.998994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:26.998994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:26.998994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:26.998994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:26.998994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:26.998994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:26.998994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:26.998994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:26.998994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:26.998994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:26.998994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:26.998994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:26.998994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:26.998994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:26.998994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:26.999837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:26.999837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:26.999837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:26.999837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:26.999837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:26.999837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:26.999837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:26.999837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:26.999837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:26.999837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:26.999837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:26.999837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:26.999837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:16:26.999837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:26.999837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 416/819] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:26 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:27.001630 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6533ab-2b93-4fbb-97ee-f9474656367a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:27.037875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f81d7c-75d6-4627-9fe0-3b099710a376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:27.038536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f81d7c-75d6-4627-9fe0-3b099710a376 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:27.038820 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f81d7c-75d6-4627-9fe0-3b099710a376 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:27.039089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f81d7c-75d6-4627-9fe0-3b099710a376 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:27.039915 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f81d7c-75d6-4627-9fe0-3b099710a376 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:27.040218 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f81d7c-75d6-4627-9fe0-3b099710a376 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:27.041661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f81d7c-75d6-4627-9fe0-3b099710a376 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:27.061282 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 404/820] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Jun 17 07:16:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:27.061938 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f81d7c-75d6-4627-9fe0-3b099710a376 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:27.119401 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6533ab-2b93-4fbb-97ee-f9474656367a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:27.160036 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb01bb5-6cdc-4c87-85dc-002227972188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:27.160831 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb01bb5-6cdc-4c87-85dc-002227972188 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:27.161118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb01bb5-6cdc-4c87-85dc-002227972188 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:27.161708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb01bb5-6cdc-4c87-85dc-002227972188 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:27.162634 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb01bb5-6cdc-4c87-85dc-002227972188 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:27.162940 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb01bb5-6cdc-4c87-85dc-002227972188 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:27.163925 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f81d7c-75d6-4627-9fe0-3b099710a376 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:27.164440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb01bb5-6cdc-4c87-85dc-002227972188 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:27.167247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:27.181846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 417/821] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:27.181846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb01bb5-6cdc-4c87-85dc-002227972188 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:27.192101 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:27.208029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db9e91-239f-464f-ba13-4e8c061fdb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:27.208029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db9e91-239f-464f-ba13-4e8c061fdb04 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:27.208029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db9e91-239f-464f-ba13-4e8c061fdb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:27.208029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db9e91-239f-464f-ba13-4e8c061fdb04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:27.208383 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db9e91-239f-464f-ba13-4e8c061fdb04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:27.209615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db9e91-239f-464f-ba13-4e8c061fdb04 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:27.282049 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb01bb5-6cdc-4c87-85dc-002227972188 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:27.301257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 405/822] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Jun 17 07:16:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:16:27.302304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db9e91-239f-464f-ba13-4e8c061fdb04 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:27.354979 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ae4e3-544e-4f78-842b-bd91abe26ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:27.355681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ae4e3-544e-4f78-842b-bd91abe26ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:27.356014 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ae4e3-544e-4f78-842b-bd91abe26ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:27.356861 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ae4e3-544e-4f78-842b-bd91abe26ad4 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:27.358546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ae4e3-544e-4f78-842b-bd91abe26ad4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:27.358938 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ae4e3-544e-4f78-842b-bd91abe26ad4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:27.361119 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ae4e3-544e-4f78-842b-bd91abe26ad4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:27.368958 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 418/823] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Jun 17 07:16:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:27.370208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ae4e3-544e-4f78-842b-bd91abe26ad4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:27.450903 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db9e91-239f-464f-ba13-4e8c061fdb04 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:27.479312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:27.497615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427412d6-f881-4b98-ab61-34413fbfab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:27.498357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427412d6-f881-4b98-ab61-34413fbfab35 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:27.498639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427412d6-f881-4b98-ab61-34413fbfab35 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:27.498923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427412d6-f881-4b98-ab61-34413fbfab35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:27.517399 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ae4e3-544e-4f78-842b-bd91abe26ad4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:27.532191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:27.561935 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91272e0-d31d-4912-a6b2-66843a0b4522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:27.563171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91272e0-d31d-4912-a6b2-66843a0b4522 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:27.563579 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91272e0-d31d-4912-a6b2-66843a0b4522 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:27.563880 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91272e0-d31d-4912-a6b2-66843a0b4522 None admin] PATH_INFO: `/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/a18b07c033224d2085773936dad33eec/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:27.566242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91272e0-d31d-4912-a6b2-66843a0b4522 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dffdba97abf4f59b12c4fbdc6245e9e, user_id=a18b07c033224d2085773936dad33eec, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:27.568333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91272e0-d31d-4912-a6b2-66843a0b4522 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:27.577728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427412d6-f881-4b98-ab61-34413fbfab35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:27.579281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427412d6-f881-4b98-ab61-34413fbfab35 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:27.656194 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 419/824] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:16:27 2022] PUT /identity/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/a18b07c033224d2085773936dad33eec/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:16:27.658011 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91272e0-d31d-4912-a6b2-66843a0b4522 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:27.703622 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 406/825] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:16:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:16:27.714925 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427412d6-f881-4b98-ab61-34413fbfab35 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:27.835239 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:27.849891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91272e0-d31d-4912-a6b2-66843a0b4522 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:27.885471 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:27.897969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a275a-75cc-4579-9370-4f71a6accfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:27.897969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a275a-75cc-4579-9370-4f71a6accfef None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:27.897969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a275a-75cc-4579-9370-4f71a6accfef None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:27.897969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a275a-75cc-4579-9370-4f71a6accfef None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:27.901521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a275a-75cc-4579-9370-4f71a6accfef None admin] RBAC: Adding query filter params (type=network) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:27.901839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a275a-75cc-4579-9370-4f71a6accfef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:27.904455 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a275a-75cc-4579-9370-4f71a6accfef None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:27.912591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 420/826] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Jun 17 07:16:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:27.917819 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427412d6-f881-4b98-ab61-34413fbfab35 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:27.918151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a275a-75cc-4579-9370-4f71a6accfef None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:27.956186 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed84f60-b596-4b61-8710-d1fbb262e8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:27.957396 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed84f60-b596-4b61-8710-d1fbb262e8ef None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:27.964628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed84f60-b596-4b61-8710-d1fbb262e8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:27.964628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed84f60-b596-4b61-8710-d1fbb262e8ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:27.971160 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed84f60-b596-4b61-8710-d1fbb262e8ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:27.972741 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed84f60-b596-4b61-8710-d1fbb262e8ef None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:27.992650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-4ed84f60-b596-4b61-8710-d1fbb262e8ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:27.992650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:27.992650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:27.992650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:27.992650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:27.992650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:27.992650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:27.992650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:27.992650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:27.992650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:27.992650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:27.992650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:27.992650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:27.992650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:27.992650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:27.993686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:27.993686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:27.993686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:27.993686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:27.993686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:27.993686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:27.993686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:27.993686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:27.993686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:27.993686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:27.993686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:27.993686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:27.993686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:27.993686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:27.993686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:27.993686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:27.993686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:27.994592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:27.994592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:27.994592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:27.994592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:27.994592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 407/827] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:27.999945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed84f60-b596-4b61-8710-d1fbb262e8ef None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:28.057176 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a275a-75cc-4579-9370-4f71a6accfef None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:28.094487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e372af1-e2e8-4b2f-9ac0-af3072595eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:28.095507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e372af1-e2e8-4b2f-9ac0-af3072595eb3 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:28.095996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e372af1-e2e8-4b2f-9ac0-af3072595eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:28.096474 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e372af1-e2e8-4b2f-9ac0-af3072595eb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:28.097440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e372af1-e2e8-4b2f-9ac0-af3072595eb3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:28.099037 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e372af1-e2e8-4b2f-9ac0-af3072595eb3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:28.176606 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed84f60-b596-4b61-8710-d1fbb262e8ef None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:28.192470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:28.203445 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 421/828] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Jun 17 07:16:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:16:28.240757 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb45b3-43c0-457f-83f5-163390d457df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:28.241905 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb45b3-43c0-457f-83f5-163390d457df None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:28.242509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb45b3-43c0-457f-83f5-163390d457df None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:28.242989 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb45b3-43c0-457f-83f5-163390d457df None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:28.243980 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb45b3-43c0-457f-83f5-163390d457df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:28.244498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb45b3-43c0-457f-83f5-163390d457df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:28.246284 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb45b3-43c0-457f-83f5-163390d457df None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:28.261445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 408/829] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:28.269390 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e372af1-e2e8-4b2f-9ac0-af3072595eb3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:28.354856 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:28.420467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e372af1-e2e8-4b2f-9ac0-af3072595eb3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:28.464455 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548158db-755d-4c3b-ba94-329886981981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:28.465273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548158db-755d-4c3b-ba94-329886981981 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:28.466238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548158db-755d-4c3b-ba94-329886981981 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:28.466512 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548158db-755d-4c3b-ba94-329886981981 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:28.477630 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548158db-755d-4c3b-ba94-329886981981 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:28.479118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548158db-755d-4c3b-ba94-329886981981 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:28.497949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-548158db-755d-4c3b-ba94-329886981981 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:28.497949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:28.497949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:28.497949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:28.497949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:28.497949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:28.497949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:28.497949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:28.497949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:28.497949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:28.497949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:28.497949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:28.497949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:28.497949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:28.497949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:28.498912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:28.498912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:28.498912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:28.498912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:28.498912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:28.498912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:28.498912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:28.498912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:28.498912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:28.498912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:28.498912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:28.498912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:28.498912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:28.498912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:28.498912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:28.498912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:28.498912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:28.499919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:28.499919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:28.499919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:28.499919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:28.499919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:28.499919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:28.499919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:28.499919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:28.499919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 422/830] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:28.505096 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb45b3-43c0-457f-83f5-163390d457df None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:28.538708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf58ab-51f8-40fa-8395-e72b31ec3801 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:28.539016 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf58ab-51f8-40fa-8395-e72b31ec3801 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:28.539255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf58ab-51f8-40fa-8395-e72b31ec3801 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:28.540848 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 423/831] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:16:28.546349 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93e652-a0ed-4dc1-ba0a-74e0926ed248 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:28.546658 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93e652-a0ed-4dc1-ba0a-74e0926ed248 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:28.546897 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93e652-a0ed-4dc1-ba0a-74e0926ed248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:28.567905 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-fe93e652-a0ed-4dc1-ba0a-74e0926ed248 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:28.569187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fe93e652-a0ed-4dc1-ba0a-74e0926ed248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:28.647561 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb45b3-43c0-457f-83f5-163390d457df None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:28.656502 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 424/832] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:28.692934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35ccb6-174e-4cdf-a3b0-0edb5180535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:28.693704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35ccb6-174e-4cdf-a3b0-0edb5180535b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:28.693982 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35ccb6-174e-4cdf-a3b0-0edb5180535b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:28.694255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35ccb6-174e-4cdf-a3b0-0edb5180535b None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:28.694915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93e652-a0ed-4dc1-ba0a-74e0926ed248 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:28.695025 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35ccb6-174e-4cdf-a3b0-0edb5180535b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:28.695323 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35ccb6-174e-4cdf-a3b0-0edb5180535b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:28.696744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35ccb6-174e-4cdf-a3b0-0edb5180535b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:28.713133 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 409/833] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:28.719592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35ccb6-174e-4cdf-a3b0-0edb5180535b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:28.744623 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:28.749405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:28.804848 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93e652-a0ed-4dc1-ba0a-74e0926ed248 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:28.820763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35ccb6-174e-4cdf-a3b0-0edb5180535b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:28.846849 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a6f06-3596-4f09-8912-f0acfb6fa342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:28.847318 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a6f06-3596-4f09-8912-f0acfb6fa342 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:28.847594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a6f06-3596-4f09-8912-f0acfb6fa342 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:28.847864 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a6f06-3596-4f09-8912-f0acfb6fa342 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:28.858469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a6f06-3596-4f09-8912-f0acfb6fa342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:28.864006 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6167249-c4a3-49e3-97d1-b397921fefb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:28.864882 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6167249-c4a3-49e3-97d1-b397921fefb9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:28.865440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6167249-c4a3-49e3-97d1-b397921fefb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:28.865948 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6167249-c4a3-49e3-97d1-b397921fefb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:28.866070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-c95a6f06-3596-4f09-8912-f0acfb6fa342 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:28.866070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:28.866070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:28.866070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:28.866070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:28.866070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:28.866070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:28.866070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:28.866070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:28.866070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:28.866070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:28.866070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:28.866070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:28.866070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:28.866070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:28.866070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:28.866932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:28.866932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:28.866932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:28.866932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:28.866932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:28.866932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:28.866932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:28.866932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:28.866932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:28.866932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:28.866932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:28.866932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:28.866932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:28.866932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:28.866932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:28.866932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:28.867767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:28.867767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:28.867767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:28.867767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:28.867767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:28.867767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:28.867767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:28.867767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:28.867767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:28.867767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:28.867767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:16:28.867767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:28.869764 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6167249-c4a3-49e3-97d1-b397921fefb9 None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=88e1572d22c048b09699a2fe50900f92) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:28.870283 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6167249-c4a3-49e3-97d1-b397921fefb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:28.872570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6167249-c4a3-49e3-97d1-b397921fefb9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:28.872679 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 425/834] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:16:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:28.873758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a6f06-3596-4f09-8912-f0acfb6fa342 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:28.880858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 410/835] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:16:28 2022] GET /identity/v3/role_assignments?user.id=88e1572d22c048b09699a2fe50900f92&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:28.997935 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:29.001146 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a6f06-3596-4f09-8912-f0acfb6fa342 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:29.040822 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dd88d-bc1d-4849-a9bf-1a9a873f02dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:29.041541 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dd88d-bc1d-4849-a9bf-1a9a873f02dd None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:29.041824 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dd88d-bc1d-4849-a9bf-1a9a873f02dd None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:29.042094 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dd88d-bc1d-4849-a9bf-1a9a873f02dd None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:29.042861 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4dd88d-bc1d-4849-a9bf-1a9a873f02dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:29.043163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4dd88d-bc1d-4849-a9bf-1a9a873f02dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:29.045872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4dd88d-bc1d-4849-a9bf-1a9a873f02dd None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:29.055247 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 426/836] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:16:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:29.061532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6167249-c4a3-49e3-97d1-b397921fefb9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:29.159782 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:29.169774 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6167249-c4a3-49e3-97d1-b397921fefb9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:29.204966 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa882a-4b9a-4da6-ab87-96a4a9a85ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:29.205838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa882a-4b9a-4da6-ab87-96a4a9a85ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:29.206128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa882a-4b9a-4da6-ab87-96a4a9a85ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:29.206400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa882a-4b9a-4da6-ab87-96a4a9a85ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:29.216902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa882a-4b9a-4da6-ab87-96a4a9a85ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:29.218385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa882a-4b9a-4da6-ab87-96a4a9a85ce4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:29.237445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-dffa882a-4b9a-4da6-ab87-96a4a9a85ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:29.237445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:29.237445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:29.237445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:29.237445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:29.237445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:29.237445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:29.237445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:29.237445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:29.237445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:29.237445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:29.237445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:29.237445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:29.237445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:29.237445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:29.238365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:29.238365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:29.238365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:29.238365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:29.238365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:29.238365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:29.238365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:29.238365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:29.238365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:29.238365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:29.238365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:29.238365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:29.238365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:29.238365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:29.238365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:29.238365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:29.238365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:29.239266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:29.239266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:29.239266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:29.239266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:29.239266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 411/837] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:29.244467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dd88d-bc1d-4849-a9bf-1a9a873f02dd None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:29.347383 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dd88d-bc1d-4849-a9bf-1a9a873f02dd None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:29.382471 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4c913-4ca0-4c75-bbaa-04e2d68d4217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:29.383177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4c913-4ca0-4c75-bbaa-04e2d68d4217 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:29.383458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4c913-4ca0-4c75-bbaa-04e2d68d4217 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:29.383728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4c913-4ca0-4c75-bbaa-04e2d68d4217 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:29.384494 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4c913-4ca0-4c75-bbaa-04e2d68d4217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:29.384737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4c913-4ca0-4c75-bbaa-04e2d68d4217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:29.386124 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4c913-4ca0-4c75-bbaa-04e2d68d4217 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:29.398452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 427/838] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:29.404002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa882a-4b9a-4da6-ab87-96a4a9a85ce4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:29.505193 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa882a-4b9a-4da6-ab87-96a4a9a85ce4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:29.540799 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6ceac-3154-43e4-93fb-3b8f320ae003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:29.541638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6ceac-3154-43e4-93fb-3b8f320ae003 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:29.541915 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6ceac-3154-43e4-93fb-3b8f320ae003 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:29.542183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6ceac-3154-43e4-93fb-3b8f320ae003 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:29.550349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6ceac-3154-43e4-93fb-3b8f320ae003 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:29.551795 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6ceac-3154-43e4-93fb-3b8f320ae003 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:29.567424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-49e6ceac-3154-43e4-93fb-3b8f320ae003 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:16:29.567424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:29.567424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:29.567424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:29.567424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:29.567424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:29.567424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:29.567424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:29.567424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:29.567424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:29.567424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:29.567424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:29.567424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:29.567424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:29.567424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:29.567424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:29.568417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:29.569385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:29.569385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:29.569385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:29.569385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:29.569385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:29.569385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:29.569385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:29.569385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:29.569385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:16:29.569385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:29.569385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 412/839] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Jun 17 07:16:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:29.574563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4c913-4ca0-4c75-bbaa-04e2d68d4217 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:29.606986 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:29.654496 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a453c95-57a1-4292-baaa-46838b8e2b38 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:29.654806 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a453c95-57a1-4292-baaa-46838b8e2b38 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:29.655067 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a453c95-57a1-4292-baaa-46838b8e2b38 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:29.660286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 413/840] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:16:29.661873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707a1f3-e8c0-4732-a0ef-1a2f3de3bdee None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:29.662160 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707a1f3-e8c0-4732-a0ef-1a2f3de3bdee None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:29.662436 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707a1f3-e8c0-4732-a0ef-1a2f3de3bdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:29.673689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:29.686473 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4c913-4ca0-4c75-bbaa-04e2d68d4217 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:29.690206 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c707a1f3-e8c0-4732-a0ef-1a2f3de3bdee None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:29.699774 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c707a1f3-e8c0-4732-a0ef-1a2f3de3bdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:29.722158 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fcf07-917f-4656-88fd-ef5263d6fac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:29.722827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fcf07-917f-4656-88fd-ef5263d6fac3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:29.723104 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fcf07-917f-4656-88fd-ef5263d6fac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:29.723377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fcf07-917f-4656-88fd-ef5263d6fac3 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:29.724202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fcf07-917f-4656-88fd-ef5263d6fac3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:29.724501 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fcf07-917f-4656-88fd-ef5263d6fac3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:29.725954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fcf07-917f-4656-88fd-ef5263d6fac3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:29.744502 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 428/841] 10.222.0.52 () {56 vars in 1149 bytes} [Fri Jun 17 07:16:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:29.750676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fcf07-917f-4656-88fd-ef5263d6fac3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:29.772574 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 414/842] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:29.798417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707a1f3-e8c0-4732-a0ef-1a2f3de3bdee None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:29.857705 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:29.882567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fcf07-917f-4656-88fd-ef5263d6fac3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:29.904716 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707a1f3-e8c0-4732-a0ef-1a2f3de3bdee None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:29.928582 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610ea79-a726-4fef-bdae-98bd205cfc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:29.929230 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610ea79-a726-4fef-bdae-98bd205cfc63 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:29.929531 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610ea79-a726-4fef-bdae-98bd205cfc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:29.929806 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610ea79-a726-4fef-bdae-98bd205cfc63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:29.943390 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a0cb0-441e-4205-9b68-9d298b78e8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:29.944597 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a0cb0-441e-4205-9b68-9d298b78e8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:29.945092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a0cb0-441e-4205-9b68-9d298b78e8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:29.945622 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a0cb0-441e-4205-9b68-9d298b78e8d5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:29.946491 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a0cb0-441e-4205-9b68-9d298b78e8d5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:29.948305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a0cb0-441e-4205-9b68-9d298b78e8d5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:29.962019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6c4a0cb0-441e-4205-9b68-9d298b78e8d5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:16:29.962019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:29.962019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:29.962019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:29.962019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:29.962019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:29.962019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:29.962019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:29.962019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:16:29.962019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:29.962019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:29.962019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:29.962019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:29.962019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:29.962019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:29.962019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:29.962019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:29.963132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:29.963132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:29.963132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:29.963132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:29.963132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:29.963132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:29.963132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:29.963132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:29.963132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:29.963132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:29.963132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:29.963132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:29.963132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:29.963132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:29.963132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:29.963132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:29.964062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:29.964062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:29.964062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:29.964062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:29.964062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:29.964062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:29.964062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:29.964062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:29.964062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:29.964062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:29.964062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:29.964062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:29.964062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:16:29.964062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:29.972357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:29.972694 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 415/843] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:16:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:29.974324 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a0cb0-441e-4205-9b68-9d298b78e8d5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:30.009291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610ea79-a726-4fef-bdae-98bd205cfc63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:30.010766 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610ea79-a726-4fef-bdae-98bd205cfc63 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:30.081491 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a0cb0-441e-4205-9b68-9d298b78e8d5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:30.114484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:30.129610 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff675f11-eb3a-4d2b-bc3c-cad1d6feb23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:30.130297 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff675f11-eb3a-4d2b-bc3c-cad1d6feb23f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:30.130581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff675f11-eb3a-4d2b-bc3c-cad1d6feb23f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:30.130861 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff675f11-eb3a-4d2b-bc3c-cad1d6feb23f None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:30.131583 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff675f11-eb3a-4d2b-bc3c-cad1d6feb23f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:30.132003 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff675f11-eb3a-4d2b-bc3c-cad1d6feb23f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:30.133451 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff675f11-eb3a-4d2b-bc3c-cad1d6feb23f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:30.143414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 416/844] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:16:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:30.149177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff675f11-eb3a-4d2b-bc3c-cad1d6feb23f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:30.154806 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 429/845] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:16:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 07:16:30.157533 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610ea79-a726-4fef-bdae-98bd205cfc63 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:30.221036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:30.260806 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff675f11-eb3a-4d2b-bc3c-cad1d6feb23f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:30.268126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610ea79-a726-4fef-bdae-98bd205cfc63 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:30.296757 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9039360-69e2-40ef-9ec2-0e8be5f8a1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:30.297461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9039360-69e2-40ef-9ec2-0e8be5f8a1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:30.297733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9039360-69e2-40ef-9ec2-0e8be5f8a1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:30.298004 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9039360-69e2-40ef-9ec2-0e8be5f8a1a1 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:30.298697 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9039360-69e2-40ef-9ec2-0e8be5f8a1a1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:30.299001 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9039360-69e2-40ef-9ec2-0e8be5f8a1a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:30.300357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9039360-69e2-40ef-9ec2-0e8be5f8a1a1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:30.305012 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 417/846] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:16:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:30.306055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb8d34-0eb5-422a-94cc-5cd7d1a28c04 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:30.306334 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb8d34-0eb5-422a-94cc-5cd7d1a28c04 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:30.306603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb8d34-0eb5-422a-94cc-5cd7d1a28c04 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:30.307931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 418/847] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:30.313218 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce491cd1-8426-4a07-8ced-05836d8622f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:30.314177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce491cd1-8426-4a07-8ced-05836d8622f5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:30.314459 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce491cd1-8426-4a07-8ced-05836d8622f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:30.314728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce491cd1-8426-4a07-8ced-05836d8622f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:30.319247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec828f-11c1-49c7-a320-ed54e423916b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:30.319845 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec828f-11c1-49c7-a320-ed54e423916b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:30.320353 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec828f-11c1-49c7-a320-ed54e423916b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:30.327452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce491cd1-8426-4a07-8ced-05836d8622f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:30.330035 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce491cd1-8426-4a07-8ced-05836d8622f5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:30.342166 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3cec828f-11c1-49c7-a320-ed54e423916b None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:30.343755 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3cec828f-11c1-49c7-a320-ed54e423916b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:30.353151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-ce491cd1-8426-4a07-8ced-05836d8622f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:30.353151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:30.353151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:30.353151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:30.353151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:30.353151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:30.353151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:30.353151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:30.353151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:30.353151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:30.353151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:30.353151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:30.353151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:30.353151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:30.353151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:30.354167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:30.354167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:30.354167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:30.354167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:30.354167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:30.354167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:30.354167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:30.354167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:30.354167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:30.354167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:30.354167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:30.354167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:30.354167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:30.354167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:30.354167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:30.354167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:30.354167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:30.355058 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:30.355058 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:30.355058 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:30.355058 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:30.360256 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 430/848] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:30.361626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce491cd1-8426-4a07-8ced-05836d8622f5 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:30.400584 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:30.445370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 419/849] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:30.469578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec828f-11c1-49c7-a320-ed54e423916b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:30.491549 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce491cd1-8426-4a07-8ced-05836d8622f5 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:30.530340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:30.534153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa7d43-3390-43fb-8a92-dc495a9c3ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:30.535057 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa7d43-3390-43fb-8a92-dc495a9c3ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:30.535477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa7d43-3390-43fb-8a92-dc495a9c3ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:30.535901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa7d43-3390-43fb-8a92-dc495a9c3ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:30.536820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa7d43-3390-43fb-8a92-dc495a9c3ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:30.537274 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa7d43-3390-43fb-8a92-dc495a9c3ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:30.538817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa7d43-3390-43fb-8a92-dc495a9c3ae9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:30.551827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 431/850] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:30.557362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa7d43-3390-43fb-8a92-dc495a9c3ae9 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:30.579024 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec828f-11c1-49c7-a320-ed54e423916b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:30.624975 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d19664-97eb-463f-a4ad-095f884e83de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:30.625844 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d19664-97eb-463f-a4ad-095f884e83de None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:30.626361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d19664-97eb-463f-a4ad-095f884e83de None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:30.626639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d19664-97eb-463f-a4ad-095f884e83de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:30.644041 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d19664-97eb-463f-a4ad-095f884e83de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:30.655266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b4d19664-97eb-463f-a4ad-095f884e83de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:16:30.655266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:30.655266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:30.655266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:30.655266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:30.655266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:30.655266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:30.655266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:30.655266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:30.655266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:30.655266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:30.655266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:30.655266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:30.655266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:30.655266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:30.655266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:30.656319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:30.656319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:30.656319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:30.656319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:30.656319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:30.656319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:30.656319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:30.656319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:30.656319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:30.656319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:30.656319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:30.656319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:30.656319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:30.656319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:30.656319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:30.656319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:30.657213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:30.657213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:30.657213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:30.657213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:30.657213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:30.657213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:30.657213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:30.657213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:30.657213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:30.657213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:30.657213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:16:30.657213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:30.661420 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 420/851] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:16:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:30.663669 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d19664-97eb-463f-a4ad-095f884e83de None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:30.666579 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:30.687106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa7d43-3390-43fb-8a92-dc495a9c3ae9 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:30.733756 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f67035-a1dc-43d8-ba9a-8629dc863995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:30.735282 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f67035-a1dc-43d8-ba9a-8629dc863995 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:30.735781 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f67035-a1dc-43d8-ba9a-8629dc863995 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:30.736255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f67035-a1dc-43d8-ba9a-8629dc863995 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:30.745784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f67035-a1dc-43d8-ba9a-8629dc863995 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:30.749008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f67035-a1dc-43d8-ba9a-8629dc863995 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:30.768020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-f8f67035-a1dc-43d8-ba9a-8629dc863995 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:30.768020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:30.768020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:30.768020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:30.768020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:30.768020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:30.768020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:30.768020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:30.768020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:30.768020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:30.768020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:30.768020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:30.768020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:30.768020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:30.768020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:30.768977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:30.768977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:30.768977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:30.768977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:30.768977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:30.768977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:30.768977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:30.768977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:30.768977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:30.768977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:30.768977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:30.768977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:30.768977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:30.768977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:30.768977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:30.768977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:30.768977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:30.769915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:30.769915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:30.769915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:30.769915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:30.769915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:30.769915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:30.769915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:30.769915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:30.775444 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 432/852] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:30.777082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f67035-a1dc-43d8-ba9a-8629dc863995 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:30.797310 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d19664-97eb-463f-a4ad-095f884e83de None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:30.814977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:30.834476 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0606d-02d7-409e-9967-c126af26273f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:30.835578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0606d-02d7-409e-9967-c126af26273f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:30.836072 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0606d-02d7-409e-9967-c126af26273f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:30.836573 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0606d-02d7-409e-9967-c126af26273f None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:30.837568 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0606d-02d7-409e-9967-c126af26273f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:30.838090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0606d-02d7-409e-9967-c126af26273f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:30.839687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0606d-02d7-409e-9967-c126af26273f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:30.849377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 421/853] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:16:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:30.857363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0606d-02d7-409e-9967-c126af26273f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:30.898080 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f67035-a1dc-43d8-ba9a-8629dc863995 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:30.941935 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35269b-786a-4c52-ab4e-8e7919fa142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:30.942518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35269b-786a-4c52-ab4e-8e7919fa142f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:30.942803 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35269b-786a-4c52-ab4e-8e7919fa142f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:30.943080 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35269b-786a-4c52-ab4e-8e7919fa142f None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:30.943858 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35269b-786a-4c52-ab4e-8e7919fa142f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:30.944166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35269b-786a-4c52-ab4e-8e7919fa142f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:30.945650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35269b-786a-4c52-ab4e-8e7919fa142f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:30.964348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 433/854] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:30.966226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35269b-786a-4c52-ab4e-8e7919fa142f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:30.981879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:30.988751 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0606d-02d7-409e-9967-c126af26273f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:31.034302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51789f-3eb3-43c2-aad7-4b0dfc33e3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:31.035787 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51789f-3eb3-43c2-aad7-4b0dfc33e3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:31.036490 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51789f-3eb3-43c2-aad7-4b0dfc33e3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:31.037434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51789f-3eb3-43c2-aad7-4b0dfc33e3e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:31.055314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51789f-3eb3-43c2-aad7-4b0dfc33e3e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:31.057605 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51789f-3eb3-43c2-aad7-4b0dfc33e3e0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:31.081825 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35269b-786a-4c52-ab4e-8e7919fa142f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:31.083677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-fc51789f-3eb3-43c2-aad7-4b0dfc33e3e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:31.083677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:31.083677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:31.083677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:31.083677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:31.083677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:31.083677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:31.083677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:31.083677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:31.083677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:31.083677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:31.083677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:31.083677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:31.083677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:31.083677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:31.084623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:31.084623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:31.084623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:31.084623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:31.084623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:31.084623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:31.084623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:31.084623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:31.084623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:31.084623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:31.084623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:31.084623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:31.084623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:31.084623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:31.084623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:31.084623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:31.084623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:31.085559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:31.085559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:31.085559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:31.085559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:31.089390 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 422/855] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:31.094662 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51789f-3eb3-43c2-aad7-4b0dfc33e3e0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:31.127288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7f76c-bb89-4aba-a8bd-76b9b23103eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:31.127981 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7f76c-bb89-4aba-a8bd-76b9b23103eb None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:31.128265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7f76c-bb89-4aba-a8bd-76b9b23103eb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:31.128547 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7f76c-bb89-4aba-a8bd-76b9b23103eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:31.129626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7f76c-bb89-4aba-a8bd-76b9b23103eb None admin] RBAC: Adding query filter params (role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=9144d74a341b4e08ae353b384fe1186e) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:31.129942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7f76c-bb89-4aba-a8bd-76b9b23103eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:31.132463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7f76c-bb89-4aba-a8bd-76b9b23103eb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:31.136655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:31.145437 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 434/856] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:16:30 2022] GET /identity/v3/role_assignments?user.id=9144d74a341b4e08ae353b384fe1186e&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:31.225523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51789f-3eb3-43c2-aad7-4b0dfc33e3e0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:31.227991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b565b-d748-42e3-b832-e0143e099b0f None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:31.228284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b565b-d748-42e3-b832-e0143e099b0f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:31.228563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b565b-d748-42e3-b832-e0143e099b0f None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:31.230337 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 435/857] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:16:31.235984 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759091e-9690-436e-a14a-2b0d69deb052 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:31.236312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759091e-9690-436e-a14a-2b0d69deb052 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:31.236551 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759091e-9690-436e-a14a-2b0d69deb052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:31.259000 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c759091e-9690-436e-a14a-2b0d69deb052 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:31.260261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c759091e-9690-436e-a14a-2b0d69deb052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:31.281504 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727d2d6-1b9d-42e5-9cf6-842222133e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:31.282844 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727d2d6-1b9d-42e5-9cf6-842222133e8b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:31.283716 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727d2d6-1b9d-42e5-9cf6-842222133e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:31.284199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727d2d6-1b9d-42e5-9cf6-842222133e8b None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:31.285371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727d2d6-1b9d-42e5-9cf6-842222133e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:31.285912 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727d2d6-1b9d-42e5-9cf6-842222133e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:31.288473 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727d2d6-1b9d-42e5-9cf6-842222133e8b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:31.306817 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 423/858] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:31.313785 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727d2d6-1b9d-42e5-9cf6-842222133e8b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:31.347180 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 436/859] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:31.370576 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759091e-9690-436e-a14a-2b0d69deb052 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:31.379817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:31.430977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:31.443089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727d2d6-1b9d-42e5-9cf6-842222133e8b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:31.483920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dab57-54c0-4462-9d14-59141d38ea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:31.484977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dab57-54c0-4462-9d14-59141d38ea7d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:31.485298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dab57-54c0-4462-9d14-59141d38ea7d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:31.485602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dab57-54c0-4462-9d14-59141d38ea7d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:31.499274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dab57-54c0-4462-9d14-59141d38ea7d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:31.501634 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dab57-54c0-4462-9d14-59141d38ea7d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:31.502654 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759091e-9690-436e-a14a-2b0d69deb052 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:31.518503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b23dab57-54c0-4462-9d14-59141d38ea7d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:16:31.518503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:31.518503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:31.518503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:31.518503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:31.518503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:31.518503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:31.518503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:31.518503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:31.518503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:31.518503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:31.518503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:31.518503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:31.518503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:31.518503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:31.518503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:31.519530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:31.520517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:31.520517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:31.520517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:31.520517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:31.520517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:31.520517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:31.520517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:31.520517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:31.520517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:16:31.520517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:31.520517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 424/860] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:16:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:31.525768 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dab57-54c0-4462-9d14-59141d38ea7d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:31.545950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965e162-4baa-4ca1-bbe6-d02c231f7e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:31.547248 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965e162-4baa-4ca1-bbe6-d02c231f7e20 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:31.547804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965e162-4baa-4ca1-bbe6-d02c231f7e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:31.548283 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965e162-4baa-4ca1-bbe6-d02c231f7e20 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:31.549138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965e162-4baa-4ca1-bbe6-d02c231f7e20 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:31.550847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965e162-4baa-4ca1-bbe6-d02c231f7e20 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:31.564877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-8965e162-4baa-4ca1-bbe6-d02c231f7e20 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:16:31.564877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:31.564877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:31.564877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:31.564877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:31.564877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:31.564877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:31.564877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:31.564877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:16:31.564877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:31.564877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:31.564877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:31.564877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:31.564877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:31.564877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:31.564877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:31.565901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:31.565901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:31.565901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:31.565901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:31.565901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:31.565901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:31.565901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:31.565901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:31.565901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:31.565901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:31.565901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:31.565901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:31.565901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:31.565901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:31.565901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:31.565901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:31.566755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:31.566755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:31.566755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:31.566755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:31.566755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:31.566755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:31.566755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:31.566755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:31.566755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:31.566755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:31.566755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:31.566755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:31.566755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:31.566755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:16:31.566755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:31.569608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 437/861] 10.222.0.52 () {56 vars in 1132 bytes} [Fri Jun 17 07:16:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:31.575715 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965e162-4baa-4ca1-bbe6-d02c231f7e20 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:31.642808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dab57-54c0-4462-9d14-59141d38ea7d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:31.653368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:31.679475 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a629d-3441-44a2-aa62-7c3b98d587b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:31.680257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a629d-3441-44a2-aa62-7c3b98d587b4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:31.680482 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a629d-3441-44a2-aa62-7c3b98d587b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:31.680685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a629d-3441-44a2-aa62-7c3b98d587b4 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:31.681540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a629d-3441-44a2-aa62-7c3b98d587b4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:31.681847 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a629d-3441-44a2-aa62-7c3b98d587b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:31.683583 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a629d-3441-44a2-aa62-7c3b98d587b4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:31.691264 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965e162-4baa-4ca1-bbe6-d02c231f7e20 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:31.703421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 425/862] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Jun 17 07:16:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:31.708279 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a629d-3441-44a2-aa62-7c3b98d587b4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:31.723248 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:31.738987 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593bc4cd-3d75-4b37-adea-59d1c9c22ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:31.740049 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bc4cd-3d75-4b37-adea-59d1c9c22ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:31.740438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bc4cd-3d75-4b37-adea-59d1c9c22ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:31.740839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bc4cd-3d75-4b37-adea-59d1c9c22ba1 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:31.741880 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593bc4cd-3d75-4b37-adea-59d1c9c22ba1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:31.742286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593bc4cd-3d75-4b37-adea-59d1c9c22ba1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:31.744383 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593bc4cd-3d75-4b37-adea-59d1c9c22ba1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:31.754823 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 438/863] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Jun 17 07:16:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:31.756149 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593bc4cd-3d75-4b37-adea-59d1c9c22ba1 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:31.853120 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a629d-3441-44a2-aa62-7c3b98d587b4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:31.873843 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593bc4cd-3d75-4b37-adea-59d1c9c22ba1 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:31.902302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c2341-49ec-4fc5-967a-2221a0901be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:31.903931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c2341-49ec-4fc5-967a-2221a0901be6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:31.904306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c2341-49ec-4fc5-967a-2221a0901be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:31.904652 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c2341-49ec-4fc5-967a-2221a0901be6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:31.910873 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5dc25-50a5-4eff-9d8e-165f0bc0e5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:31.911614 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5dc25-50a5-4eff-9d8e-165f0bc0e5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:31.911961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5dc25-50a5-4eff-9d8e-165f0bc0e5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:31.912304 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5dc25-50a5-4eff-9d8e-165f0bc0e5c5 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:31.913079 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5dc25-50a5-4eff-9d8e-165f0bc0e5c5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:31.913497 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5dc25-50a5-4eff-9d8e-165f0bc0e5c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:31.915048 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5dc25-50a5-4eff-9d8e-165f0bc0e5c5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:31.916540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:31.922375 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 439/864] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Jun 17 07:16:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:31.990572 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c2341-49ec-4fc5-967a-2221a0901be6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:31.991983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c2341-49ec-4fc5-967a-2221a0901be6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:32.004042 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:32.105784 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 426/865] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:16:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 07:16:32.112200 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5dc25-50a5-4eff-9d8e-165f0bc0e5c5 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:32.220327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5dc25-50a5-4eff-9d8e-165f0bc0e5c5 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:32.257245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca95386-056c-4acd-b21d-6fd5b1957374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:32.258362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca95386-056c-4acd-b21d-6fd5b1957374 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:32.258807 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca95386-056c-4acd-b21d-6fd5b1957374 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:32.259242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca95386-056c-4acd-b21d-6fd5b1957374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:32.270776 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca95386-056c-4acd-b21d-6fd5b1957374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:32.272406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca95386-056c-4acd-b21d-6fd5b1957374 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:32.289951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-eca95386-056c-4acd-b21d-6fd5b1957374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:32.289951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:32.289951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:32.289951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:32.289951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:32.289951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:32.289951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:32.289951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:32.289951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:32.289951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:32.289951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:32.289951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:32.289951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:32.289951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:32.289951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:32.291082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:32.291082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:32.291082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:32.291082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:32.291082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:32.291082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:32.291082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:32.291082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:32.291082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:32.291082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:32.291082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:32.291082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:32.291082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:32.291082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:32.291082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:32.291082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:32.291082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:32.292212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:32.292212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:32.292212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:32.292212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:32.294859 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 440/866] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:32.300504 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c2341-49ec-4fc5-967a-2221a0901be6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:32.408465 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c2341-49ec-4fc5-967a-2221a0901be6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:32.419198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:32.450278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b15e1-de5e-4672-91d1-93e8178618c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:32.451227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b15e1-de5e-4672-91d1-93e8178618c6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:32.451695 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b15e1-de5e-4672-91d1-93e8178618c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:32.452250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b15e1-de5e-4672-91d1-93e8178618c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:32.453177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b15e1-de5e-4672-91d1-93e8178618c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:32.453674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b15e1-de5e-4672-91d1-93e8178618c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:32.455278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b15e1-de5e-4672-91d1-93e8178618c6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:32.471350 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 427/867] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:32.477174 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca95386-056c-4acd-b21d-6fd5b1957374 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:32.516048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec49d-ebf4-41ab-a94f-cc9baef9df73 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:32.516555 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec49d-ebf4-41ab-a94f-cc9baef9df73 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:32.516991 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec49d-ebf4-41ab-a94f-cc9baef9df73 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:32.518858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 428/868] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:32.525564 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fe32c-f7ce-4263-ba50-ee7634fc2175 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:32.526133 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fe32c-f7ce-4263-ba50-ee7634fc2175 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:32.526641 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fe32c-f7ce-4263-ba50-ee7634fc2175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:32.535121 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:32.545814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3c9fe32c-f7ce-4263-ba50-ee7634fc2175 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:32.547347 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3c9fe32c-f7ce-4263-ba50-ee7634fc2175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:32.599608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca95386-056c-4acd-b21d-6fd5b1957374 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:32.629658 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 429/869] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:32.638741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ffc7-8cd4-46fe-aaf1-672c85de28ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:32.639737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ffc7-8cd4-46fe-aaf1-672c85de28ca None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:32.640170 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ffc7-8cd4-46fe-aaf1-672c85de28ca None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:32.640603 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ffc7-8cd4-46fe-aaf1-672c85de28ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:32.645026 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fe32c-f7ce-4263-ba50-ee7634fc2175 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:32.649595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5ffc7-8cd4-46fe-aaf1-672c85de28ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:32.651228 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5ffc7-8cd4-46fe-aaf1-672c85de28ca None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:32.671260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-eec5ffc7-8cd4-46fe-aaf1-672c85de28ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:32.671260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:32.671260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:32.671260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:32.671260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:32.671260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:32.671260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:32.671260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:32.671260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:32.671260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:32.671260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:32.671260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:32.671260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:32.671260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:32.671260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:32.672372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:32.672372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:32.672372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:32.672372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:32.672372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:32.672372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:32.672372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:32.672372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:32.672372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:32.672372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:32.672372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:32.672372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:32.672372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:32.672372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:32.672372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:32.672372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:32.672372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:32.673498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:32.673498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:32.673498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:32.673498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:32.673498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:32.673498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:32.673498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:32.673498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:32.676511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 441/870] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:32.681663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ffc7-8cd4-46fe-aaf1-672c85de28ca None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:32.758745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:32.763983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fe32c-f7ce-4263-ba50-ee7634fc2175 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:32.793313 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ffc7-8cd4-46fe-aaf1-672c85de28ca None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:32.800224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89db684-388a-43b0-9a52-f2ab98ab9e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:32.801306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89db684-388a-43b0-9a52-f2ab98ab9e9f None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:32.801854 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89db684-388a-43b0-9a52-f2ab98ab9e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:32.802431 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89db684-388a-43b0-9a52-f2ab98ab9e9f None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:32.803336 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89db684-388a-43b0-9a52-f2ab98ab9e9f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:32.804926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89db684-388a-43b0-9a52-f2ab98ab9e9f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:32.805348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:32.829509 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb3b97-fc8b-4749-888e-749e7869441a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:32.830200 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb3b97-fc8b-4749-888e-749e7869441a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:32.830481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb3b97-fc8b-4749-888e-749e7869441a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:32.830758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb3b97-fc8b-4749-888e-749e7869441a None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:32.831534 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb3b97-fc8b-4749-888e-749e7869441a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:32.831893 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb3b97-fc8b-4749-888e-749e7869441a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:32.833372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb3b97-fc8b-4749-888e-749e7869441a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:32.850436 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 442/871] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:32.851861 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb3b97-fc8b-4749-888e-749e7869441a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:32.877873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 430/872] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Jun 17 07:16:32 2022] POST /identity/v3/services => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:16:32.971672 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb3b97-fc8b-4749-888e-749e7869441a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:33.017741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597c320-bdae-4189-8fe0-aa1e6e218353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:33.018835 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597c320-bdae-4189-8fe0-aa1e6e218353 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:33.019315 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597c320-bdae-4189-8fe0-aa1e6e218353 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:33.019804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597c320-bdae-4189-8fe0-aa1e6e218353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:33.020846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597c320-bdae-4189-8fe0-aa1e6e218353 None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=a18b07c033224d2085773936dad33eec) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:33.021391 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597c320-bdae-4189-8fe0-aa1e6e218353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:33.023063 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597c320-bdae-4189-8fe0-aa1e6e218353 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:33.037471 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 443/873] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:16:32 2022] GET /identity/v3/role_assignments?user.id=a18b07c033224d2085773936dad33eec&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:33.518366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45527d50-14be-4c1c-938b-3f964251ba57 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:33.518886 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45527d50-14be-4c1c-938b-3f964251ba57 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:33.518993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45527d50-14be-4c1c-938b-3f964251ba57 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:33.520495 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 431/874] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:33.526059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac0380-340c-4018-94ed-def2cb9b822e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:33.526450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac0380-340c-4018-94ed-def2cb9b822e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:33.526611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac0380-340c-4018-94ed-def2cb9b822e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:33.545610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-10ac0380-340c-4018-94ed-def2cb9b822e None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:33.546810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-10ac0380-340c-4018-94ed-def2cb9b822e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:33.573355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:33.618653 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 444/875] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:33.644515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45527d50-14be-4c1c-938b-3f964251ba57 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:33.760296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45527d50-14be-4c1c-938b-3f964251ba57 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:33.797458 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944425a0-bfaa-48d7-bee7-554643686df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:33.798196 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944425a0-bfaa-48d7-bee7-554643686df9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:33.798478 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944425a0-bfaa-48d7-bee7-554643686df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:33.798753 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944425a0-bfaa-48d7-bee7-554643686df9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:33.809741 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944425a0-bfaa-48d7-bee7-554643686df9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:33.818244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-944425a0-bfaa-48d7-bee7-554643686df9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:16:33.818244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:33.818244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:33.818244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:33.818244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:33.818244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:33.818244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:33.818244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:33.818244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:33.818244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:33.818244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:33.818244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:33.818244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:33.818244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:33.818244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:33.818244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:33.819177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:33.819177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:33.819177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:33.819177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:33.819177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:33.819177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:33.819177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:33.819177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:33.819177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:33.819177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:33.819177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:33.819177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:33.819177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:33.819177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:33.819177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:33.819177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:33.820481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:33.820481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:33.820481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:33.820481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:33.820481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:33.820481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:33.820481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:33.820481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:33.820481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:33.820481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:33.820481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:16:33.820481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:33.820481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 432/876] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Jun 17 07:16:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:33.826498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac0380-340c-4018-94ed-def2cb9b822e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:33.928511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac0380-340c-4018-94ed-def2cb9b822e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:33.969348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31b082-b5e9-4958-a25d-b30412e6657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:33.969348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31b082-b5e9-4958-a25d-b30412e6657d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:33.969348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31b082-b5e9-4958-a25d-b30412e6657d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:33.969348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31b082-b5e9-4958-a25d-b30412e6657d None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:33.969760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31b082-b5e9-4958-a25d-b30412e6657d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:33.969760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31b082-b5e9-4958-a25d-b30412e6657d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:33.969760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31b082-b5e9-4958-a25d-b30412e6657d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:33.977552 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 445/877] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Jun 17 07:16:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:33.983660 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944425a0-bfaa-48d7-bee7-554643686df9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:34.009714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:34.092674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944425a0-bfaa-48d7-bee7-554643686df9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:34.128810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b50976-7078-464c-a344-77612a435e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:34.129654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b50976-7078-464c-a344-77612a435e51 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:34.130066 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b50976-7078-464c-a344-77612a435e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:34.130344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b50976-7078-464c-a344-77612a435e51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:34.141597 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b50976-7078-464c-a344-77612a435e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:34.143058 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b50976-7078-464c-a344-77612a435e51 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:34.163532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-f3b50976-7078-464c-a344-77612a435e51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:34.163532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:34.163532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:34.163532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:34.163532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:34.163532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:34.163532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:34.163532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:34.163532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:34.163532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:34.163532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:34.163532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:34.163532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:34.163532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:34.163532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:34.164498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:34.164498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:34.164498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:34.164498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:34.164498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:34.164498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:34.164498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:34.164498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:34.164498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:34.164498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:34.164498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:34.164498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:34.164498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:34.164498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:34.164498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:34.164498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:34.164498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:34.165888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:34.165888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:34.165888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:34.165888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:34.165888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 433/878] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:34.172112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31b082-b5e9-4958-a25d-b30412e6657d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:34.209699 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:34.229480 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2999213-ea88-48b4-b413-7d8166691bb2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:34.230141 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2999213-ea88-48b4-b413-7d8166691bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:34.230686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2999213-ea88-48b4-b413-7d8166691bb2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:34.233433 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 434/879] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:16:34.240296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732373a-3b10-48b6-bdcc-6f7e5cf0bfa5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:34.240957 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732373a-3b10-48b6-bdcc-6f7e5cf0bfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:34.241482 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732373a-3b10-48b6-bdcc-6f7e5cf0bfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:34.264159 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b732373a-3b10-48b6-bdcc-6f7e5cf0bfa5 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:34.265900 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b732373a-3b10-48b6-bdcc-6f7e5cf0bfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:34.287444 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31b082-b5e9-4958-a25d-b30412e6657d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:34.325148 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04277-1ca4-4c15-aea6-d012a8346c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:34.326200 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04277-1ca4-4c15-aea6-d012a8346c1c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:34.326694 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04277-1ca4-4c15-aea6-d012a8346c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:34.327171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04277-1ca4-4c15-aea6-d012a8346c1c None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:34.328141 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b04277-1ca4-4c15-aea6-d012a8346c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:34.328679 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b04277-1ca4-4c15-aea6-d012a8346c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:34.330412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b04277-1ca4-4c15-aea6-d012a8346c1c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:34.345051 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 446/880] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:34.351815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04277-1ca4-4c15-aea6-d012a8346c1c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:34.357452 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:34.366973 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 435/881] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:34 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:34.392460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732373a-3b10-48b6-bdcc-6f7e5cf0bfa5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:34.454973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:34.478375 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04277-1ca4-4c15-aea6-d012a8346c1c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:34.504071 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732373a-3b10-48b6-bdcc-6f7e5cf0bfa5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:34.523768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277a355-54c9-48a5-8d75-861edc205cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:34.524907 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277a355-54c9-48a5-8d75-861edc205cdd None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:34.525418 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277a355-54c9-48a5-8d75-861edc205cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:34.526319 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277a355-54c9-48a5-8d75-861edc205cdd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:34.537115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277a355-54c9-48a5-8d75-861edc205cdd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:34.538898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277a355-54c9-48a5-8d75-861edc205cdd None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:34.545294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb164f-eae3-446c-819a-f9fa2761be68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:34.545984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb164f-eae3-446c-819a-f9fa2761be68 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:34.546268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb164f-eae3-446c-819a-f9fa2761be68 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:34.546546 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb164f-eae3-446c-819a-f9fa2761be68 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:34.547267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb164f-eae3-446c-819a-f9fa2761be68 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:34.548630 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb164f-eae3-446c-819a-f9fa2761be68 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:34.563151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-6277a355-54c9-48a5-8d75-861edc205cdd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:16:34.563151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:34.563151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:34.563151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:34.563151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:34.563151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:34.563151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:34.563151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:34.563151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:34.563151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:34.563151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:34.563151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:34.563151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:34.563151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:34.563151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:34.563151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:34.564193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:34.565169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:34.565169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:34.565169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:34.565169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:34.565169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:34.565169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:34.565169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:34.565169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:34.565169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:16:34.565169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:34.569067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 447/882] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Jun 17 07:16:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:34.569899 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277a355-54c9-48a5-8d75-861edc205cdd None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:34.638825 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 436/883] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Jun 17 07:16:34 2022] POST /identity/v3/services => generated 269 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:16:34.692964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277a355-54c9-48a5-8d75-861edc205cdd None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:34.740488 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c62c2-96cb-4c5a-b5a6-d7a75391f681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:34.741460 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c62c2-96cb-4c5a-b5a6-d7a75391f681 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:34.741931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c62c2-96cb-4c5a-b5a6-d7a75391f681 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:34.742386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c62c2-96cb-4c5a-b5a6-d7a75391f681 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:34.743382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c62c2-96cb-4c5a-b5a6-d7a75391f681 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:34.743851 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c62c2-96cb-4c5a-b5a6-d7a75391f681 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:34.745542 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c62c2-96cb-4c5a-b5a6-d7a75391f681 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:34.756672 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:34.773307 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 448/884] 10.222.0.52 () {56 vars in 1149 bytes} [Fri Jun 17 07:16:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:34.780346 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb164f-eae3-446c-819a-f9fa2761be68 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:34.848922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:34.893998 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb164f-eae3-446c-819a-f9fa2761be68 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:34.930893 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf242-ac44-4e0d-9198-de8b25bb8196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:34.931559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf242-ac44-4e0d-9198-de8b25bb8196 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:34.931838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf242-ac44-4e0d-9198-de8b25bb8196 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:34.932115 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf242-ac44-4e0d-9198-de8b25bb8196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:35.006404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edf242-ac44-4e0d-9198-de8b25bb8196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:35.007970 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edf242-ac44-4e0d-9198-de8b25bb8196 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:35.077759 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:35.112119 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a16da-f88c-4b55-b956-04de2aa97c24 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:35.112432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a16da-f88c-4b55-b956-04de2aa97c24 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:35.112683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a16da-f88c-4b55-b956-04de2aa97c24 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:35.114341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 449/885] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:35.119167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aede9-8a81-48c6-a035-14111c659cb7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:35.119476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aede9-8a81-48c6-a035-14111c659cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:35.119727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aede9-8a81-48c6-a035-14111c659cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:35.123589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 437/886] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:16:34 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:16:35.129009 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf242-ac44-4e0d-9198-de8b25bb8196 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:35.142328 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-821aede9-8a81-48c6-a035-14111c659cb7 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:35.149715 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-821aede9-8a81-48c6-a035-14111c659cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:35.243501 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf242-ac44-4e0d-9198-de8b25bb8196 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:35.244275 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 450/887] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:35.264634 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821aede9-8a81-48c6-a035-14111c659cb7 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:35.283768 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146a447-3a70-4831-8052-b8daedaff64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:35.285707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146a447-3a70-4831-8052-b8daedaff64c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:35.286246 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146a447-3a70-4831-8052-b8daedaff64c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:35.286722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146a447-3a70-4831-8052-b8daedaff64c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:35.301000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146a447-3a70-4831-8052-b8daedaff64c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:35.302479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146a447-3a70-4831-8052-b8daedaff64c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:35.319855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-7146a447-3a70-4831-8052-b8daedaff64c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:35.319855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:35.319855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:35.319855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:35.319855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:35.319855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:35.319855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:35.319855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:35.319855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:35.319855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:35.319855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:35.319855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:35.319855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:35.319855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:35.319855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:35.320763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:35.320763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:35.320763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:35.320763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:35.320763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:35.320763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:35.320763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:35.320763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:35.320763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:35.320763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:35.320763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:35.320763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:35.320763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:35.320763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:35.320763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:35.320763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:35.320763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:35.322244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:35.322244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:35.322244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:35.322244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:35.322244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 438/888] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:35.322530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceddba7-5153-4d00-9198-cfd74cf1943c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:35.322530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceddba7-5153-4d00-9198-cfd74cf1943c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:35.322853 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceddba7-5153-4d00-9198-cfd74cf1943c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:35.325233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 439/889] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:35.327454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceddba7-5153-4d00-9198-cfd74cf1943c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:35.342885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:35.379714 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821aede9-8a81-48c6-a035-14111c659cb7 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:35.409232 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:35.418648 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e922d-9ed9-4cea-b8fd-b88c45a26c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:35.419644 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e922d-9ed9-4cea-b8fd-b88c45a26c9e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:35.420076 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e922d-9ed9-4cea-b8fd-b88c45a26c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:35.420604 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e922d-9ed9-4cea-b8fd-b88c45a26c9e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:35.421555 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e922d-9ed9-4cea-b8fd-b88c45a26c9e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:35.423076 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e922d-9ed9-4cea-b8fd-b88c45a26c9e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:35.436105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-bf8e922d-9ed9-4cea-b8fd-b88c45a26c9e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:16:35.436105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:35.436105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:35.436105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:35.436105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:35.436105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:35.436105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:35.436105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:35.436105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:16:35.436105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:35.436105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:35.436105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:35.436105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:35.436105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:35.436105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:35.436105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:35.436105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:35.437286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:35.437286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:35.437286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:35.437286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:35.437286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:35.437286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:35.437286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:35.437286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:35.437286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:35.437286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:35.437286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:35.437286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:35.437286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:35.437286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:35.437286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:35.437286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:35.438341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:35.438341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:35.438341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:35.438341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:35.438341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:35.438341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:35.438341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:35.438341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:35.438341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:35.438341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:35.438341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:35.438341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:35.438341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:16:35.438341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:35.439266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceddba7-5153-4d00-9198-cfd74cf1943c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:35.445648 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 451/890] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:16:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:35.447279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a573c7-fa65-4960-b9f5-1dcbc610940f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:35.447824 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a573c7-fa65-4960-b9f5-1dcbc610940f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:35.448314 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a573c7-fa65-4960-b9f5-1dcbc610940f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:35.466865 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-97a573c7-fa65-4960-b9f5-1dcbc610940f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:35.468524 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-97a573c7-fa65-4960-b9f5-1dcbc610940f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:35.472915 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1f94b-8e34-4734-9369-867c9845ba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:35.473604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1f94b-8e34-4734-9369-867c9845ba27 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:35.473883 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1f94b-8e34-4734-9369-867c9845ba27 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:35.474155 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1f94b-8e34-4734-9369-867c9845ba27 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:35.474976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1f94b-8e34-4734-9369-867c9845ba27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:35.475315 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1f94b-8e34-4734-9369-867c9845ba27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:35.476665 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1f94b-8e34-4734-9369-867c9845ba27 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:35.488021 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 440/891] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:35.488021 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1f94b-8e34-4734-9369-867c9845ba27 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:35.545274 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 452/892] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:35.546911 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a573c7-fa65-4960-b9f5-1dcbc610940f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:35.581286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:35.617537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1f94b-8e34-4734-9369-867c9845ba27 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:35.653259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7d041-7bc1-4696-8363-ab706b5aaf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:35.653958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7d041-7bc1-4696-8363-ab706b5aaf8e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:35.654244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7d041-7bc1-4696-8363-ab706b5aaf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:35.654522 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7d041-7bc1-4696-8363-ab706b5aaf8e None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:35.655220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7d041-7bc1-4696-8363-ab706b5aaf8e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:35.655529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7d041-7bc1-4696-8363-ab706b5aaf8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:35.656908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7d041-7bc1-4696-8363-ab706b5aaf8e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:35.662116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 441/893] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:16:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:35.662828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7d041-7bc1-4696-8363-ab706b5aaf8e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:35.668693 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a573c7-fa65-4960-b9f5-1dcbc610940f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:35.691936 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:35.707982 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8173bd-dc3a-4d2a-aa33-c23cc065a4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:35.709286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8173bd-dc3a-4d2a-aa33-c23cc065a4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:35.709600 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8173bd-dc3a-4d2a-aa33-c23cc065a4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:35.709870 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8173bd-dc3a-4d2a-aa33-c23cc065a4b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:35.718651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8173bd-dc3a-4d2a-aa33-c23cc065a4b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:35.720918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8173bd-dc3a-4d2a-aa33-c23cc065a4b7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:35.737908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-bd8173bd-dc3a-4d2a-aa33-c23cc065a4b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:35.737908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:35.737908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:35.737908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:35.737908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:35.737908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:35.737908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:35.737908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:35.737908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:35.737908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:35.737908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:35.737908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:35.737908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:35.737908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:35.737908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:35.738968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:35.738968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:35.738968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:35.738968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:35.738968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:35.738968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:35.738968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:35.738968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:35.738968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:35.738968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:35.738968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:35.738968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:35.738968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:35.738968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:35.738968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:35.738968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:35.738968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:35.739872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:35.739872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:35.739872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:35.739872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:35.739872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:35.739872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:35.739872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:35.739872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:35.739872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 453/894] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:35.739872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8173bd-dc3a-4d2a-aa33-c23cc065a4b7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:35.783579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7d041-7bc1-4696-8363-ab706b5aaf8e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:35.817787 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b134b-25ff-47d3-9b0e-2963de8502ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:35.818664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b134b-25ff-47d3-9b0e-2963de8502ae None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:35.818944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b134b-25ff-47d3-9b0e-2963de8502ae None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:35.819216 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b134b-25ff-47d3-9b0e-2963de8502ae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:35.819924 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b134b-25ff-47d3-9b0e-2963de8502ae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:35.821303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b134b-25ff-47d3-9b0e-2963de8502ae None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:35.823865 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:35.834301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b21b134b-25ff-47d3-9b0e-2963de8502ae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:16:35.834301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:35.834301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:35.834301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:35.834301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:35.834301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:35.834301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:35.834301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:35.834301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:16:35.834301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:35.834301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:35.834301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:35.834301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:35.834301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:35.834301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:35.834301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:35.834301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:35.842575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:35.842575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:35.842575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:35.842575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:35.842575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:35.842575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:35.842575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:35.842575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:35.842575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:35.842575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:35.842575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:35.842575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:35.842575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:35.842575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:35.842575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:35.842575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:35.843411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:35.843411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:35.843411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:35.843411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:35.843411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:35.843411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:35.843411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:35.843411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:35.843411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:35.843411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:35.843411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:35.843411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:35.843411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:16:35.843411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:35.843411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 442/895] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Jun 17 07:16:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:35.844291 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b134b-25ff-47d3-9b0e-2963de8502ae None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:35.861768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8173bd-dc3a-4d2a-aa33-c23cc065a4b7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:35.898733 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e1969-f6c6-4514-9866-b3952be816fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:35.899639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e1969-f6c6-4514-9866-b3952be816fe None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:35.900035 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e1969-f6c6-4514-9866-b3952be816fe None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:35.900302 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e1969-f6c6-4514-9866-b3952be816fe None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:35.900999 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e1969-f6c6-4514-9866-b3952be816fe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:35.901303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e1969-f6c6-4514-9866-b3952be816fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:35.903390 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e1969-f6c6-4514-9866-b3952be816fe None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:35.913712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 454/896] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:16:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:35.913712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e1969-f6c6-4514-9866-b3952be816fe None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:35.945807 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b134b-25ff-47d3-9b0e-2963de8502ae None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:35.960905 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:35.981767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aeb003-9767-45a8-8c6c-482604864c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:35.982437 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeb003-9767-45a8-8c6c-482604864c4a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:35.982724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeb003-9767-45a8-8c6c-482604864c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:35.983004 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeb003-9767-45a8-8c6c-482604864c4a None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:35.983817 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aeb003-9767-45a8-8c6c-482604864c4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:35.984130 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aeb003-9767-45a8-8c6c-482604864c4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:35.985584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aeb003-9767-45a8-8c6c-482604864c4a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:36.003144 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 443/897] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:36.003144 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aeb003-9767-45a8-8c6c-482604864c4a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:36.027384 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e1969-f6c6-4514-9866-b3952be816fe None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:36.061648 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e680a8-5475-4f48-be70-34d08e3c2537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:36.062414 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e680a8-5475-4f48-be70-34d08e3c2537 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:36.062699 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e680a8-5475-4f48-be70-34d08e3c2537 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:36.062972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e680a8-5475-4f48-be70-34d08e3c2537 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:36.063661 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e680a8-5475-4f48-be70-34d08e3c2537 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:36.063966 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e680a8-5475-4f48-be70-34d08e3c2537 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:36.065121 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:36.065617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e680a8-5475-4f48-be70-34d08e3c2537 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:36.074488 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 455/898] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Jun 17 07:16:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:36.074488 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e680a8-5475-4f48-be70-34d08e3c2537 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:36.107932 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aeb003-9767-45a8-8c6c-482604864c4a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:36.143230 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeccf40-c793-451c-ae9c-96fbd21855f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:36.143896 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeccf40-c793-451c-ae9c-96fbd21855f9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:36.144181 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeccf40-c793-451c-ae9c-96fbd21855f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:36.144455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeccf40-c793-451c-ae9c-96fbd21855f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:36.145239 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeccf40-c793-451c-ae9c-96fbd21855f9 None admin] RBAC: Adding query filter params (interface=public, service_id=bac29928e5e64eb9bbd94236e3e40ea2, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:36.145578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeccf40-c793-451c-ae9c-96fbd21855f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:36.146947 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeccf40-c793-451c-ae9c-96fbd21855f9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:36.157098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 444/899] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Jun 17 07:16:35 2022] GET /identity/v3/endpoints?service_id=bac29928e5e64eb9bbd94236e3e40ea2&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:36.157098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeccf40-c793-451c-ae9c-96fbd21855f9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:36.186676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e680a8-5475-4f48-be70-34d08e3c2537 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:36.195752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:36.221414 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c91819-0f22-4cb1-8d47-de5da2f0f12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:36.222073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c91819-0f22-4cb1-8d47-de5da2f0f12d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:36.222354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c91819-0f22-4cb1-8d47-de5da2f0f12d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:36.222633 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c91819-0f22-4cb1-8d47-de5da2f0f12d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:36.223521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c91819-0f22-4cb1-8d47-de5da2f0f12d None admin] RBAC: Adding query filter params (role.id=ad9cdfc3afef42c9a483ec04f9815c3b, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=9144d74a341b4e08ae353b384fe1186e) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:36.223824 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c91819-0f22-4cb1-8d47-de5da2f0f12d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:36.225285 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c91819-0f22-4cb1-8d47-de5da2f0f12d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:36.241369 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 456/900] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:16:36 2022] GET /identity/v3/role_assignments?user.id=9144d74a341b4e08ae353b384fe1186e&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=ad9cdfc3afef42c9a483ec04f9815c3b => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:36.241369 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c91819-0f22-4cb1-8d47-de5da2f0f12d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:36.306242 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeccf40-c793-451c-ae9c-96fbd21855f9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:36.335704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:36.349991 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b3619-d032-4e13-bcf4-69449039597d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:36.350779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b3619-d032-4e13-bcf4-69449039597d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:36.351130 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b3619-d032-4e13-bcf4-69449039597d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:36.351501 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b3619-d032-4e13-bcf4-69449039597d None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:36.352295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b3619-d032-4e13-bcf4-69449039597d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:36.352671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b3619-d032-4e13-bcf4-69449039597d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:36.354892 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b3619-d032-4e13-bcf4-69449039597d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:36.365980 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 445/901] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Jun 17 07:16:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:36.384109 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c91819-0f22-4cb1-8d47-de5da2f0f12d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:36.426105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3f0b3-82c9-48d4-97c0-f7d011de0880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:36.426801 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3f0b3-82c9-48d4-97c0-f7d011de0880 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:36.427086 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3f0b3-82c9-48d4-97c0-f7d011de0880 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:36.427361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3f0b3-82c9-48d4-97c0-f7d011de0880 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:36.428069 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3f0b3-82c9-48d4-97c0-f7d011de0880 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:36.429549 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3f0b3-82c9-48d4-97c0-f7d011de0880 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:36.437520 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 457/902] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Jun 17 07:16:36 2022] GET /identity/v3/services => generated 1268 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:16:36.965109 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230c49e-ef83-4e8c-b845-f27d6e178e30 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:36.966293 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230c49e-ef83-4e8c-b845-f27d6e178e30 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:36.966901 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230c49e-ef83-4e8c-b845-f27d6e178e30 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:36.968601 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 446/903] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:36.974433 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e53410-085c-4d97-bf0f-d24177837e04 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:36.975074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e53410-085c-4d97-bf0f-d24177837e04 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:36.975074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e53410-085c-4d97-bf0f-d24177837e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:36.993496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d4e53410-085c-4d97-bf0f-d24177837e04 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:36.994700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d4e53410-085c-4d97-bf0f-d24177837e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:37.026154 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:37.069752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 458/904] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:37.095338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230c49e-ef83-4e8c-b845-f27d6e178e30 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:37.210634 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230c49e-ef83-4e8c-b845-f27d6e178e30 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:37.246299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa952a72-f98a-4f28-9c74-04f1a07a6d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:37.249355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa952a72-f98a-4f28-9c74-04f1a07a6d39 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:37.249355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa952a72-f98a-4f28-9c74-04f1a07a6d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:37.249355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa952a72-f98a-4f28-9c74-04f1a07a6d39 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:37.249355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa952a72-f98a-4f28-9c74-04f1a07a6d39 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:37.250108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa952a72-f98a-4f28-9c74-04f1a07a6d39 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:37.263359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-aa952a72-f98a-4f28-9c74-04f1a07a6d39 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:16:37.263359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:37.263359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:37.263359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:37.263359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:37.263359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:37.263359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:37.263359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:37.263359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:16:37.263359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:37.263359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:37.263359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:37.263359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:37.263359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:37.263359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:37.263359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:37.264343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:37.264343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:37.264343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:37.264343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:37.264343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:37.264343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:37.264343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:37.264343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:37.264343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:37.264343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:37.264343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:37.264343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:37.264343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:37.264343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:37.264343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:37.264343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:37.265184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:37.265184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:37.265184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:37.265184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:37.265184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:37.265184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:37.265184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:37.265184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:37.265184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:37.265184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:37.265184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:37.265184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:37.265184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:37.265184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:16:37.265184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:37.265184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 447/905] 10.222.0.52 () {56 vars in 1132 bytes} [Fri Jun 17 07:16:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:37.270491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e53410-085c-4d97-bf0f-d24177837e04 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:37.370658 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e53410-085c-4d97-bf0f-d24177837e04 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:37.406438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c16b94-e157-4979-8ff0-e8ed8b511251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:37.407107 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c16b94-e157-4979-8ff0-e8ed8b511251 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:37.407391 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c16b94-e157-4979-8ff0-e8ed8b511251 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:37.407712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c16b94-e157-4979-8ff0-e8ed8b511251 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:37.408415 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c16b94-e157-4979-8ff0-e8ed8b511251 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:37.408715 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c16b94-e157-4979-8ff0-e8ed8b511251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:37.410101 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c16b94-e157-4979-8ff0-e8ed8b511251 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:37.415198 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 459/906] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Jun 17 07:16:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:37.421292 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa952a72-f98a-4f28-9c74-04f1a07a6d39 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:37.479559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:37.530745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa952a72-f98a-4f28-9c74-04f1a07a6d39 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:37.569078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b426a9-7ebf-4bc6-8ad4-41508476368d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:37.569772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b426a9-7ebf-4bc6-8ad4-41508476368d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:37.570053 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b426a9-7ebf-4bc6-8ad4-41508476368d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:37.570325 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b426a9-7ebf-4bc6-8ad4-41508476368d None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:37.571025 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b426a9-7ebf-4bc6-8ad4-41508476368d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:37.571326 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b426a9-7ebf-4bc6-8ad4-41508476368d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:37.572682 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b426a9-7ebf-4bc6-8ad4-41508476368d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:37.578116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 448/907] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Jun 17 07:16:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:37.584598 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c16b94-e157-4979-8ff0-e8ed8b511251 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:37.623988 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:37.695425 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c16b94-e157-4979-8ff0-e8ed8b511251 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:37.730100 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6268f-1d38-4ff0-89e7-871327030103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:37.731394 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6268f-1d38-4ff0-89e7-871327030103 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:37.731764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6268f-1d38-4ff0-89e7-871327030103 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:37.732035 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6268f-1d38-4ff0-89e7-871327030103 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:37.732813 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6268f-1d38-4ff0-89e7-871327030103 None admin] RBAC: Adding query filter params (interface=public, service_id=43c57895833b48f68fb75eede6d5ab2a, region_id=RegionOne) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:37.733126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6268f-1d38-4ff0-89e7-871327030103 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:37.734509 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6268f-1d38-4ff0-89e7-871327030103 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:37.739935 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 460/908] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Jun 17 07:16:37 2022] GET /identity/v3/endpoints?service_id=43c57895833b48f68fb75eede6d5ab2a&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:37.746703 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b426a9-7ebf-4bc6-8ad4-41508476368d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:37.850877 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b426a9-7ebf-4bc6-8ad4-41508476368d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:37.867671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:37.886376 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5901b21-09c8-42f0-8b80-2e89cf20c1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:37.887118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5901b21-09c8-42f0-8b80-2e89cf20c1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:37.887834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5901b21-09c8-42f0-8b80-2e89cf20c1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:37.888180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5901b21-09c8-42f0-8b80-2e89cf20c1d0 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:37.888863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5901b21-09c8-42f0-8b80-2e89cf20c1d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:37.890254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5901b21-09c8-42f0-8b80-2e89cf20c1d0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:37.896374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 449/909] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Jun 17 07:16:37 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:16:38.540216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9a03-6793-42e4-8b8d-5658d894215c None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:38.540762 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9a03-6793-42e4-8b8d-5658d894215c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:38.540762 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9a03-6793-42e4-8b8d-5658d894215c None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:38.542418 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 461/910] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:38.547924 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d592db2-6ae1-4b5f-a55f-75437903c999 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:38.548461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d592db2-6ae1-4b5f-a55f-75437903c999 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:38.548461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d592db2-6ae1-4b5f-a55f-75437903c999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:38.566341 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9d592db2-6ae1-4b5f-a55f-75437903c999 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:38.567560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9d592db2-6ae1-4b5f-a55f-75437903c999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:38.645538 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c715a41-621e-42dc-ba54-a6825dc130c6 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:38.646179 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c715a41-621e-42dc-ba54-a6825dc130c6 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:38.646663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c715a41-621e-42dc-ba54-a6825dc130c6 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:38.648663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 462/912] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:38.648805 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 450/912] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:38.654934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc9d60-867d-4a55-8623-9cd39a3ca08d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:38.655255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc9d60-867d-4a55-8623-9cd39a3ca08d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:38.655489 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc9d60-867d-4a55-8623-9cd39a3ca08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:38.676118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c715a41-621e-42dc-ba54-a6825dc130c6 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:38.687846 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cafc9d60-867d-4a55-8623-9cd39a3ca08d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:38.689362 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cafc9d60-867d-4a55-8623-9cd39a3ca08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:38.763944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 451/913] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:38.765710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec9082-3621-4f20-8309-243ac7ace96c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:38.766237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec9082-3621-4f20-8309-243ac7ace96c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:38.766718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec9082-3621-4f20-8309-243ac7ace96c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:38.768204 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 452/914] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:38.774105 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58138de8-a564-4300-b129-50156e266fa1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:38.774639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58138de8-a564-4300-b129-50156e266fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:38.775406 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58138de8-a564-4300-b129-50156e266fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:38.793671 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:38.798127 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-58138de8-a564-4300-b129-50156e266fa1 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:38.799317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-58138de8-a564-4300-b129-50156e266fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:38.801544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c715a41-621e-42dc-ba54-a6825dc130c6 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:38.834803 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:38.845357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9cd14-de1d-4b28-b146-dca6a62f2303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:38.846442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9cd14-de1d-4b28-b146-dca6a62f2303 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:38.846726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9cd14-de1d-4b28-b146-dca6a62f2303 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:38.847002 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9cd14-de1d-4b28-b146-dca6a62f2303 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:38.860697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9cd14-de1d-4b28-b146-dca6a62f2303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:38.868416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 453/915] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:38.869160 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58138de8-a564-4300-b129-50156e266fa1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:38.878031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-d5b9cd14-de1d-4b28-b146-dca6a62f2303 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:16:38.878031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:38.878031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:38.878031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:38.878031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:38.878031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:38.878031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:38.878031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:38.878031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:38.878031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:38.878031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:38.878031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:38.878031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:38.878031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:38.878031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:38.878031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:38.879092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:38.879092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:38.879092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:38.879092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:38.879092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:38.879092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:38.879092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:38.879092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:38.879092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:38.879092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:38.879092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:38.879092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:38.879092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:38.879092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:38.879092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:38.879092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:38.879939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:38.879939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:38.879939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:38.879939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:38.879939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:38.879939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:38.879939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:38.879939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:38.879939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:38.879939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:38.879939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:16:38.879939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:38.882850 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 463/916] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Jun 17 07:16:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:38.889116 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9cd14-de1d-4b28-b146-dca6a62f2303 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:38.980202 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58138de8-a564-4300-b129-50156e266fa1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:38.999210 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9cd14-de1d-4b28-b146-dca6a62f2303 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:39.016125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1aea9-8e1d-4955-a842-8a901e9ec775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:39.016802 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1aea9-8e1d-4955-a842-8a901e9ec775 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:39.017094 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1aea9-8e1d-4955-a842-8a901e9ec775 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:39.017394 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1aea9-8e1d-4955-a842-8a901e9ec775 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:39.018132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1aea9-8e1d-4955-a842-8a901e9ec775 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:39.019559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1aea9-8e1d-4955-a842-8a901e9ec775 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:39.039525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12eb505-d59e-4be2-bb17-9a88cd7f2462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:39.040196 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb505-d59e-4be2-bb17-9a88cd7f2462 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:39.040580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb505-d59e-4be2-bb17-9a88cd7f2462 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:39.040864 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb505-d59e-4be2-bb17-9a88cd7f2462 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:39.041716 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12eb505-d59e-4be2-bb17-9a88cd7f2462 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:39.042027 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12eb505-d59e-4be2-bb17-9a88cd7f2462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:39.044088 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12eb505-d59e-4be2-bb17-9a88cd7f2462 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:39.052740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 464/917] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Jun 17 07:16:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:39.054353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12eb505-d59e-4be2-bb17-9a88cd7f2462 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:39.074015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:39.084863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 454/918] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Jun 17 07:16:38 2022] POST /identity/v3/services => generated 241 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:16:39.084863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1aea9-8e1d-4955-a842-8a901e9ec775 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:39.126611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:39.179414 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12eb505-d59e-4be2-bb17-9a88cd7f2462 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:39.235232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1aea9-8e1d-4955-a842-8a901e9ec775 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:39.235586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0ed97-d233-4f74-bbee-e562e80ddb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:39.236511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0ed97-d233-4f74-bbee-e562e80ddb90 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:39.237008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0ed97-d233-4f74-bbee-e562e80ddb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:39.237424 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0ed97-d233-4f74-bbee-e562e80ddb90 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:39.238309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0ed97-d233-4f74-bbee-e562e80ddb90 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:39.239835 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0ed97-d233-4f74-bbee-e562e80ddb90 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:39.254738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-f1e0ed97-d233-4f74-bbee-e562e80ddb90 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:16:39.254738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:39.254738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:39.254738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:39.254738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:39.254738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:39.254738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:39.254738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:39.254738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:16:39.254738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:39.254738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:39.254738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:39.254738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:39.254738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:39.254738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:39.254738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:39.254738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:39.255814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:39.255814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:39.255814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:39.255814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:39.255814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:39.255814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:39.255814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:39.255814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:39.255814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:39.255814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:39.255814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:39.255814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:39.255814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:39.255814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:39.255814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:39.255814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:39.256660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:39.256660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:39.256660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:39.256660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:39.256660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:39.256660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:39.256660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:39.256660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:39.256660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:39.256660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:39.256660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:39.256660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:39.256660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:16:39.256660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:39.261222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 465/919] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:16:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:39.263906 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0ed97-d233-4f74-bbee-e562e80ddb90 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:39.291869 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dd5da-dac6-4baf-97ee-8266f3ab4e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:39.293770 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dd5da-dac6-4baf-97ee-8266f3ab4e94 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:39.294522 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dd5da-dac6-4baf-97ee-8266f3ab4e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:39.294758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dd5da-dac6-4baf-97ee-8266f3ab4e94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:39.310972 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dd5da-dac6-4baf-97ee-8266f3ab4e94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:39.313426 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dd5da-dac6-4baf-97ee-8266f3ab4e94 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:39.336834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8e2dd5da-dac6-4baf-97ee-8266f3ab4e94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:39.336834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:39.336834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:39.336834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:39.336834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:39.336834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:39.336834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:39.336834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:39.336834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:39.336834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:39.336834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:39.336834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:39.336834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:39.336834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:39.336834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:39.338019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:39.338019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:39.338019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:39.338019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:39.338019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:39.338019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:39.338019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:39.338019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:39.338019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:39.338019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:39.338019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:39.338019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:39.338019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:39.338019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:39.338019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:39.338019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:39.338019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:39.338973 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:39.338973 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:39.338973 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:39.338973 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:39.338973 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 455/920] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:39.346377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dd5da-dac6-4baf-97ee-8266f3ab4e94 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:39.375682 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:39.410442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0ed97-d233-4f74-bbee-e562e80ddb90 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:39.457354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:39.458604 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf739ebe-1748-4de9-bb86-7a9791f82eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:39.459595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf739ebe-1748-4de9-bb86-7a9791f82eac None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:39.460107 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf739ebe-1748-4de9-bb86-7a9791f82eac None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:39.460693 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf739ebe-1748-4de9-bb86-7a9791f82eac None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:39.461769 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf739ebe-1748-4de9-bb86-7a9791f82eac None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:39.462085 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf739ebe-1748-4de9-bb86-7a9791f82eac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:39.464355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf739ebe-1748-4de9-bb86-7a9791f82eac None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:39.473998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 466/921] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:16:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:39.479367 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf739ebe-1748-4de9-bb86-7a9791f82eac None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:39.491738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dd5da-dac6-4baf-97ee-8266f3ab4e94 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:39.543029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b4473-8b77-4794-b07c-915bfe4e0249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:39.544831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b4473-8b77-4794-b07c-915bfe4e0249 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:39.545362 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b4473-8b77-4794-b07c-915bfe4e0249 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:39.545841 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b4473-8b77-4794-b07c-915bfe4e0249 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:39.546763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b4473-8b77-4794-b07c-915bfe4e0249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:39.547809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b4473-8b77-4794-b07c-915bfe4e0249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:39.549717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b4473-8b77-4794-b07c-915bfe4e0249 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:39.568055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 456/922] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:39.574348 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b4473-8b77-4794-b07c-915bfe4e0249 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:39.611837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf739ebe-1748-4de9-bb86-7a9791f82eac None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:39.658527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31414be9-f8d7-4ac7-beb5-ea316d37c133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:39.659376 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31414be9-f8d7-4ac7-beb5-ea316d37c133 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:39.659656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31414be9-f8d7-4ac7-beb5-ea316d37c133 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:39.659939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31414be9-f8d7-4ac7-beb5-ea316d37c133 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:39.660665 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31414be9-f8d7-4ac7-beb5-ea316d37c133 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:39.660969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31414be9-f8d7-4ac7-beb5-ea316d37c133 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:39.662397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31414be9-f8d7-4ac7-beb5-ea316d37c133 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:39.672903 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 467/923] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Jun 17 07:16:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:39.676782 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31414be9-f8d7-4ac7-beb5-ea316d37c133 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:39.685236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:39.727380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b4473-8b77-4794-b07c-915bfe4e0249 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:39.778748 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3350a-0fce-4328-89b9-766c75337731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:39.780166 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3350a-0fce-4328-89b9-766c75337731 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:39.780166 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3350a-0fce-4328-89b9-766c75337731 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:39.780166 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3350a-0fce-4328-89b9-766c75337731 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:39.789307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3350a-0fce-4328-89b9-766c75337731 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:39.792141 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3350a-0fce-4328-89b9-766c75337731 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:39.794811 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:39.814530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-15a3350a-0fce-4328-89b9-766c75337731 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:16:39.814530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:39.814530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:39.814530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:39.814530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:39.814530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:39.814530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:39.814530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:39.814530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:39.814530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:39.814530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:39.814530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:39.814530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:39.814530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:39.814530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:39.814530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:39.815558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:39.816540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:39.816540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:39.816540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:39.816540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:39.816540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:39.816540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:39.816540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:39.816540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:39.816540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:16:39.816540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:39.820339 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 457/924] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Jun 17 07:16:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:39.821919 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3350a-0fce-4328-89b9-766c75337731 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:39.824307 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31414be9-f8d7-4ac7-beb5-ea316d37c133 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:39.873090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641784c9-09de-4461-866c-a131f373f93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:39.874754 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641784c9-09de-4461-866c-a131f373f93e None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:39.875279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641784c9-09de-4461-866c-a131f373f93e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:39.876240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641784c9-09de-4461-866c-a131f373f93e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:39.877672 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641784c9-09de-4461-866c-a131f373f93e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:39.879628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641784c9-09de-4461-866c-a131f373f93e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:39.948840 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3350a-0fce-4328-89b9-766c75337731 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:39.989953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 468/925] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Jun 17 07:16:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:16:40.002832 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dd136-7cdd-420b-a875-8e515efb9d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:40.003560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dd136-7cdd-420b-a875-8e515efb9d04 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:40.003836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dd136-7cdd-420b-a875-8e515efb9d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:40.004103 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dd136-7cdd-420b-a875-8e515efb9d04 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:40.005062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504dd136-7cdd-420b-a875-8e515efb9d04 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:40.005420 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504dd136-7cdd-420b-a875-8e515efb9d04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:40.007063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504dd136-7cdd-420b-a875-8e515efb9d04 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:40.030138 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 458/926] 10.222.0.52 () {56 vars in 1149 bytes} [Fri Jun 17 07:16:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:40.036063 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641784c9-09de-4461-866c-a131f373f93e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:40.119708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:40.131430 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a005bc-ee78-40e5-bf70-f2da0a279138 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:40.131770 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a005bc-ee78-40e5-bf70-f2da0a279138 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:40.131976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a005bc-ee78-40e5-bf70-f2da0a279138 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:40.133518 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 459/927] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:40.139928 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd0467-0223-4abc-8f58-5eac4e5e4bd9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:40.140212 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd0467-0223-4abc-8f58-5eac4e5e4bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:40.145859 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd0467-0223-4abc-8f58-5eac4e5e4bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:40.159641 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-67dd0467-0223-4abc-8f58-5eac4e5e4bd9 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:40.160956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-67dd0467-0223-4abc-8f58-5eac4e5e4bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:40.182160 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641784c9-09de-4461-866c-a131f373f93e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:40.226968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d4979-a593-46b2-a0be-22ca10798499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:40.228536 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d4979-a593-46b2-a0be-22ca10798499 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:40.229034 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d4979-a593-46b2-a0be-22ca10798499 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:40.229626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d4979-a593-46b2-a0be-22ca10798499 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:40.231809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:40.243355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d4979-a593-46b2-a0be-22ca10798499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:40.245125 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d4979-a593-46b2-a0be-22ca10798499 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:40.259001 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 460/928] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:40.265093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-7e1d4979-a593-46b2-a0be-22ca10798499 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:40.265093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:40.265093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:40.265093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:40.265093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:40.265093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:40.265093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:40.265093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:40.265093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:40.265093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:40.265093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:40.265093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:40.265093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:40.265093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:40.265093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:40.266106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:40.266106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:40.266106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:40.266106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:40.266106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:40.266106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:40.266106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:40.266106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:40.266106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:40.266106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:40.266106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:40.266106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:40.266106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:40.266106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:40.266106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:40.266106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:40.266106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:40.267132 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:40.267132 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:40.267132 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:40.267132 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:40.268969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 469/929] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:40.279020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd0467-0223-4abc-8f58-5eac4e5e4bd9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:40.286186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d4979-a593-46b2-a0be-22ca10798499 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:40.415731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d4979-a593-46b2-a0be-22ca10798499 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:40.419775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd0467-0223-4abc-8f58-5eac4e5e4bd9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:40.430892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:40.454919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0d241-ca4e-4b7a-a93c-75492bcec155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:40.456050 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0d241-ca4e-4b7a-a93c-75492bcec155 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:40.456484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0d241-ca4e-4b7a-a93c-75492bcec155 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:40.456907 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0d241-ca4e-4b7a-a93c-75492bcec155 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:40.457771 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0d241-ca4e-4b7a-a93c-75492bcec155 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:40.459353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0d241-ca4e-4b7a-a93c-75492bcec155 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:40.462650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e5860-6a1e-4ef8-a881-7696bc7e1a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:40.463165 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e5860-6a1e-4ef8-a881-7696bc7e1a8a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:40.463444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e5860-6a1e-4ef8-a881-7696bc7e1a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:40.463720 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e5860-6a1e-4ef8-a881-7696bc7e1a8a None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:40.464477 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e5860-6a1e-4ef8-a881-7696bc7e1a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:40.464780 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e5860-6a1e-4ef8-a881-7696bc7e1a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:40.466228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e5860-6a1e-4ef8-a881-7696bc7e1a8a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:40.474068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-b8c0d241-ca4e-4b7a-a93c-75492bcec155 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:16:40.474068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:40.474068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:40.474068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:40.474068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:40.474068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:40.474068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:40.474068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:40.474068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:16:40.474068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:40.474068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:40.474068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:40.474068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:40.474068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:40.474068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:40.474068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:40.475208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:40.475208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:40.475208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:40.475208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:40.475208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:40.475208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:40.475208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:40.475208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:40.475208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:40.475208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:40.475208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:40.475208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:40.475208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:40.475208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:40.475208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:40.475208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:40.476165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:40.476165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:40.476165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:40.476165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:40.476165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:40.476165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:40.476165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:40.476165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:40.476165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:40.476165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:40.476165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:40.476165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:40.476165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:40.476165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:16:40.476165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:40.478636 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 470/930] 10.222.0.52 () {56 vars in 1132 bytes} [Fri Jun 17 07:16:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:40.479800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 461/931] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:40.486093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0d241-ca4e-4b7a-a93c-75492bcec155 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:40.486241 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e5860-6a1e-4ef8-a881-7696bc7e1a8a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:40.535712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:40.594054 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0d241-ca4e-4b7a-a93c-75492bcec155 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:40.599177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e5860-6a1e-4ef8-a881-7696bc7e1a8a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:40.629939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8f9e4-16e9-4b57-aea8-e669a17335c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:40.631421 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8f9e4-16e9-4b57-aea8-e669a17335c4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:40.631910 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8f9e4-16e9-4b57-aea8-e669a17335c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:40.632363 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8f9e4-16e9-4b57-aea8-e669a17335c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:40.639026 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5acb60-836f-478b-ae28-5a67148f356b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:40.639994 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5acb60-836f-478b-ae28-5a67148f356b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:40.640276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5acb60-836f-478b-ae28-5a67148f356b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:40.640544 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5acb60-836f-478b-ae28-5a67148f356b None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:40.641176 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8f9e4-16e9-4b57-aea8-e669a17335c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:40.641285 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5acb60-836f-478b-ae28-5a67148f356b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:40.641562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5acb60-836f-478b-ae28-5a67148f356b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:40.642933 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5acb60-836f-478b-ae28-5a67148f356b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:40.643382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8f9e4-16e9-4b57-aea8-e669a17335c4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:40.648467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 462/932] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Jun 17 07:16:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:40.658323 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5acb60-836f-478b-ae28-5a67148f356b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:40.659168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-f2b8f9e4-16e9-4b57-aea8-e669a17335c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:40.659168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:40.659168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:40.659168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:40.659168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:40.659168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:40.659168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:40.659168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:40.659168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:40.659168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:40.659168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:40.659168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:40.659168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:40.659168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:40.659168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:40.660242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:40.660242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:40.660242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:40.660242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:40.660242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:40.660242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:40.660242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:40.660242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:40.660242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:40.660242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:40.660242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:40.660242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:40.660242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:40.660242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:40.660242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:40.660242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:40.660242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:40.661377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:40.661377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:40.661377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:40.661377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:40.661377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:40.661377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:40.661377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:40.661377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:40.667315 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 471/933] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:40.668214 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8f9e4-16e9-4b57-aea8-e669a17335c4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:40.707600 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:40.777254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8f9e4-16e9-4b57-aea8-e669a17335c4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:40.790356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5acb60-836f-478b-ae28-5a67148f356b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:40.797741 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:40.814775 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81016e-3eb6-4d32-8c82-667c99eb9620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:40.815855 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81016e-3eb6-4d32-8c82-667c99eb9620 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:40.816352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81016e-3eb6-4d32-8c82-667c99eb9620 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:40.816820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81016e-3eb6-4d32-8c82-667c99eb9620 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:40.817828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81016e-3eb6-4d32-8c82-667c99eb9620 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:40.818362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81016e-3eb6-4d32-8c82-667c99eb9620 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:40.819994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81016e-3eb6-4d32-8c82-667c99eb9620 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:40.827251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093445ed-21b0-4be0-b913-6e7cccb7b67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:40.827923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093445ed-21b0-4be0-b913-6e7cccb7b67c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:40.828204 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093445ed-21b0-4be0-b913-6e7cccb7b67c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:40.828912 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093445ed-21b0-4be0-b913-6e7cccb7b67c None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:40.829178 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093445ed-21b0-4be0-b913-6e7cccb7b67c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:40.829512 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093445ed-21b0-4be0-b913-6e7cccb7b67c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:40.830941 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093445ed-21b0-4be0-b913-6e7cccb7b67c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:40.835254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 472/934] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:40.841081 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 463/935] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Jun 17 07:16:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:40.842478 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093445ed-21b0-4be0-b913-6e7cccb7b67c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:40.842612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81016e-3eb6-4d32-8c82-667c99eb9620 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:40.943450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:40.948965 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093445ed-21b0-4be0-b913-6e7cccb7b67c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:40.950492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81016e-3eb6-4d32-8c82-667c99eb9620 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:40.986380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8180d53-e8b1-4000-84e1-e8cdbdf06c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:40.987046 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8180d53-e8b1-4000-84e1-e8cdbdf06c27 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:40.987326 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8180d53-e8b1-4000-84e1-e8cdbdf06c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:40.987595 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8180d53-e8b1-4000-84e1-e8cdbdf06c27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:40.988333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8180d53-e8b1-4000-84e1-e8cdbdf06c27 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:40.988930 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b0f14-dd13-41a0-8c2c-5a50f197adfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:40.989735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8180d53-e8b1-4000-84e1-e8cdbdf06c27 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:40.990317 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b0f14-dd13-41a0-8c2c-5a50f197adfb None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:40.990881 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b0f14-dd13-41a0-8c2c-5a50f197adfb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:40.991347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b0f14-dd13-41a0-8c2c-5a50f197adfb None admin] PATH_INFO: `/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/9144d74a341b4e08ae353b384fe1186e/roles/ad9cdfc3afef42c9a483ec04f9815c3b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:40.993983 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b0f14-dd13-41a0-8c2c-5a50f197adfb None admin] RBAC: Authorizing `identity:create_grant(project_id=0dffdba97abf4f59b12c4fbdc6245e9e, user_id=9144d74a341b4e08ae353b384fe1186e, role_id=ad9cdfc3afef42c9a483ec04f9815c3b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:40.995613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b0f14-dd13-41a0-8c2c-5a50f197adfb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:41.076227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 464/936] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Jun 17 07:16:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:16:41.089390 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 473/937] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:16:40 2022] PUT /identity/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/9144d74a341b4e08ae353b384fe1186e/roles/ad9cdfc3afef42c9a483ec04f9815c3b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:16:41.548348 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fde91-8995-41d8-8a70-2265a3498be9 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:41.549064 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fde91-8995-41d8-8a70-2265a3498be9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:41.549594 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fde91-8995-41d8-8a70-2265a3498be9 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:41.551418 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 465/938] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:41.556441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e12339-9079-43eb-8dfd-6f32bff7ec25 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:41.556737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e12339-9079-43eb-8dfd-6f32bff7ec25 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:41.557017 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e12339-9079-43eb-8dfd-6f32bff7ec25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:41.574590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-37e12339-9079-43eb-8dfd-6f32bff7ec25 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:41.575982 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-37e12339-9079-43eb-8dfd-6f32bff7ec25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:41.657438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 474/939] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:41.676274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fde91-8995-41d8-8a70-2265a3498be9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:41.708706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:41.785781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fde91-8995-41d8-8a70-2265a3498be9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:41.824115 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd51085-0c9f-420a-ab78-6636b26060e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:41.825238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd51085-0c9f-420a-ab78-6636b26060e3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:41.825774 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd51085-0c9f-420a-ab78-6636b26060e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:41.826289 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd51085-0c9f-420a-ab78-6636b26060e3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:41.827573 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd51085-0c9f-420a-ab78-6636b26060e3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:41.830605 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd51085-0c9f-420a-ab78-6636b26060e3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:41.849529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6bd51085-0c9f-420a-ab78-6636b26060e3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:16:41.849529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:41.849529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:41.849529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:41.849529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:41.849529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:41.849529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:41.849529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:41.849529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:16:41.849529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:41.849529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:41.849529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:41.849529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:41.849529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:41.849529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:41.849529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:41.849529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:41.850589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:41.850589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:41.850589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:41.850589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:41.850589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:41.850589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:41.850589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:41.850589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:41.850589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:41.850589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:41.850589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:41.850589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:41.850589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:41.850589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:41.850589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:41.850589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:41.851443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:41.851443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:41.851443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:41.851443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:41.851443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:41.851443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:41.851443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:41.851443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:41.851443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:41.851443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:41.851443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:41.851443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:41.851443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:16:41.851443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:41.851443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 466/940] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Jun 17 07:16:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:41.857750 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e12339-9079-43eb-8dfd-6f32bff7ec25 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:41.946946 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:41.965757 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e12339-9079-43eb-8dfd-6f32bff7ec25 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:42.002802 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdebc7-25b0-46dd-9655-57f61bafe50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:42.003846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdebc7-25b0-46dd-9655-57f61bafe50c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:42.004354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdebc7-25b0-46dd-9655-57f61bafe50c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:42.004869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdebc7-25b0-46dd-9655-57f61bafe50c None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:42.005852 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdebc7-25b0-46dd-9655-57f61bafe50c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:42.006364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdebc7-25b0-46dd-9655-57f61bafe50c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:42.007967 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdebc7-25b0-46dd-9655-57f61bafe50c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:42.013905 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 475/941] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Jun 17 07:16:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:42.022246 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd51085-0c9f-420a-ab78-6636b26060e3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:42.123395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:42.133033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd51085-0c9f-420a-ab78-6636b26060e3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:42.174836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caefc86-b3f2-42c5-8a12-9d45e53833d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:42.175911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caefc86-b3f2-42c5-8a12-9d45e53833d9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:42.176467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caefc86-b3f2-42c5-8a12-9d45e53833d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:42.176941 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caefc86-b3f2-42c5-8a12-9d45e53833d9 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:42.177902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caefc86-b3f2-42c5-8a12-9d45e53833d9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:42.178410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caefc86-b3f2-42c5-8a12-9d45e53833d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:42.179998 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caefc86-b3f2-42c5-8a12-9d45e53833d9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:42.186598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 467/942] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Jun 17 07:16:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:42.194475 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdebc7-25b0-46dd-9655-57f61bafe50c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:42.303731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdebc7-25b0-46dd-9655-57f61bafe50c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:42.353285 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b99f5-8a78-4ab2-a92b-7550a5a382a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:42.354367 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b99f5-8a78-4ab2-a92b-7550a5a382a2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:42.354902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b99f5-8a78-4ab2-a92b-7550a5a382a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:42.355378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b99f5-8a78-4ab2-a92b-7550a5a382a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:42.357102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b99f5-8a78-4ab2-a92b-7550a5a382a2 None admin] RBAC: Adding query filter params (interface=public, service_id=a1ebf29837a741aa8285bb1edc72f7d5, region_id=RegionOne) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:42.357661 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b99f5-8a78-4ab2-a92b-7550a5a382a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:42.359276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b99f5-8a78-4ab2-a92b-7550a5a382a2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:42.365940 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 476/943] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Jun 17 07:16:42 2022] GET /identity/v3/endpoints?service_id=a1ebf29837a741aa8285bb1edc72f7d5&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:42.373738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caefc86-b3f2-42c5-8a12-9d45e53833d9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:42.398852 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9db8ca-f190-49e5-991c-dbc1b6b99968 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:42.399159 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9db8ca-f190-49e5-991c-dbc1b6b99968 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:42.399407 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9db8ca-f190-49e5-991c-dbc1b6b99968 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:42.401016 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 477/944] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:16:42.407496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a29699-e73b-4fc5-bafe-58dc404c1d27 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:42.408034 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a29699-e73b-4fc5-bafe-58dc404c1d27 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:42.408414 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a29699-e73b-4fc5-bafe-58dc404c1d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:42.427768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f9a29699-e73b-4fc5-bafe-58dc404c1d27 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:42.429170 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f9a29699-e73b-4fc5-bafe-58dc404c1d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:42.433848 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:42.490247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caefc86-b3f2-42c5-8a12-9d45e53833d9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:42.523275 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 478/945] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:42.537959 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfd30a-81b7-42e3-8138-8710675b301e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:42.538716 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd30a-81b7-42e3-8138-8710675b301e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:42.538995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd30a-81b7-42e3-8138-8710675b301e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:42.539267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd30a-81b7-42e3-8138-8710675b301e None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:42.539946 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfd30a-81b7-42e3-8138-8710675b301e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:42.541304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfd30a-81b7-42e3-8138-8710675b301e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:42.548365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 468/946] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Jun 17 07:16:42 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:16:42.548683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a29699-e73b-4fc5-bafe-58dc404c1d27 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:42.665354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a29699-e73b-4fc5-bafe-58dc404c1d27 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:42.707476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89976344-f779-4efa-a4fd-be34e54f7f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:42.708166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89976344-f779-4efa-a4fd-be34e54f7f4d None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:42.708448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89976344-f779-4efa-a4fd-be34e54f7f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:42.708721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89976344-f779-4efa-a4fd-be34e54f7f4d None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:42.709477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89976344-f779-4efa-a4fd-be34e54f7f4d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:42.710953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89976344-f779-4efa-a4fd-be34e54f7f4d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:42.712341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: WARNING keystone.server.flask.common [None req-89976344-f779-4efa-a4fd-be34e54f7f4d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 17 07:16:42.728319 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:42.761457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.sql.core [None req-89976344-f779-4efa-a4fd-be34e54f7f4d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 07:16:42.761457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 17 07:16:42.761457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [parameters: {'id': '425b5064cfbf443c8cafeec47da02990', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 17 07:16:42.761457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80239) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 07:16:42.770216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-89976344-f779-4efa-a4fd-be34e54f7f4d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 425b5064cfbf443c8cafeec47da02990.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 425b5064cfbf443c8cafeec47da02990. Jun 17 07:16:42.770216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:42.770216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 07:16:42.770216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 07:16:42.770216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 07:16:42.770216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 07:16:42.770216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 07:16:42.770216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 07:16:42.770216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 07:16:42.770216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application conn.query(q) Jun 17 07:16:42.770216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 07:16:42.770216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 07:16:42.770216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application result.read() Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 17 07:16:42.772225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 17 07:16:42.773177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 07:16:42.773177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application next(self.gen) Jun 17 07:16:42.773177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 07:16:42.773177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application yield resource Jun 17 07:16:42.773177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 07:16:42.773177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application next(self.gen) Jun 17 07:16:42.773177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 07:16:42.773177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 07:16:42.773177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 07:16:42.773177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 07:16:42.773177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 07:16:42.773177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise self.value Jun 17 07:16:42.773177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 07:16:42.773177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 07:16:42.773177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 07:16:42.773177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application session.commit() Jun 17 07:16:42.773177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 07:16:42.774131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 07:16:42.774131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 07:16:42.774131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 07:16:42.774131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 07:16:42.774131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self.session.flush() Jun 17 07:16:42.774131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 07:16:42.774131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 07:16:42.774131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 07:16:42.774131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 07:16:42.774131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 07:16:42.774131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application compat.raise_( Jun 17 07:16:42.774131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 07:16:42.774131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception Jun 17 07:16:42.774131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 07:16:42.774131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 07:16:42.774131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 07:16:42.774131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 07:16:42.775047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 07:16:42.775047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 07:16:42.775047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 07:16:42.775047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 07:16:42.775047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 17 07:16:42.775047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 17 07:16:42.775047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 07:16:42.775047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 07:16:42.775047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 07:16:42.775047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 07:16:42.775047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 07:16:42.775047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 07:16:42.775047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 07:16:42.775047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 07:16:42.775047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 07:16:42.777029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 07:16:42.777029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 07:16:42.777029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception Jun 17 07:16:42.777029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 07:16:42.777029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 07:16:42.777029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 07:16:42.777029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 07:16:42.777029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 07:16:42.777029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 07:16:42.777029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 07:16:42.777029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application conn.query(q) Jun 17 07:16:42.777029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 07:16:42.777029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 07:16:42.777029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 07:16:42.777029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application result.read() Jun 17 07:16:42.777029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 07:16:42.777029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 07:16:42.779268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 07:16:42.779268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 07:16:42.779268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 07:16:42.779268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 07:16:42.779268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 07:16:42.779268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 07:16:42.779268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 07:16:42.779268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 17 07:16:42.779268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [parameters: {'id': '425b5064cfbf443c8cafeec47da02990', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 17 07:16:42.779268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 07:16:42.779268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:42.779268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:42.779268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:42.779268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:42.779268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 17 07:16:42.781152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 17 07:16:42.781152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 07:16:42.781152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 07:16:42.781152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 17 07:16:42.781152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:42.781152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:42.781152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:42.781152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:42.781152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:42.781152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:42.781152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:42.781152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:42.781152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:42.781152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:42.781152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:42.781152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:42.781152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:42.783305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:42.783305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 17 07:16:42.783305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 17 07:16:42.783305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:42.783305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:42.783305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 17 07:16:42.783305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 17 07:16:42.783305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 425b5064cfbf443c8cafeec47da02990. Jun 17 07:16:42.783305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:42.783305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 479/947] 10.222.0.52 () {60 vars in 1140 bytes} [Fri Jun 17 07:16:42 2022] POST /identity/v3/projects => generated 262 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:42.784569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfd30a-81b7-42e3-8138-8710675b301e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:42.798439 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:42.881785 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfd30a-81b7-42e3-8138-8710675b301e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:42.917614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed9a28-b86c-4fd7-9f1e-025397fc0c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:42.918868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9a28-b86c-4fd7-9f1e-025397fc0c0c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:42.919141 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9a28-b86c-4fd7-9f1e-025397fc0c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:42.919416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9a28-b86c-4fd7-9f1e-025397fc0c0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:42.926366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed9a28-b86c-4fd7-9f1e-025397fc0c0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:42.927801 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed9a28-b86c-4fd7-9f1e-025397fc0c0c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:42.942286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6fed9a28-b86c-4fd7-9f1e-025397fc0c0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:42.942286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:42.942286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:42.942286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:42.942286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:42.942286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:42.942286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:42.942286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:42.942286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:42.942286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:42.942286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:42.942286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:42.942286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:42.942286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:42.942286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:42.944354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:42.944354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:42.944354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:42.944354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:42.944354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:42.944354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:42.944354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:42.944354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:42.944354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:42.944354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:42.944354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:42.944354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:42.944354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:42.944354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:42.944354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:42.944354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:42.944354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:42.945580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:42.945580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:42.945580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:42.945580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:42.945580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:42.945580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:42.945580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:42.945580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:42.945580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 469/948] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:42.949689 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89976344-f779-4efa-a4fd-be34e54f7f4d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:43.060844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89976344-f779-4efa-a4fd-be34e54f7f4d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:43.097731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78acb9d-1615-412a-a79e-c50d0f203237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:43.098435 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78acb9d-1615-412a-a79e-c50d0f203237 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:43.098729 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78acb9d-1615-412a-a79e-c50d0f203237 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:43.099004 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78acb9d-1615-412a-a79e-c50d0f203237 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:43.099760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78acb9d-1615-412a-a79e-c50d0f203237 None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:43.100064 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78acb9d-1615-412a-a79e-c50d0f203237 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:43.101737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78acb9d-1615-412a-a79e-c50d0f203237 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:43.123644 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 480/949] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Jun 17 07:16:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:43.439584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39647d59-a481-4a0d-bf6c-fdf0a7463fc2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:43.439584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39647d59-a481-4a0d-bf6c-fdf0a7463fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:43.439584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39647d59-a481-4a0d-bf6c-fdf0a7463fc2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:43.439584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 470/950] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:43.447561 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d612-7cf6-4e84-9829-7c95eef39c8d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:43.447561 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d612-7cf6-4e84-9829-7c95eef39c8d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:43.447561 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d612-7cf6-4e84-9829-7c95eef39c8d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:43.448072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35714459-953d-40ea-9ea2-c91b4ff94cdc None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:43.448072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35714459-953d-40ea-9ea2-c91b4ff94cdc None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:43.448072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35714459-953d-40ea-9ea2-c91b4ff94cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:43.448490 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 471/951] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:43.454209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e723df-72c6-472a-99e4-801da3ec9d5a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:43.454486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e723df-72c6-472a-99e4-801da3ec9d5a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:43.454963 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e723df-72c6-472a-99e4-801da3ec9d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:43.467692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-35714459-953d-40ea-9ea2-c91b4ff94cdc None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:43.469305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-35714459-953d-40ea-9ea2-c91b4ff94cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:43.473211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-15e723df-72c6-472a-99e4-801da3ec9d5a None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:43.474563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-15e723df-72c6-472a-99e4-801da3ec9d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:43.525797 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:43.544571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 472/953] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:43.545395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 481/953] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:43.567481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e723df-72c6-472a-99e4-801da3ec9d5a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:43.568891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35714459-953d-40ea-9ea2-c91b4ff94cdc None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:43.582885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:43.707944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35714459-953d-40ea-9ea2-c91b4ff94cdc None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:43.720841 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e723df-72c6-472a-99e4-801da3ec9d5a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:43.754138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3b268-9dd7-4447-8ad6-439a01708011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:43.755391 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3b268-9dd7-4447-8ad6-439a01708011 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:43.755882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3b268-9dd7-4447-8ad6-439a01708011 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:43.756377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3b268-9dd7-4447-8ad6-439a01708011 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:43.761046 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1831c1-af35-4015-a6c5-5372cc6272ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:43.763188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1831c1-af35-4015-a6c5-5372cc6272ec None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:43.763912 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1831c1-af35-4015-a6c5-5372cc6272ec None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:43.764538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1831c1-af35-4015-a6c5-5372cc6272ec None admin] PATH_INFO: `/v3/services/compute` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:43.765421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1831c1-af35-4015-a6c5-5372cc6272ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:43.767051 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1831c1-af35-4015-a6c5-5372cc6272ec None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:43.769816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3b268-9dd7-4447-8ad6-439a01708011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:43.778329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-5ee3b268-9dd7-4447-8ad6-439a01708011 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:16:43.778329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:43.778329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:43.778329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:43.778329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:43.778329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:43.778329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:43.778329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:43.778329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:43.778329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:43.778329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:43.778329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:43.778329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:43.778329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:43.778329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:43.778329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:43.779406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:43.779406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:43.779406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:43.779406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:43.779406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:43.779406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:43.779406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:43.779406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:43.779406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:43.779406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:43.779406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:43.779406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:43.779406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:43.779406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:43.779406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:43.779406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:43.780301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:43.780301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:43.780301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:43.780301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:43.780301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:43.780301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:43.780301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:43.780301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:43.780301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:43.780301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:43.780301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:16:43.780301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:43.783698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9b1831c1-af35-4015-a6c5-5372cc6272ec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:16:43.783698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:43.783698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:43.783698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:43.783698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:43.783698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:43.783698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:43.783698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:43.783698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:16:43.783698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:43.783698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:43.783698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:43.783698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:43.783698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:43.783698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:43.783698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:43.783698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:43.785234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:43.785234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:43.785234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:43.785234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:43.785234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:43.785234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:43.785234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:43.785234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:43.785234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:43.785234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:43.785234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:43.785234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:43.785234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:43.785234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:43.785234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:43.785234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:43.786151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:43.786151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:43.786151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:43.786151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:43.786151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:43.786151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:43.786151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:43.786151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:43.786151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:43.786151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:43.786151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:43.786151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:43.786151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:16:43.786151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:43.786911 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 482/954] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Jun 17 07:16:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:43.786911 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3b268-9dd7-4447-8ad6-439a01708011 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:43.795124 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 473/955] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:43.798578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1831c1-af35-4015-a6c5-5372cc6272ec None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:43.842524 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:43.878760 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:43.905579 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3b268-9dd7-4447-8ad6-439a01708011 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:43.912549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1831c1-af35-4015-a6c5-5372cc6272ec None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:43.944547 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cb5d9-6a9f-4e8a-b6c5-58d08e3b749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:43.945514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cb5d9-6a9f-4e8a-b6c5-58d08e3b749d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:43.945943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cb5d9-6a9f-4e8a-b6c5-58d08e3b749d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:43.946364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cb5d9-6a9f-4e8a-b6c5-58d08e3b749d None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:43.947351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cb5d9-6a9f-4e8a-b6c5-58d08e3b749d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:43.948003 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cb5d9-6a9f-4e8a-b6c5-58d08e3b749d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:43.949596 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cb5d9-6a9f-4e8a-b6c5-58d08e3b749d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:43.953138 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c0000-71fa-4256-9470-82f232978d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:43.953946 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c0000-71fa-4256-9470-82f232978d34 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:43.954327 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c0000-71fa-4256-9470-82f232978d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:43.954706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c0000-71fa-4256-9470-82f232978d34 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:43.955587 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c0000-71fa-4256-9470-82f232978d34 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:43.955988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c0000-71fa-4256-9470-82f232978d34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:43.957578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c0000-71fa-4256-9470-82f232978d34 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:43.965468 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 483/957] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Jun 17 07:16:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:43.966661 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cb5d9-6a9f-4e8a-b6c5-58d08e3b749d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:43.967334 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 474/957] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Jun 17 07:16:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:43.969286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c0000-71fa-4256-9470-82f232978d34 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:44.076062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c0000-71fa-4256-9470-82f232978d34 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:44.076613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cb5d9-6a9f-4e8a-b6c5-58d08e3b749d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:44.086321 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:44.113631 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b423d-e971-4bfb-9933-39f1bd59ecf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:44.113814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df074a-b7d9-48d7-9152-23c048fc6601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:44.114400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df074a-b7d9-48d7-9152-23c048fc6601 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:44.114681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df074a-b7d9-48d7-9152-23c048fc6601 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:44.114959 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df074a-b7d9-48d7-9152-23c048fc6601 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:44.115505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b423d-e971-4bfb-9933-39f1bd59ecf4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:44.115689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df074a-b7d9-48d7-9152-23c048fc6601 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:44.115960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df074a-b7d9-48d7-9152-23c048fc6601 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:44.116359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b423d-e971-4bfb-9933-39f1bd59ecf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:44.116838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b423d-e971-4bfb-9933-39f1bd59ecf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:44.117350 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df074a-b7d9-48d7-9152-23c048fc6601 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:44.119454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:44.128598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 475/958] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Jun 17 07:16:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:44.130637 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b423d-e971-4bfb-9933-39f1bd59ecf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:44.132382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b423d-e971-4bfb-9933-39f1bd59ecf4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:44.153753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-0a7b423d-e971-4bfb-9933-39f1bd59ecf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:44.153753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:44.153753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:44.153753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:44.153753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:44.153753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:44.153753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:44.153753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:44.153753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:44.153753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:44.153753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:44.153753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:44.153753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:44.153753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:44.153753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:44.154737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:44.154737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:44.154737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:44.154737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:44.154737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:44.154737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:44.154737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:44.154737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:44.154737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:44.154737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:44.154737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:44.154737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:44.154737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:44.154737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:44.154737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:44.154737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:44.154737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:44.155637 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:44.155637 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:44.155637 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:44.155637 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:44.158093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 484/959] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:44.164070 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df074a-b7d9-48d7-9152-23c048fc6601 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:44.284199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df074a-b7d9-48d7-9152-23c048fc6601 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:44.326577 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0a3bf-03dc-4128-a96b-dcdf1c24ee44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:44.327259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0a3bf-03dc-4128-a96b-dcdf1c24ee44 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:44.327541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0a3bf-03dc-4128-a96b-dcdf1c24ee44 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:44.327815 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0a3bf-03dc-4128-a96b-dcdf1c24ee44 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:44.328589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0a3bf-03dc-4128-a96b-dcdf1c24ee44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:44.328892 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0a3bf-03dc-4128-a96b-dcdf1c24ee44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:44.330289 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0a3bf-03dc-4128-a96b-dcdf1c24ee44 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:44.345308 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 476/960] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:44.350798 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b423d-e971-4bfb-9933-39f1bd59ecf4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:44.461074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b423d-e971-4bfb-9933-39f1bd59ecf4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:44.499043 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c3537-ad8d-4aa5-a2b8-54d754cb6659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:44.500236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c3537-ad8d-4aa5-a2b8-54d754cb6659 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:44.500729 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c3537-ad8d-4aa5-a2b8-54d754cb6659 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:44.501263 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c3537-ad8d-4aa5-a2b8-54d754cb6659 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:44.509717 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c3537-ad8d-4aa5-a2b8-54d754cb6659 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:44.511409 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c3537-ad8d-4aa5-a2b8-54d754cb6659 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:44.526951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-c70c3537-ad8d-4aa5-a2b8-54d754cb6659 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:16:44.526951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:44.526951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:44.526951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:44.526951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:44.526951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:44.526951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:44.526951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:44.526951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:44.526951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:44.526951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:44.526951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:44.526951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:44.526951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:44.526951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:44.526951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:44.528467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:44.529545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:44.529545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:44.529545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:44.529545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:44.529545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:44.529545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:44.529545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:44.529545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:44.529545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:16:44.529545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:44.532194 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 485/961] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Jun 17 07:16:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:44.537632 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0a3bf-03dc-4128-a96b-dcdf1c24ee44 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:44.605525 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:44.647529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0a3bf-03dc-4128-a96b-dcdf1c24ee44 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:44.685401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc122e9-a11c-4844-938a-1d8e608812f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:44.686083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc122e9-a11c-4844-938a-1d8e608812f5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:44.686366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc122e9-a11c-4844-938a-1d8e608812f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:44.686646 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc122e9-a11c-4844-938a-1d8e608812f5 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:44.687486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc122e9-a11c-4844-938a-1d8e608812f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:44.687791 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc122e9-a11c-4844-938a-1d8e608812f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:44.689213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc122e9-a11c-4844-938a-1d8e608812f5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:44.708396 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 477/962] 10.222.0.52 () {56 vars in 1149 bytes} [Fri Jun 17 07:16:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:44.714271 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c3537-ad8d-4aa5-a2b8-54d754cb6659 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:44.748913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:44.791914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b9cd3-13c1-4fda-83d4-34965e844a11 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:44.792409 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b9cd3-13c1-4fda-83d4-34965e844a11 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:44.792409 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b9cd3-13c1-4fda-83d4-34965e844a11 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:44.794653 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 478/963] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:16:44.800961 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3ed2c-aa91-49ee-a694-21fd0137bb18 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:44.801390 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3ed2c-aa91-49ee-a694-21fd0137bb18 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:44.801771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3ed2c-aa91-49ee-a694-21fd0137bb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:44.823062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-79e3ed2c-aa91-49ee-a694-21fd0137bb18 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:44.824743 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-79e3ed2c-aa91-49ee-a694-21fd0137bb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:44.838863 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c3537-ad8d-4aa5-a2b8-54d754cb6659 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:44.875835 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945dc7e-4eee-4e40-b889-cd98473a0ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:44.876791 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945dc7e-4eee-4e40-b889-cd98473a0ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:44.877292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945dc7e-4eee-4e40-b889-cd98473a0ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:44.877790 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945dc7e-4eee-4e40-b889-cd98473a0ed3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:44.913623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 479/964] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:44.938619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3ed2c-aa91-49ee-a694-21fd0137bb18 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:44.969151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945dc7e-4eee-4e40-b889-cd98473a0ed3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:44.971233 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945dc7e-4eee-4e40-b889-cd98473a0ed3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:44.995729 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:45.004353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:45.053132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3ed2c-aa91-49ee-a694-21fd0137bb18 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:45.093080 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6be213-bb36-4fe0-918f-46afc931dcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:45.094402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6be213-bb36-4fe0-918f-46afc931dcb8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:45.094914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6be213-bb36-4fe0-918f-46afc931dcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:45.095409 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6be213-bb36-4fe0-918f-46afc931dcb8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:45.096318 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6be213-bb36-4fe0-918f-46afc931dcb8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:45.097933 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6be213-bb36-4fe0-918f-46afc931dcb8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:45.110037 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 486/965] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:16:44 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:16:45.111637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-de6be213-bb36-4fe0-918f-46afc931dcb8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:16:45.111637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:45.111637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:45.111637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:45.111637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:45.111637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:45.111637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:45.111637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:45.111637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:16:45.111637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:45.111637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:45.111637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:45.111637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:45.111637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:45.111637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:45.111637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:45.111637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:45.112618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:45.112618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:45.112618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:45.112618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:45.112618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:45.112618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:45.112618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:45.112618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:45.112618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:45.112618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:45.112618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:45.112618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:45.112618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:45.112618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:45.112618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:45.112618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:45.113888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:45.113888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:45.113888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:45.113888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:45.113888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:45.113888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:45.113888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:45.113888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:45.113888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:45.113888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:45.113888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:45.113888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:45.113888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:16:45.113888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:45.115266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945dc7e-4eee-4e40-b889-cd98473a0ed3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:45.117064 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 480/966] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Jun 17 07:16:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:45.125496 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6be213-bb36-4fe0-918f-46afc931dcb8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:45.222749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945dc7e-4eee-4e40-b889-cd98473a0ed3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:45.235023 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6be213-bb36-4fe0-918f-46afc931dcb8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:45.244344 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:45.251237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:45.259534 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b230e70-f7c3-473f-b624-8fb4abee763a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:45.260227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b230e70-f7c3-473f-b624-8fb4abee763a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:45.260610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b230e70-f7c3-473f-b624-8fb4abee763a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:45.260986 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b230e70-f7c3-473f-b624-8fb4abee763a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:45.272478 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b230e70-f7c3-473f-b624-8fb4abee763a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:45.274152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b230e70-f7c3-473f-b624-8fb4abee763a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:45.275422 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2747c-46d6-46bf-8763-92982818d9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:45.276301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2747c-46d6-46bf-8763-92982818d9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:45.276809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2747c-46d6-46bf-8763-92982818d9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:45.277777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2747c-46d6-46bf-8763-92982818d9f9 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:45.279821 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2747c-46d6-46bf-8763-92982818d9f9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:45.280328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2747c-46d6-46bf-8763-92982818d9f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:45.281945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2747c-46d6-46bf-8763-92982818d9f9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:45.295799 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 481/967] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Jun 17 07:16:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:45.297081 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2747c-46d6-46bf-8763-92982818d9f9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:45.297261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-1b230e70-f7c3-473f-b624-8fb4abee763a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:45.297261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:45.297261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:45.297261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:45.297261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:45.297261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:45.297261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:45.297261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:45.297261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:45.297261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:45.297261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:45.297261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:45.297261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:45.297261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:45.297261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:45.298347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:45.298347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:45.298347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:45.298347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:45.298347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:45.298347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:45.298347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:45.298347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:45.298347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:45.298347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:45.298347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:45.298347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:45.298347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:45.298347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:45.298347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:45.298347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:45.298347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:45.299479 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:45.299479 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:45.299479 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:45.299479 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:45.305994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 487/968] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:45.307096 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b230e70-f7c3-473f-b624-8fb4abee763a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:45.417748 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2747c-46d6-46bf-8763-92982818d9f9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:45.424121 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b230e70-f7c3-473f-b624-8fb4abee763a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:45.454034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8c397-df08-4aaa-a8c4-57ddbb8cb043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:45.455024 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8c397-df08-4aaa-a8c4-57ddbb8cb043 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:45.455461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8c397-df08-4aaa-a8c4-57ddbb8cb043 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:45.455914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8c397-df08-4aaa-a8c4-57ddbb8cb043 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:45.456637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8c397-df08-4aaa-a8c4-57ddbb8cb043 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:45.456946 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8c397-df08-4aaa-a8c4-57ddbb8cb043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:45.458460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8c397-df08-4aaa-a8c4-57ddbb8cb043 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:45.462930 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9570885-81f4-4445-95ee-be3f3c308642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:45.463590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570885-81f4-4445-95ee-be3f3c308642 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:45.463827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 482/969] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Jun 17 07:16:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:45.470079 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570885-81f4-4445-95ee-be3f3c308642 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:45.470079 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570885-81f4-4445-95ee-be3f3c308642 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:45.470079 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9570885-81f4-4445-95ee-be3f3c308642 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:45.470079 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9570885-81f4-4445-95ee-be3f3c308642 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:45.470423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358d6b5-e190-4a0d-9bb3-128e104de611 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:45.470423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358d6b5-e190-4a0d-9bb3-128e104de611 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:45.470423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358d6b5-e190-4a0d-9bb3-128e104de611 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:45.470606 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9570885-81f4-4445-95ee-be3f3c308642 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:45.470684 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 483/970] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:45.471168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358d6b5-e190-4a0d-9bb3-128e104de611 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:45.482991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 488/971] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:45.484277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb2387-2bdd-43e4-9493-f20b126d67c5 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:45.484559 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb2387-2bdd-43e4-9493-f20b126d67c5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:45.484834 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb2387-2bdd-43e4-9493-f20b126d67c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:45.501928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b2bb2387-2bdd-43e4-9493-f20b126d67c5 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:45.503143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b2bb2387-2bdd-43e4-9493-f20b126d67c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:45.525461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:45.530681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:45.573259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 489/972] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:45.574697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb2387-2bdd-43e4-9493-f20b126d67c5 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:45.599932 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358d6b5-e190-4a0d-9bb3-128e104de611 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:45.639189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7986a16-7bdb-411f-94b1-af5703415320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:45.640190 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7986a16-7bdb-411f-94b1-af5703415320 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:45.640654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7986a16-7bdb-411f-94b1-af5703415320 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:45.641125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7986a16-7bdb-411f-94b1-af5703415320 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:45.642182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7986a16-7bdb-411f-94b1-af5703415320 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:45.643733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7986a16-7bdb-411f-94b1-af5703415320 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:45.699951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb2387-2bdd-43e4-9493-f20b126d67c5 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:45.733355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 484/973] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Jun 17 07:16:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:16:45.733355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7986a16-7bdb-411f-94b1-af5703415320 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:45.745240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b5c26-4bb7-4c8a-9d49-2419e2972049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:45.747107 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b5c26-4bb7-4c8a-9d49-2419e2972049 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:45.747538 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b5c26-4bb7-4c8a-9d49-2419e2972049 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:45.747918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b5c26-4bb7-4c8a-9d49-2419e2972049 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:45.756872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b5c26-4bb7-4c8a-9d49-2419e2972049 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:45.758635 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b5c26-4bb7-4c8a-9d49-2419e2972049 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:45.776006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-a84b5c26-4bb7-4c8a-9d49-2419e2972049 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:45.776006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:45.776006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:45.776006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:45.776006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:45.776006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:45.776006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:45.776006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:45.776006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:45.776006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:45.776006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:45.776006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:45.776006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:45.776006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:45.776006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:45.776995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:45.776995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:45.776995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:45.776995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:45.776995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:45.776995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:45.776995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:45.776995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:45.776995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:45.776995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:45.776995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:45.776995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:45.776995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:45.776995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:45.776995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:45.776995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:45.776995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:45.777973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:45.777973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:45.777973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:45.777973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:45.777973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:45.777973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:45.777973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:45.777973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:45.777973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 490/974] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:45.784352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b5c26-4bb7-4c8a-9d49-2419e2972049 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:45.813037 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:45.870794 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:45.878954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7986a16-7bdb-411f-94b1-af5703415320 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:45.919421 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b5c26-4bb7-4c8a-9d49-2419e2972049 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:45.920391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178b00c-c0ba-4153-9cc5-2875d21ec981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:45.921071 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178b00c-c0ba-4153-9cc5-2875d21ec981 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:45.921382 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178b00c-c0ba-4153-9cc5-2875d21ec981 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:45.921663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178b00c-c0ba-4153-9cc5-2875d21ec981 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:45.922378 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178b00c-c0ba-4153-9cc5-2875d21ec981 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:45.923818 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178b00c-c0ba-4153-9cc5-2875d21ec981 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:45.925135 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.common [None req-a178b00c-c0ba-4153-9cc5-2875d21ec981 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 17 07:16:45.958441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11142c-ec2d-4efb-a41a-664e4d6cf547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:45.959113 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11142c-ec2d-4efb-a41a-664e4d6cf547 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:45.959442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11142c-ec2d-4efb-a41a-664e4d6cf547 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:45.959722 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11142c-ec2d-4efb-a41a-664e4d6cf547 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:45.960517 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11142c-ec2d-4efb-a41a-664e4d6cf547 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:45.960823 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11142c-ec2d-4efb-a41a-664e4d6cf547 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:45.962395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11142c-ec2d-4efb-a41a-664e4d6cf547 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:45.971584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.sql.core [None req-a178b00c-c0ba-4153-9cc5-2875d21ec981 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 07:16:45.971584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 17 07:16:45.971584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [parameters: {'user_id': '9e0b4a32adf24e0aa20ccd04af477775', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 17 07:16:45.971584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80240) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 07:16:45.976300 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 491/975] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:45.983307 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11142c-ec2d-4efb-a41a-664e4d6cf547 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:45.989143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a178b00c-c0ba-4153-9cc5-2875d21ec981 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 17 07:16:45.989143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:45.989143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 07:16:45.989143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 07:16:45.989143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 07:16:45.989143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 07:16:45.989143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 07:16:45.989143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 07:16:45.989143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 07:16:45.989143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application conn.query(q) Jun 17 07:16:45.989143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 07:16:45.989143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 07:16:45.989143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 07:16:45.989143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result.read() Jun 17 07:16:45.989143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 07:16:45.990151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application next(self.gen) Jun 17 07:16:45.991554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 07:16:45.991554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application yield resource Jun 17 07:16:45.991554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 07:16:45.991554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application next(self.gen) Jun 17 07:16:45.991554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 07:16:45.991554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 07:16:45.991554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 07:16:45.991554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 07:16:45.991554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 07:16:45.991554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise self.value Jun 17 07:16:45.991554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 07:16:45.991554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 07:16:45.991554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 07:16:45.991554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application session.commit() Jun 17 07:16:45.991554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 07:16:45.991554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 07:16:45.991554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 07:16:45.992738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 07:16:45.992738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 07:16:45.992738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.session.flush() Jun 17 07:16:45.992738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 07:16:45.992738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 07:16:45.992738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 07:16:45.992738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 07:16:45.992738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 07:16:45.992738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application compat.raise_( Jun 17 07:16:45.992738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 07:16:45.992738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception Jun 17 07:16:45.992738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 07:16:45.992738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 07:16:45.992738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 07:16:45.992738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 07:16:45.992738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 07:16:45.992738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 07:16:45.994538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 07:16:45.994538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 07:16:45.994538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 17 07:16:45.994538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 17 07:16:45.994538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 07:16:45.994538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 07:16:45.994538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 07:16:45.994538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 07:16:45.994538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 07:16:45.994538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 07:16:45.994538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 07:16:45.994538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 07:16:45.994538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 07:16:45.994538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 07:16:45.994538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 07:16:45.994538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception Jun 17 07:16:45.997559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 07:16:45.997559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 07:16:45.997559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 07:16:45.997559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 07:16:45.997559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 07:16:45.997559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 07:16:45.997559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 07:16:45.997559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application conn.query(q) Jun 17 07:16:45.997559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 07:16:45.997559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 07:16:45.997559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 07:16:45.997559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result.read() Jun 17 07:16:45.997559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 07:16:45.997559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 07:16:45.997559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 07:16:45.997559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 07:16:45.999808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 07:16:45.999808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 07:16:45.999808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 07:16:45.999808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 07:16:45.999808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 07:16:45.999808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 17 07:16:45.999808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [parameters: {'user_id': '9e0b4a32adf24e0aa20ccd04af477775', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 17 07:16:45.999808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 07:16:45.999808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:45.999808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:45.999808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:45.999808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:45.999808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:45.999808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:45.999808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:46.001786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:46.001786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:46.001786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:46.001786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:46.001786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:46.001786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:46.001786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:46.001786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 17 07:16:46.001786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 17 07:16:46.001786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:46.001786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:46.001786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:46.001786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:46.001786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:46.001786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:46.001786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 17 07:16:46.001786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 17 07:16:46.004201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 17 07:16:46.004201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 17 07:16:46.004201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 07:16:46.004201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 07:16:46.004201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 17 07:16:46.004201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:46.004201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 485/976] 10.222.0.52 () {60 vars in 1131 bytes} [Fri Jun 17 07:16:45 2022] POST /identity/v3/users => generated 160 bytes in 267 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:46.004201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178b00c-c0ba-4153-9cc5-2875d21ec981 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:46.112202 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178b00c-c0ba-4153-9cc5-2875d21ec981 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:46.113557 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:46.144699 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11142c-ec2d-4efb-a41a-664e4d6cf547 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:46.151343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10330659-7585-4d97-b68a-03c37a83f4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:46.152153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10330659-7585-4d97-b68a-03c37a83f4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:46.152597 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10330659-7585-4d97-b68a-03c37a83f4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:46.152881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10330659-7585-4d97-b68a-03c37a83f4e2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:46.161123 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10330659-7585-4d97-b68a-03c37a83f4e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:46.162779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10330659-7585-4d97-b68a-03c37a83f4e2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:46.178290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-10330659-7585-4d97-b68a-03c37a83f4e2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 07:16:46.178290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:46.178290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:46.178290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:46.178290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:46.178290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:46.178290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:46.178290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:46.178290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:46.178290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:46.178290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:46.178290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:46.178290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:46.178290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:46.178290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:46.178290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:46.179494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:46.180454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:46.180454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:46.180454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:46.180454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:46.180454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:46.180454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:46.180454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:46.180454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:46.180454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 07:16:46.180454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:46.185302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 486/977] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:16:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:46.186197 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10330659-7585-4d97-b68a-03c37a83f4e2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:46.191614 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c6675-4ee2-4f5f-b0c5-fab2a11f9cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:46.192496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c6675-4ee2-4f5f-b0c5-fab2a11f9cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:46.193023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c6675-4ee2-4f5f-b0c5-fab2a11f9cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:46.193476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c6675-4ee2-4f5f-b0c5-fab2a11f9cf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:46.194466 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c6675-4ee2-4f5f-b0c5-fab2a11f9cf7 None admin] RBAC: Adding query filter params (role.id=ad9cdfc3afef42c9a483ec04f9815c3b, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=9144d74a341b4e08ae353b384fe1186e) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:46.194924 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c6675-4ee2-4f5f-b0c5-fab2a11f9cf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:46.197050 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c6675-4ee2-4f5f-b0c5-fab2a11f9cf7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:46.207266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:46.208380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 492/978] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:16:45 2022] GET /identity/v3/role_assignments?user.id=9144d74a341b4e08ae353b384fe1186e&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=ad9cdfc3afef42c9a483ec04f9815c3b => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:46.307114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10330659-7585-4d97-b68a-03c37a83f4e2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:46.346541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c275ce-1fd2-4dcd-b739-f2a5d68755b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:46.347531 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c275ce-1fd2-4dcd-b739-f2a5d68755b8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:46.347970 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c275ce-1fd2-4dcd-b739-f2a5d68755b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:46.348396 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c275ce-1fd2-4dcd-b739-f2a5d68755b8 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:46.349424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c275ce-1fd2-4dcd-b739-f2a5d68755b8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:46.349885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c275ce-1fd2-4dcd-b739-f2a5d68755b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:46.351488 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c275ce-1fd2-4dcd-b739-f2a5d68755b8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:46.399929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 487/979] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Jun 17 07:16:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:46.438281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b494d-2aba-47fb-9ec0-8e54724a2c5e None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:46.438564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b494d-2aba-47fb-9ec0-8e54724a2c5e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:46.438844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b494d-2aba-47fb-9ec0-8e54724a2c5e None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:46.440618 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 493/980] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:46.446486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45126583-8cec-41b9-847f-21576a75cccc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:46.446799 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45126583-8cec-41b9-847f-21576a75cccc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:46.447045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45126583-8cec-41b9-847f-21576a75cccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:46.466543 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-45126583-8cec-41b9-847f-21576a75cccc None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:46.468116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-45126583-8cec-41b9-847f-21576a75cccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:46.557793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 488/981] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:46.578441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b494d-2aba-47fb-9ec0-8e54724a2c5e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:46.703715 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b494d-2aba-47fb-9ec0-8e54724a2c5e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:46.740263 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81353783-4113-44ca-a7fe-13c6c35dd749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:46.740926 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81353783-4113-44ca-a7fe-13c6c35dd749 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:46.741205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81353783-4113-44ca-a7fe-13c6c35dd749 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:46.741505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81353783-4113-44ca-a7fe-13c6c35dd749 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:46.742215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81353783-4113-44ca-a7fe-13c6c35dd749 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:46.743635 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81353783-4113-44ca-a7fe-13c6c35dd749 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:46.825377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 494/982] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Jun 17 07:16:46 2022] POST /identity/v3/services => generated 242 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:16:48.017279 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964f7be-a599-4231-b58d-1200791636e2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:48.017896 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964f7be-a599-4231-b58d-1200791636e2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:48.017896 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964f7be-a599-4231-b58d-1200791636e2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:48.019335 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 489/983] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:48.024637 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188caca-db94-4b31-b33b-fa7f14f2df7f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:48.025105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188caca-db94-4b31-b33b-fa7f14f2df7f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:48.025194 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188caca-db94-4b31-b33b-fa7f14f2df7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:48.030537 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:48.042296 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3188caca-db94-4b31-b33b-fa7f14f2df7f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:48.044068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3188caca-db94-4b31-b33b-fa7f14f2df7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:48.130057 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 495/984] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:48.153174 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964f7be-a599-4231-b58d-1200791636e2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:48.162609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:48.265945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964f7be-a599-4231-b58d-1200791636e2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:48.302706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880d280-128a-4d88-8f4b-e5a8e6bcb4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:48.303492 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880d280-128a-4d88-8f4b-e5a8e6bcb4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:48.303769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880d280-128a-4d88-8f4b-e5a8e6bcb4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:48.304037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880d280-128a-4d88-8f4b-e5a8e6bcb4b1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:48.304703 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880d280-128a-4d88-8f4b-e5a8e6bcb4b1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:48.306128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880d280-128a-4d88-8f4b-e5a8e6bcb4b1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:48.320140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a880d280-128a-4d88-8f4b-e5a8e6bcb4b1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:16:48.320140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:48.320140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:48.320140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:48.320140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:48.320140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:48.320140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:48.320140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:48.320140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:16:48.320140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:48.320140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:48.320140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:48.320140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:48.320140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:48.320140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:48.320140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:48.320140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:48.322097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:48.322097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:48.322097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:48.322097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:48.322097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:48.322097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:48.322097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:48.322097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:48.322097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:48.322097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:48.322097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:48.322097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:48.322097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:48.322097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:48.322097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:48.322097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:48.324232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:48.324232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:48.324232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:48.324232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:48.324232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:48.324232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:48.324232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:48.324232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:48.324232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:48.324232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:48.324232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:48.324232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:48.324232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:16:48.324232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:48.326941 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 490/985] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Jun 17 07:16:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:48.328532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188caca-db94-4b31-b33b-fa7f14f2df7f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:48.445822 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188caca-db94-4b31-b33b-fa7f14f2df7f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:48.476636 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:48.486327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f7ce7-e41c-46df-9139-7d9ba3ef8402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:48.487051 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f7ce7-e41c-46df-9139-7d9ba3ef8402 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:48.487364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f7ce7-e41c-46df-9139-7d9ba3ef8402 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:48.487702 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f7ce7-e41c-46df-9139-7d9ba3ef8402 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:48.488538 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f7ce7-e41c-46df-9139-7d9ba3ef8402 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:48.488905 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f7ce7-e41c-46df-9139-7d9ba3ef8402 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:48.490469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f7ce7-e41c-46df-9139-7d9ba3ef8402 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:48.496662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 496/986] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Jun 17 07:16:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:48.503073 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880d280-128a-4d88-8f4b-e5a8e6bcb4b1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:48.583125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:48.620057 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880d280-128a-4d88-8f4b-e5a8e6bcb4b1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:48.649777 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfee8b0-938a-46d9-ab90-75b79ac55cee None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:48.650067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfee8b0-938a-46d9-ab90-75b79ac55cee None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:48.650352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfee8b0-938a-46d9-ab90-75b79ac55cee None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:48.651724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 497/987] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:16:48.657463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96b70a-3cd8-4d21-bad7-1fc9f25b9654 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:48.657753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96b70a-3cd8-4d21-bad7-1fc9f25b9654 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:48.657955 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69111d-c3d7-4174-8612-1d0a98607cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:48.658077 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96b70a-3cd8-4d21-bad7-1fc9f25b9654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:48.658573 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69111d-c3d7-4174-8612-1d0a98607cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:48.658852 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69111d-c3d7-4174-8612-1d0a98607cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:48.659126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69111d-c3d7-4174-8612-1d0a98607cb2 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:48.659824 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69111d-c3d7-4174-8612-1d0a98607cb2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:48.660126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69111d-c3d7-4174-8612-1d0a98607cb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:48.661539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69111d-c3d7-4174-8612-1d0a98607cb2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:48.669395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 491/988] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Jun 17 07:16:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:48.676778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69111d-c3d7-4174-8612-1d0a98607cb2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:48.685500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-ca96b70a-3cd8-4d21-bad7-1fc9f25b9654 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:48.686713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ca96b70a-3cd8-4d21-bad7-1fc9f25b9654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:48.773510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 498/989] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:48.794186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96b70a-3cd8-4d21-bad7-1fc9f25b9654 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:48.805011 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69111d-c3d7-4174-8612-1d0a98607cb2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:48.849303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930455d-ed71-4a1c-acd6-a87828176d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:48.850081 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930455d-ed71-4a1c-acd6-a87828176d7a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:48.850439 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930455d-ed71-4a1c-acd6-a87828176d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:48.850799 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930455d-ed71-4a1c-acd6-a87828176d7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:48.851781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930455d-ed71-4a1c-acd6-a87828176d7a None admin] RBAC: Adding query filter params (interface=admin, service_id=a1ebf29837a741aa8285bb1edc72f7d5, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:48.852173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930455d-ed71-4a1c-acd6-a87828176d7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:48.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930455d-ed71-4a1c-acd6-a87828176d7a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:48.856516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:48.866707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 492/990] 10.222.0.52 () {56 vars in 1249 bytes} [Fri Jun 17 07:16:48 2022] GET /identity/v3/endpoints?service_id=a1ebf29837a741aa8285bb1edc72f7d5&interface=admin®ion_id=RegionOne => generated 193 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:48.870536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930455d-ed71-4a1c-acd6-a87828176d7a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:48.910088 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96b70a-3cd8-4d21-bad7-1fc9f25b9654 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:48.936626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:48.947759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f924084-18a5-4e4a-af7a-3b4c64369ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:48.956133 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f924084-18a5-4e4a-af7a-3b4c64369ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:48.956133 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f924084-18a5-4e4a-af7a-3b4c64369ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:48.956133 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f924084-18a5-4e4a-af7a-3b4c64369ec1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:48.956133 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f924084-18a5-4e4a-af7a-3b4c64369ec1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:48.956133 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f924084-18a5-4e4a-af7a-3b4c64369ec1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:48.963008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-0f924084-18a5-4e4a-af7a-3b4c64369ec1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:16:48.963008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:48.963008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:48.963008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:48.963008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:48.963008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:48.963008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:48.963008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:48.963008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:16:48.963008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:48.963008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:48.963008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:48.963008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:48.963008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:48.963008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:48.963008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:48.963008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:48.964335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:48.964335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:48.964335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:48.964335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:48.964335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:48.964335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:48.964335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:48.964335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:48.964335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:48.964335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:48.964335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:48.964335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:48.964335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:48.964335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:48.964335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:48.964335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:48.966767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:48.966767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:48.966767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:48.966767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:48.966767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:48.966767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:48.966767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:48.966767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:48.966767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:48.966767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:48.966767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:48.966767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:48.966767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:16:48.966767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:48.966767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 499/991] 10.222.0.52 () {56 vars in 1105 bytes} [Fri Jun 17 07:16:48 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:48.971854 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f924084-18a5-4e4a-af7a-3b4c64369ec1 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:49.000226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930455d-ed71-4a1c-acd6-a87828176d7a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:49.041060 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e45e2-d5aa-4010-a01a-3732b196c21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:49.041758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e45e2-d5aa-4010-a01a-3732b196c21a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:49.042050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e45e2-d5aa-4010-a01a-3732b196c21a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:49.042369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e45e2-d5aa-4010-a01a-3732b196c21a None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:49.043942 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e45e2-d5aa-4010-a01a-3732b196c21a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:49.046307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e45e2-d5aa-4010-a01a-3732b196c21a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:49.061352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 493/992] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Jun 17 07:16:48 2022] GET /identity/v3/services => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:16:49.061352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f7620-55fa-4122-9cc8-8f75b5473e4a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:49.061352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f7620-55fa-4122-9cc8-8f75b5473e4a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:49.061352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f7620-55fa-4122-9cc8-8f75b5473e4a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:49.061352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 494/993] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:49.063150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696d75d-1fa8-4785-8176-3aa2e79d8119 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:49.063447 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696d75d-1fa8-4785-8176-3aa2e79d8119 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:49.063831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696d75d-1fa8-4785-8176-3aa2e79d8119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:49.085660 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e696d75d-1fa8-4785-8176-3aa2e79d8119 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:49.087072 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e696d75d-1fa8-4785-8176-3aa2e79d8119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:49.102829 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f924084-18a5-4e4a-af7a-3b4c64369ec1 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:49.144098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6684d3b-c78d-48ce-a1d7-bee9d9baa0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:49.145170 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6684d3b-c78d-48ce-a1d7-bee9d9baa0fb None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:49.145550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6684d3b-c78d-48ce-a1d7-bee9d9baa0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:49.145947 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6684d3b-c78d-48ce-a1d7-bee9d9baa0fb None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:49.146690 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6684d3b-c78d-48ce-a1d7-bee9d9baa0fb None admin] RBAC: Adding query filter params (name=image) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:49.147003 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6684d3b-c78d-48ce-a1d7-bee9d9baa0fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:49.148426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6684d3b-c78d-48ce-a1d7-bee9d9baa0fb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:49.159755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 500/994] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:49.159952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:49.161074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6684d3b-c78d-48ce-a1d7-bee9d9baa0fb None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:49.173110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 495/995] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:49.200644 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696d75d-1fa8-4785-8176-3aa2e79d8119 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:49.268997 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:49.318986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696d75d-1fa8-4785-8176-3aa2e79d8119 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:49.327807 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6684d3b-c78d-48ce-a1d7-bee9d9baa0fb None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:49.355008 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7018b7-577f-484a-94fa-464b22137c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:49.356232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7018b7-577f-484a-94fa-464b22137c2c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:49.356502 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7018b7-577f-484a-94fa-464b22137c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:49.356776 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7018b7-577f-484a-94fa-464b22137c2c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:49.357477 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7018b7-577f-484a-94fa-464b22137c2c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:49.358840 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7018b7-577f-484a-94fa-464b22137c2c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:49.370676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924848ed-c874-4924-b30f-99290cfe4666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:49.371616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9e7018b7-577f-484a-94fa-464b22137c2c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:16:49.371616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:49.371616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:49.371616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:49.371616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:49.371616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:49.371616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:49.371616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:49.371616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:16:49.371616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:49.371616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:49.371616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:49.371616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:49.371616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:49.371616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:49.371616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:49.371616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:49.372771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:49.372771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:49.372771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:49.372771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:49.372771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:49.372771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:49.372771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:49.372771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:49.372771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:49.372771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:49.372771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:49.372771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:49.372771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:49.372771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:49.372771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:49.372771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:49.374037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:49.374037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:49.374037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:49.374037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:49.374037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:49.374037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:49.374037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:49.374037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:49.374037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:49.374037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:49.374037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:49.374037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:49.374037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:16:49.374037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:49.374796 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924848ed-c874-4924-b30f-99290cfe4666 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:49.374796 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924848ed-c874-4924-b30f-99290cfe4666 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:49.374796 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924848ed-c874-4924-b30f-99290cfe4666 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:49.375014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 496/996] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:49.375092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924848ed-c874-4924-b30f-99290cfe4666 None admin] RBAC: Adding query filter params (type=image) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:49.375092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924848ed-c874-4924-b30f-99290cfe4666 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:49.375676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924848ed-c874-4924-b30f-99290cfe4666 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:49.379034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7018b7-577f-484a-94fa-464b22137c2c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:49.380866 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 501/997] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:49.446055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:49.494723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7018b7-577f-484a-94fa-464b22137c2c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:49.533914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade13af0-7997-4d49-887c-b885487b66d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:49.534877 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade13af0-7997-4d49-887c-b885487b66d3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:49.535324 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade13af0-7997-4d49-887c-b885487b66d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:49.535745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade13af0-7997-4d49-887c-b885487b66d3 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:49.536621 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade13af0-7997-4d49-887c-b885487b66d3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:49.537077 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade13af0-7997-4d49-887c-b885487b66d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:49.538717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade13af0-7997-4d49-887c-b885487b66d3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:49.547395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 497/998] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Jun 17 07:16:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:49.557181 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924848ed-c874-4924-b30f-99290cfe4666 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:49.698668 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924848ed-c874-4924-b30f-99290cfe4666 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:49.719999 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:49.743818 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c8c48-eda0-4e95-ad2f-8a072480a90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:49.744515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c8c48-eda0-4e95-ad2f-8a072480a90f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:49.744815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c8c48-eda0-4e95-ad2f-8a072480a90f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:49.745105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c8c48-eda0-4e95-ad2f-8a072480a90f None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:49.746233 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c8c48-eda0-4e95-ad2f-8a072480a90f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:49.746658 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c8c48-eda0-4e95-ad2f-8a072480a90f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:49.748171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c8c48-eda0-4e95-ad2f-8a072480a90f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:49.753729 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 502/999] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Jun 17 07:16:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:49.759684 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade13af0-7997-4d49-887c-b885487b66d3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:49.868445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade13af0-7997-4d49-887c-b885487b66d3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:49.895561 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:49.910798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719c67a-e6af-47d2-a9dd-c4b5ff5f41d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:49.911496 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719c67a-e6af-47d2-a9dd-c4b5ff5f41d6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:49.911861 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719c67a-e6af-47d2-a9dd-c4b5ff5f41d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:49.912140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719c67a-e6af-47d2-a9dd-c4b5ff5f41d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:49.912988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719c67a-e6af-47d2-a9dd-c4b5ff5f41d6 None admin] RBAC: Adding query filter params (interface=public, service_id=e0c465d047a0428abba6987954dd4eb4, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:49.913335 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719c67a-e6af-47d2-a9dd-c4b5ff5f41d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:49.914778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719c67a-e6af-47d2-a9dd-c4b5ff5f41d6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:49.925176 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 498/1000] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Jun 17 07:16:49 2022] GET /identity/v3/endpoints?service_id=e0c465d047a0428abba6987954dd4eb4&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:49.926399 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c8c48-eda0-4e95-ad2f-8a072480a90f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:50.027966 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c8c48-eda0-4e95-ad2f-8a072480a90f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:50.062293 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85b767-e26a-4665-aacd-6808d910ddec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:50.062961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85b767-e26a-4665-aacd-6808d910ddec None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:50.063247 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85b767-e26a-4665-aacd-6808d910ddec None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:50.063527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85b767-e26a-4665-aacd-6808d910ddec None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:50.064213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85b767-e26a-4665-aacd-6808d910ddec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:50.065622 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85b767-e26a-4665-aacd-6808d910ddec None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:50.081430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 503/1001] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Jun 17 07:16:49 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:16:51.239260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ea70d-fd09-4c8a-ba89-3701a0ae2df4 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:51.239776 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ea70d-fd09-4c8a-ba89-3701a0ae2df4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:51.239911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ea70d-fd09-4c8a-ba89-3701a0ae2df4 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:51.241298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 499/1002] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:51.247902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffb109-ed7a-4eb9-97c9-c417e229d434 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:51.248326 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffb109-ed7a-4eb9-97c9-c417e229d434 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:51.248580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffb109-ed7a-4eb9-97c9-c417e229d434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:51.267145 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-17ffb109-ed7a-4eb9-97c9-c417e229d434 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:51.268352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-17ffb109-ed7a-4eb9-97c9-c417e229d434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:51.307894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:51.342627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 504/1003] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:51.365667 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ea70d-fd09-4c8a-ba89-3701a0ae2df4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:51.472936 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ea70d-fd09-4c8a-ba89-3701a0ae2df4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:51.508912 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46786396-30d4-4761-8177-f47bef3b4f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:51.509676 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46786396-30d4-4761-8177-f47bef3b4f28 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:51.509955 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46786396-30d4-4761-8177-f47bef3b4f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:51.510223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46786396-30d4-4761-8177-f47bef3b4f28 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:51.510891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46786396-30d4-4761-8177-f47bef3b4f28 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:51.512586 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46786396-30d4-4761-8177-f47bef3b4f28 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:51.525441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-46786396-30d4-4761-8177-f47bef3b4f28 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:16:51.525441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:51.525441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:51.525441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:51.525441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:51.525441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:51.525441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:51.525441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:51.525441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:16:51.525441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:51.525441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:51.525441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:51.525441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:51.525441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:51.525441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:51.525441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:51.525441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:51.526533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:51.526533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:51.526533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:51.526533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:51.526533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:51.526533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:51.526533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:51.526533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:51.526533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:51.526533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:51.526533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:51.526533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:51.526533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:51.526533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:51.526533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:51.526533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:51.527907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:51.527907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:51.527907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:51.527907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:51.527907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:51.527907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:51.527907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:51.527907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:51.527907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:51.527907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:51.527907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:51.527907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:51.527907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:16:51.527907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:51.532571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 500/1004] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Jun 17 07:16:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:51.533879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffb109-ed7a-4eb9-97c9-c417e229d434 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:51.567466 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ab28-4d2c-4b6f-bb7b-05f240c23dac None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:51.567798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ab28-4d2c-4b6f-bb7b-05f240c23dac None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:51.568025 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ab28-4d2c-4b6f-bb7b-05f240c23dac None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:51.569434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 501/1005] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:16:51.574964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10f2c3-ab27-411e-b315-c6a62a69fc0c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:51.575403 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10f2c3-ab27-411e-b315-c6a62a69fc0c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:51.575677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10f2c3-ab27-411e-b315-c6a62a69fc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:51.593000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6b10f2c3-ab27-411e-b315-c6a62a69fc0c None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:51.594210 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6b10f2c3-ab27-411e-b315-c6a62a69fc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:51.638996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffb109-ed7a-4eb9-97c9-c417e229d434 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:51.640026 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:51.677021 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 502/1006] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:51.685422 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a115d-a814-4fc5-a7f9-fdf00333f078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:51.686145 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a115d-a814-4fc5-a7f9-fdf00333f078 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:51.686454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a115d-a814-4fc5-a7f9-fdf00333f078 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:51.686732 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a115d-a814-4fc5-a7f9-fdf00333f078 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:51.687474 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a115d-a814-4fc5-a7f9-fdf00333f078 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:51.687761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a115d-a814-4fc5-a7f9-fdf00333f078 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:51.689135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a115d-a814-4fc5-a7f9-fdf00333f078 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:51.698125 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 505/1007] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Jun 17 07:16:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:51.700558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10f2c3-ab27-411e-b315-c6a62a69fc0c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:51.701476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a115d-a814-4fc5-a7f9-fdf00333f078 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:51.742172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:51.808390 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10f2c3-ab27-411e-b315-c6a62a69fc0c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:51.812706 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a115d-a814-4fc5-a7f9-fdf00333f078 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:51.844829 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee95a84-d2de-45fa-b9d0-c524b1d9c505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:51.845548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee95a84-d2de-45fa-b9d0-c524b1d9c505 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:51.845828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee95a84-d2de-45fa-b9d0-c524b1d9c505 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:51.846100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee95a84-d2de-45fa-b9d0-c524b1d9c505 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:51.846803 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee95a84-d2de-45fa-b9d0-c524b1d9c505 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:51.847105 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee95a84-d2de-45fa-b9d0-c524b1d9c505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:51.848464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee95a84-d2de-45fa-b9d0-c524b1d9c505 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:51.851371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941fbd1-1369-46d1-bc4c-8758a56c7f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:51.852186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941fbd1-1369-46d1-bc4c-8758a56c7f92 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:51.852463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941fbd1-1369-46d1-bc4c-8758a56c7f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:51.852732 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941fbd1-1369-46d1-bc4c-8758a56c7f92 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:51.853676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941fbd1-1369-46d1-bc4c-8758a56c7f92 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:51.853782 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 503/1008] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Jun 17 07:16:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:51.854835 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941fbd1-1369-46d1-bc4c-8758a56c7f92 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:51.859281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee95a84-d2de-45fa-b9d0-c524b1d9c505 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:51.902692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:51.933370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 506/1009] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Jun 17 07:16:51 2022] POST /identity/v3/services => generated 242 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:16:51.961683 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee95a84-d2de-45fa-b9d0-c524b1d9c505 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:52.007978 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeb9b2-918a-4c4c-a9ab-c3906cbff4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:52.008653 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb9b2-918a-4c4c-a9ab-c3906cbff4b2 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:52.008929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb9b2-918a-4c4c-a9ab-c3906cbff4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:52.009198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeb9b2-918a-4c4c-a9ab-c3906cbff4b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:52.009979 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeb9b2-918a-4c4c-a9ab-c3906cbff4b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:52.011437 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeb9b2-918a-4c4c-a9ab-c3906cbff4b2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:52.085353 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 504/1010] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Jun 17 07:16:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:16:52.274679 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c29dc5-0474-4ad3-acc6-eb10fa290e9d None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:52.275196 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c29dc5-0474-4ad3-acc6-eb10fa290e9d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:52.275280 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c29dc5-0474-4ad3-acc6-eb10fa290e9d None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:52.276768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 507/1011] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:52.282723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9737e-0c24-4be1-992a-68edd9e30e2a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:52.283184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9737e-0c24-4be1-992a-68edd9e30e2a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:52.283260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9737e-0c24-4be1-992a-68edd9e30e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:52.300950 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-97c9737e-0c24-4be1-992a-68edd9e30e2a None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:52.302184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-97c9737e-0c24-4be1-992a-68edd9e30e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:52.378423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 505/1012] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:52 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:52.402990 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c29dc5-0474-4ad3-acc6-eb10fa290e9d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:52.506050 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:52.514198 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c29dc5-0474-4ad3-acc6-eb10fa290e9d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:52.549428 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946b6e9-ecf7-45f0-8633-2233457646e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:52.550272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946b6e9-ecf7-45f0-8633-2233457646e4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:52.550595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946b6e9-ecf7-45f0-8633-2233457646e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:52.550871 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946b6e9-ecf7-45f0-8633-2233457646e4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:52.551522 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946b6e9-ecf7-45f0-8633-2233457646e4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:52.552959 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946b6e9-ecf7-45f0-8633-2233457646e4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:52.564896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-5946b6e9-ecf7-45f0-8633-2233457646e4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:16:52.564896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:52.564896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:52.564896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:52.564896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:52.564896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:52.564896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:52.564896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:52.564896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:16:52.564896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:52.564896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:52.564896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:52.564896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:52.564896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:52.564896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:52.564896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:52.564896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:52.566292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:52.566292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:52.566292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:52.566292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:52.566292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:52.566292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:52.566292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:52.566292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:52.566292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:52.566292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:52.566292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:52.566292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:52.566292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:52.566292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:52.566292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:52.566292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:52.567163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:52.567163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:52.567163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:52.567163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:52.567163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:52.567163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:52.567163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:52.567163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:52.567163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:52.567163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:52.567163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:52.567163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:52.567163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:16:52.567163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:52.567163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 508/1013] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:52.574548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9737e-0c24-4be1-992a-68edd9e30e2a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:52.601445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:52.683215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9737e-0c24-4be1-992a-68edd9e30e2a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:52.720474 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f6fee-595d-4719-9c4e-e3f9eacf1eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:52.721181 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f6fee-595d-4719-9c4e-e3f9eacf1eaf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:52.721491 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f6fee-595d-4719-9c4e-e3f9eacf1eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:52.721765 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f6fee-595d-4719-9c4e-e3f9eacf1eaf None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:52.722460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f6fee-595d-4719-9c4e-e3f9eacf1eaf None admin] RBAC: Adding query filter params (name=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:52.722761 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f6fee-595d-4719-9c4e-e3f9eacf1eaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:52.724117 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f6fee-595d-4719-9c4e-e3f9eacf1eaf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:52.733518 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 506/1014] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Jun 17 07:16:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:52.735465 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946b6e9-ecf7-45f0-8633-2233457646e4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:52.840828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946b6e9-ecf7-45f0-8633-2233457646e4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:52.874846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc64443-e759-457e-ae8b-af3c73028aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:52.875509 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc64443-e759-457e-ae8b-af3c73028aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:52.875792 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc64443-e759-457e-ae8b-af3c73028aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:52.876067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc64443-e759-457e-ae8b-af3c73028aa5 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:52.876760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc64443-e759-457e-ae8b-af3c73028aa5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:52.877065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc64443-e759-457e-ae8b-af3c73028aa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:52.878445 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc64443-e759-457e-ae8b-af3c73028aa5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:52.888369 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 509/1015] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Jun 17 07:16:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:52.889406 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f6fee-595d-4719-9c4e-e3f9eacf1eaf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:52.988526 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:52.992819 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f6fee-595d-4719-9c4e-e3f9eacf1eaf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:53.038592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8574eb6-2d15-4449-9339-e9c8901ad279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:53.039289 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8574eb6-2d15-4449-9339-e9c8901ad279 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:53.039567 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8574eb6-2d15-4449-9339-e9c8901ad279 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:53.039836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8574eb6-2d15-4449-9339-e9c8901ad279 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:53.040569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8574eb6-2d15-4449-9339-e9c8901ad279 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:53.041948 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8574eb6-2d15-4449-9339-e9c8901ad279 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:53.160395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 507/1016] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Jun 17 07:16:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:16:54.107005 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064de5d-4a13-4d35-bdc3-a1d03118a492 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:54.107543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064de5d-4a13-4d35-bdc3-a1d03118a492 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:54.107543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064de5d-4a13-4d35-bdc3-a1d03118a492 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:54.108955 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 510/1017] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:54.117557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0100e-87c4-4059-92d7-1c9d53d1fa72 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:54.117557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0100e-87c4-4059-92d7-1c9d53d1fa72 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:54.117557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0100e-87c4-4059-92d7-1c9d53d1fa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:54.132015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-33f0100e-87c4-4059-92d7-1c9d53d1fa72 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:54.133182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-33f0100e-87c4-4059-92d7-1c9d53d1fa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:54.207618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 508/1018] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:54.231749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064de5d-4a13-4d35-bdc3-a1d03118a492 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:54.262662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:54.295167 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb1a19-1b9f-4202-815d-fdb432928356 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:54.295481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb1a19-1b9f-4202-815d-fdb432928356 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:54.295741 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb1a19-1b9f-4202-815d-fdb432928356 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:54.297261 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 509/1019] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:16:54.303770 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf5d9-1693-4031-a28f-71c6fa2e396f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:54.304363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf5d9-1693-4031-a28f-71c6fa2e396f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:54.304907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf5d9-1693-4031-a28f-71c6fa2e396f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:54.322615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4d6cf5d9-1693-4031-a28f-71c6fa2e396f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:54.323919 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4d6cf5d9-1693-4031-a28f-71c6fa2e396f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:54.351322 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064de5d-4a13-4d35-bdc3-a1d03118a492 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:54.387161 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18598770-8832-4f3c-a247-ff7d2119169b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:54.388063 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18598770-8832-4f3c-a247-ff7d2119169b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:54.388342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18598770-8832-4f3c-a247-ff7d2119169b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:54.388615 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18598770-8832-4f3c-a247-ff7d2119169b None admin] PATH_INFO: `/v3/services/image` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:54.389267 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18598770-8832-4f3c-a247-ff7d2119169b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:54.390667 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18598770-8832-4f3c-a247-ff7d2119169b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:54.396025 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:54.408991 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 510/1020] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:54.409299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-18598770-8832-4f3c-a247-ff7d2119169b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:16:54.409299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:54.409299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:54.409299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:54.409299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:54.409299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:54.409299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:54.409299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:54.409299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:16:54.409299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:54.409299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:54.409299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:54.409299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:54.409299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:54.409299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:54.409299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:54.409299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:54.410451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:54.410451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:54.410451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:54.410451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:54.410451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:54.410451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:54.410451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:54.410451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:54.410451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:54.410451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:54.410451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:54.410451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:54.410451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:54.410451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:54.410451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:54.410451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:54.411330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:54.411330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:54.411330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:54.411330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:54.411330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:54.411330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:54.411330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:54.411330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:54.411330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:54.411330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:54.411330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:54.411330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:54.411330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:16:54.411330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:54.411330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 511/1021] 10.222.0.52 () {56 vars in 1105 bytes} [Fri Jun 17 07:16:54 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:54.412122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cf5d9-1693-4031-a28f-71c6fa2e396f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:54.425316 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18598770-8832-4f3c-a247-ff7d2119169b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:54.528135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:54.529149 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cf5d9-1693-4031-a28f-71c6fa2e396f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:54.541912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18598770-8832-4f3c-a247-ff7d2119169b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:54.567256 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6f46a-2d01-4aa2-a6a0-75dd3fbe9e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:54.567959 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6f46a-2d01-4aa2-a6a0-75dd3fbe9e68 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:54.568216 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6f46a-2d01-4aa2-a6a0-75dd3fbe9e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:54.568497 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6f46a-2d01-4aa2-a6a0-75dd3fbe9e68 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:54.569206 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6f46a-2d01-4aa2-a6a0-75dd3fbe9e68 None admin] RBAC: Adding query filter params (name=image) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:54.569546 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6f46a-2d01-4aa2-a6a0-75dd3fbe9e68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:54.570917 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6f46a-2d01-4aa2-a6a0-75dd3fbe9e68 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:54.581054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 511/1022] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:54.581222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bfec8-4baf-43b1-aa7c-9b45d4c280d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:54.581222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bfec8-4baf-43b1-aa7c-9b45d4c280d6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:54.581222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bfec8-4baf-43b1-aa7c-9b45d4c280d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:54.581222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bfec8-4baf-43b1-aa7c-9b45d4c280d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:54.581569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bfec8-4baf-43b1-aa7c-9b45d4c280d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:54.581569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bfec8-4baf-43b1-aa7c-9b45d4c280d6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:54.582514 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6f46a-2d01-4aa2-a6a0-75dd3fbe9e68 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:54.583262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 512/1023] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:54.588978 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bfec8-4baf-43b1-aa7c-9b45d4c280d6 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:54.651968 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:54.701435 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6f46a-2d01-4aa2-a6a0-75dd3fbe9e68 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:54.701607 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bfec8-4baf-43b1-aa7c-9b45d4c280d6 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:54.738158 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026983f-04ac-4787-b607-d760f2de78b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:54.738834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026983f-04ac-4787-b607-d760f2de78b5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:54.739121 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026983f-04ac-4787-b607-d760f2de78b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:54.739402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026983f-04ac-4787-b607-d760f2de78b5 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:54.740104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026983f-04ac-4787-b607-d760f2de78b5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:54.740413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026983f-04ac-4787-b607-d760f2de78b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:54.741230 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1b449-03df-4c2d-b16a-5fd215ad4605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:54.741828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026983f-04ac-4787-b607-d760f2de78b5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:54.741927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1b449-03df-4c2d-b16a-5fd215ad4605 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:54.742175 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1b449-03df-4c2d-b16a-5fd215ad4605 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:54.742448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1b449-03df-4c2d-b16a-5fd215ad4605 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:54.743156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1b449-03df-4c2d-b16a-5fd215ad4605 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:54.744562 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1b449-03df-4c2d-b16a-5fd215ad4605 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:54.747915 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 512/1024] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:54.753524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026983f-04ac-4787-b607-d760f2de78b5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:54.826640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 513/1025] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Jun 17 07:16:54 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:16:54.861766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026983f-04ac-4787-b607-d760f2de78b5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:54.892316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:54.900909 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b8333-a032-4c1e-812a-5b4f260481b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:54.901623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b8333-a032-4c1e-812a-5b4f260481b4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:54.901936 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b8333-a032-4c1e-812a-5b4f260481b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:54.906440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b8333-a032-4c1e-812a-5b4f260481b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:54.906440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b8333-a032-4c1e-812a-5b4f260481b4 None admin] RBAC: Adding query filter params (interface=public, service_id=bc90cefb4909438a826093ef4f5407ae, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:54.906440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b8333-a032-4c1e-812a-5b4f260481b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:54.906440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b8333-a032-4c1e-812a-5b4f260481b4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:54.916287 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 513/1026] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Jun 17 07:16:54 2022] GET /identity/v3/endpoints?service_id=bc90cefb4909438a826093ef4f5407ae&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:54.918063 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1b449-03df-4c2d-b16a-5fd215ad4605 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:54.929787 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:55.025270 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1b449-03df-4c2d-b16a-5fd215ad4605 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:55.065142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48846d01-69d6-4a5c-b8ea-693d2fb6e531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:55.065868 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48846d01-69d6-4a5c-b8ea-693d2fb6e531 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:55.066144 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48846d01-69d6-4a5c-b8ea-693d2fb6e531 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:55.066413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48846d01-69d6-4a5c-b8ea-693d2fb6e531 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:55.067092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48846d01-69d6-4a5c-b8ea-693d2fb6e531 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:55.068451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48846d01-69d6-4a5c-b8ea-693d2fb6e531 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:55.079623 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 514/1027] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Jun 17 07:16:54 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:16:55.468643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8fad1-a4a0-49b8-b5c7-f7d40c7d351a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:55.469191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8fad1-a4a0-49b8-b5c7-f7d40c7d351a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:55.469191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8fad1-a4a0-49b8-b5c7-f7d40c7d351a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:55.470793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 514/1028] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:55.475794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf05b0-5fdc-403e-b98d-9a3e5b6de33d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:55.476210 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf05b0-5fdc-403e-b98d-9a3e5b6de33d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:55.476427 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf05b0-5fdc-403e-b98d-9a3e5b6de33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:55.494176 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6bdf05b0-5fdc-403e-b98d-9a3e5b6de33d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:55.495376 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6bdf05b0-5fdc-403e-b98d-9a3e5b6de33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:55.564799 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 515/1029] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:55.589157 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8fad1-a4a0-49b8-b5c7-f7d40c7d351a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:55.708736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8fad1-a4a0-49b8-b5c7-f7d40c7d351a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:55.743486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3f91c-1ba3-46d2-8cfe-00d600d0d1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:55.744234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3f91c-1ba3-46d2-8cfe-00d600d0d1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:55.744517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3f91c-1ba3-46d2-8cfe-00d600d0d1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:55.744793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3f91c-1ba3-46d2-8cfe-00d600d0d1a9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:55.755580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3f91c-1ba3-46d2-8cfe-00d600d0d1a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:55.764822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-15b3f91c-1ba3-46d2-8cfe-00d600d0d1a9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:16:55.764822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:55.764822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:55.764822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:55.764822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:55.764822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:55.764822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:55.764822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:55.764822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:55.764822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:55.764822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:55.764822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:55.764822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:55.764822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:55.764822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:55.764822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:55.765814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:55.765814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:55.765814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:55.765814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:55.765814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:55.765814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:55.765814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:55.765814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:55.765814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:55.765814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:55.765814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:55.765814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:55.765814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:55.765814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:55.765814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:55.765814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:55.766659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:55.766659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:55.766659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:55.766659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:55.766659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:55.766659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:55.766659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:55.766659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:55.766659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:55.766659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:55.766659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:16:55.766659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:55.769678 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 515/1030] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Jun 17 07:16:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:55.771943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf05b0-5fdc-403e-b98d-9a3e5b6de33d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:55.774193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:55.874099 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf05b0-5fdc-403e-b98d-9a3e5b6de33d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:55.909509 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767c2cb-b42b-4683-b2a1-c40858948026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:55.910176 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767c2cb-b42b-4683-b2a1-c40858948026 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:55.910453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767c2cb-b42b-4683-b2a1-c40858948026 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:55.910723 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767c2cb-b42b-4683-b2a1-c40858948026 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:55.911459 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767c2cb-b42b-4683-b2a1-c40858948026 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:55.911759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767c2cb-b42b-4683-b2a1-c40858948026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:55.913121 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767c2cb-b42b-4683-b2a1-c40858948026 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:55.926059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 516/1031] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Jun 17 07:16:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:55.927309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3f91c-1ba3-46d2-8cfe-00d600d0d1a9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:55.985500 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:56.034361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3f91c-1ba3-46d2-8cfe-00d600d0d1a9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:56.068059 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90547-a595-4af6-a69e-35cde337f348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:56.068857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90547-a595-4af6-a69e-35cde337f348 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:56.069140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90547-a595-4af6-a69e-35cde337f348 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:56.069449 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90547-a595-4af6-a69e-35cde337f348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:56.080807 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90547-a595-4af6-a69e-35cde337f348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:56.082285 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90547-a595-4af6-a69e-35cde337f348 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:56.099294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-55d90547-a595-4af6-a69e-35cde337f348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:56.099294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:56.099294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:56.099294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:56.099294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:56.099294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:56.099294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:56.099294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:56.099294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:56.099294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:56.099294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:56.099294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:56.099294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:56.099294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:56.099294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:56.100231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:56.100231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:56.100231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:56.100231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:56.100231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:56.100231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:56.100231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:56.100231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:56.100231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:56.100231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:56.100231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:56.100231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:56.100231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:56.100231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:56.100231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:56.100231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:56.100231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:56.101215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:56.101215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:56.101215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:56.101215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:56.102317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 516/1032] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:56.107215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767c2cb-b42b-4683-b2a1-c40858948026 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:56.171711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:56.213173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767c2cb-b42b-4683-b2a1-c40858948026 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:56.248532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513880a6-e5cb-47d6-9754-c037e6dce607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:56.249199 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513880a6-e5cb-47d6-9754-c037e6dce607 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:56.249513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513880a6-e5cb-47d6-9754-c037e6dce607 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:56.249793 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513880a6-e5cb-47d6-9754-c037e6dce607 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:56.250508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513880a6-e5cb-47d6-9754-c037e6dce607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:56.250817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513880a6-e5cb-47d6-9754-c037e6dce607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:56.252190 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513880a6-e5cb-47d6-9754-c037e6dce607 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:56.265550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 517/1033] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:56.270980 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90547-a595-4af6-a69e-35cde337f348 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:56.375483 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90547-a595-4af6-a69e-35cde337f348 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:56.377828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:56.409699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c8a18-64e8-4aa9-a68b-b11c30fe2bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:56.410493 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c8a18-64e8-4aa9-a68b-b11c30fe2bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:56.410774 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c8a18-64e8-4aa9-a68b-b11c30fe2bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:56.411058 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c8a18-64e8-4aa9-a68b-b11c30fe2bc7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:56.419802 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c8a18-64e8-4aa9-a68b-b11c30fe2bc7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:56.421236 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c8a18-64e8-4aa9-a68b-b11c30fe2bc7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:56.436345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-883c8a18-64e8-4aa9-a68b-b11c30fe2bc7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:16:56.436345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:56.436345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:56.436345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:56.436345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:56.436345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:56.436345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:56.436345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:56.436345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:56.436345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:56.436345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:56.436345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:56.436345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:16:56.436345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:16:56.436345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:16:56.436345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:56.437304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:56.438566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:56.438566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:56.438566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:16:56.438566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:16:56.438566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:16:56.438566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:16:56.438566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:16:56.438566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:16:56.438566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:16:56.438566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:56.439685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 517/1034] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Jun 17 07:16:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:56.443546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513880a6-e5cb-47d6-9754-c037e6dce607 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:56.545589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513880a6-e5cb-47d6-9754-c037e6dce607 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:56.569438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:56.581045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720598a-bb6b-47c5-900a-d2dcfbec22cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:56.588125 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720598a-bb6b-47c5-900a-d2dcfbec22cd None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:56.588125 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720598a-bb6b-47c5-900a-d2dcfbec22cd None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:56.588125 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720598a-bb6b-47c5-900a-d2dcfbec22cd None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:56.588125 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720598a-bb6b-47c5-900a-d2dcfbec22cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:56.588125 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720598a-bb6b-47c5-900a-d2dcfbec22cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:56.588125 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720598a-bb6b-47c5-900a-d2dcfbec22cd None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:56.603025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 518/1035] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Jun 17 07:16:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:56.608612 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c8a18-64e8-4aa9-a68b-b11c30fe2bc7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:56.721302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c8a18-64e8-4aa9-a68b-b11c30fe2bc7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:56.756485 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec0ab5-e178-4e29-9756-b19eaaf95624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:56.757138 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec0ab5-e178-4e29-9756-b19eaaf95624 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:56.757447 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec0ab5-e178-4e29-9756-b19eaaf95624 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:56.757724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec0ab5-e178-4e29-9756-b19eaaf95624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:56.788905 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:56.832999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec0ab5-e178-4e29-9756-b19eaaf95624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:56.834503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec0ab5-e178-4e29-9756-b19eaaf95624 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:56.933840 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 518/1036] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:16:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:16:56.939414 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720598a-bb6b-47c5-900a-d2dcfbec22cd None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:57.016531 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf78b47-d365-434b-9ff6-ff0928f00419 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:57.016824 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf78b47-d365-434b-9ff6-ff0928f00419 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:57.017103 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf78b47-d365-434b-9ff6-ff0928f00419 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:57.018661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 519/1037] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:16:57.023265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00d155-63aa-4903-bf44-991dde336542 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:57.023549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00d155-63aa-4903-bf44-991dde336542 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:57.023820 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00d155-63aa-4903-bf44-991dde336542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:57.039925 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cb00d155-63aa-4903-bf44-991dde336542 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:57.041095 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cb00d155-63aa-4903-bf44-991dde336542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:57.046879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720598a-bb6b-47c5-900a-d2dcfbec22cd None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:57.085055 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd12fe0-1c0a-48fe-aaef-0425a499e429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:57.085888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd12fe0-1c0a-48fe-aaef-0425a499e429 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:57.086168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd12fe0-1c0a-48fe-aaef-0425a499e429 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:57.086441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd12fe0-1c0a-48fe-aaef-0425a499e429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:57.097197 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd12fe0-1c0a-48fe-aaef-0425a499e429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:57.098684 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd12fe0-1c0a-48fe-aaef-0425a499e429 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:57.106786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:57.115718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 520/1038] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:57.119505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-acd12fe0-1c0a-48fe-aaef-0425a499e429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:57.119505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:57.119505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:57.119505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:57.119505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:57.119505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:57.119505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:57.119505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:57.119505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:57.119505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:57.119505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:57.119505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:57.119505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:16:57.119505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:16:57.119505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:16:57.120656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:16:57.120656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:57.120656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:57.120656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:57.120656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:57.120656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:57.120656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:57.120656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:57.120656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:57.120656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:57.120656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:57.120656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:57.120656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:57.120656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:57.120656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:57.120656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:57.120656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:57.121980 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:16:57.121980 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:16:57.121980 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:16:57.121980 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:16:57.124883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 519/1039] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:57.126559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00d155-63aa-4903-bf44-991dde336542 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:57.141078 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd12fe0-1c0a-48fe-aaef-0425a499e429 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:57.181475 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:57.242673 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00d155-63aa-4903-bf44-991dde336542 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:57.258036 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd12fe0-1c0a-48fe-aaef-0425a499e429 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:57.282333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2413476-358e-41ca-b8bd-0f01094f3d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:57.282998 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2413476-358e-41ca-b8bd-0f01094f3d71 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:57.283284 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2413476-358e-41ca-b8bd-0f01094f3d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:57.283554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2413476-358e-41ca-b8bd-0f01094f3d71 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:57.284266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2413476-358e-41ca-b8bd-0f01094f3d71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:57.284567 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2413476-358e-41ca-b8bd-0f01094f3d71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:57.285957 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2413476-358e-41ca-b8bd-0f01094f3d71 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:57.294656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892920de-c6f4-4db7-b8fd-d7bcb9df0553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:57.295444 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892920de-c6f4-4db7-b8fd-d7bcb9df0553 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:57.295726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892920de-c6f4-4db7-b8fd-d7bcb9df0553 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:57.296003 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892920de-c6f4-4db7-b8fd-d7bcb9df0553 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:57.297177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892920de-c6f4-4db7-b8fd-d7bcb9df0553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:57.297315 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 521/1040] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:57.298448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190197fc-9067-4835-89b8-7281365e7bf3 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:57.298663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892920de-c6f4-4db7-b8fd-d7bcb9df0553 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:57.298775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190197fc-9067-4835-89b8-7281365e7bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:57.298989 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190197fc-9067-4835-89b8-7281365e7bf3 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:57.300351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 522/1041] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:57.300531 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 520/1042] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:57.302980 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190197fc-9067-4835-89b8-7281365e7bf3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:57.305494 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac09be-5fb2-46db-91f9-4eef78d976cd None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:57.305885 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac09be-5fb2-46db-91f9-4eef78d976cd None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:57.306050 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac09be-5fb2-46db-91f9-4eef78d976cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:57.322519 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d0ac09be-5fb2-46db-91f9-4eef78d976cd None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:57.324250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d0ac09be-5fb2-46db-91f9-4eef78d976cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:57.361402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:57.392747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 521/1043] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:16:57.393618 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac09be-5fb2-46db-91f9-4eef78d976cd None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:57.407823 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190197fc-9067-4835-89b8-7281365e7bf3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:57.427443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:57.442810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847c6b6-5fbe-44c6-a96e-d99f13ec9692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:57.443614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847c6b6-5fbe-44c6-a96e-d99f13ec9692 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:57.443891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847c6b6-5fbe-44c6-a96e-d99f13ec9692 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:57.444161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847c6b6-5fbe-44c6-a96e-d99f13ec9692 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:57.451609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847c6b6-5fbe-44c6-a96e-d99f13ec9692 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:57.453044 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847c6b6-5fbe-44c6-a96e-d99f13ec9692 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:57.467351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-f847c6b6-5fbe-44c6-a96e-d99f13ec9692 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:57.467351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:57.467351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:57.467351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:57.467351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:57.467351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:57.467351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:57.467351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:57.467351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:57.467351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:57.467351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:57.467351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:57.467351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:16:57.467351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:16:57.467351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:16:57.468448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:16:57.468448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:57.468448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:57.468448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:57.468448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:57.468448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:57.468448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:57.468448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:57.468448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:57.468448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:57.468448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:57.468448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:57.468448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:57.468448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:57.468448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:57.468448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:57.468448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:57.469404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:16:57.469404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:16:57.469404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:16:57.469404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:16:57.469404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:16:57.469404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:16:57.469404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:16:57.469404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:57.469404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 523/1044] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:16:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:16:57.469404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847c6b6-5fbe-44c6-a96e-d99f13ec9692 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:57.497998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac09be-5fb2-46db-91f9-4eef78d976cd None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:57.533874 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd643d-8056-4f75-bb84-e552ed3ff8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:57.534543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd643d-8056-4f75-bb84-e552ed3ff8ed None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:57.534822 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd643d-8056-4f75-bb84-e552ed3ff8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:57.535095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd643d-8056-4f75-bb84-e552ed3ff8ed None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:57.535791 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd643d-8056-4f75-bb84-e552ed3ff8ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:57.537215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd643d-8056-4f75-bb84-e552ed3ff8ed None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:57.571893 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847c6b6-5fbe-44c6-a96e-d99f13ec9692 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:57.586575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:57.606763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25738035-26b6-4334-8eff-8d2b4a34f2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:57.607548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25738035-26b6-4334-8eff-8d2b4a34f2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:57.607832 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25738035-26b6-4334-8eff-8d2b4a34f2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:57.608110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25738035-26b6-4334-8eff-8d2b4a34f2d9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:57.608767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25738035-26b6-4334-8eff-8d2b4a34f2d9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:57.610155 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25738035-26b6-4334-8eff-8d2b4a34f2d9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:57.618070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 522/1045] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:16:57 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:16:57.618984 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd643d-8056-4f75-bb84-e552ed3ff8ed None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:57.622752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-25738035-26b6-4334-8eff-8d2b4a34f2d9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:16:57.622752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:57.622752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:16:57.622752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:16:57.622752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:16:57.622752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:16:57.622752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:16:57.622752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:57.622752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:16:57.622752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:57.622752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:16:57.622752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:57.622752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:57.622752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:57.622752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:57.622752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:57.622752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:57.623843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:57.623843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:57.623843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:57.623843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:57.623843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:57.623843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:57.623843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:16:57.623843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:16:57.623843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:16:57.623843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:16:57.623843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:57.623843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:57.623843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:57.623843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:57.623843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:57.623843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:57.624701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:57.624701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:57.624701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:57.624701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:57.624701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:57.624701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:57.624701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:57.624701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:57.624701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:57.624701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:57.624701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:16:57.624701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:16:57.624701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:16:57.624701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:16:57.629085 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 524/1046] 10.222.0.52 () {56 vars in 1105 bytes} [Fri Jun 17 07:16:57 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:57.630107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25738035-26b6-4334-8eff-8d2b4a34f2d9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:57.742323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:57.760445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25738035-26b6-4334-8eff-8d2b4a34f2d9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:57.760640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd643d-8056-4f75-bb84-e552ed3ff8ed None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:57.791547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c19a7f-5319-4037-837a-9ee7721c1073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:57.792223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c19a7f-5319-4037-837a-9ee7721c1073 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:57.793155 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c19a7f-5319-4037-837a-9ee7721c1073 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:57.793155 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c19a7f-5319-4037-837a-9ee7721c1073 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:57.793584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c19a7f-5319-4037-837a-9ee7721c1073 None admin] RBAC: Adding query filter params (name=image) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:57.793893 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c19a7f-5319-4037-837a-9ee7721c1073 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:57.794505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6774698-68ba-4f00-908f-366372d37d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:57.795172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6774698-68ba-4f00-908f-366372d37d0d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:57.795285 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c19a7f-5319-4037-837a-9ee7721c1073 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:57.795442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6774698-68ba-4f00-908f-366372d37d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:57.795716 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6774698-68ba-4f00-908f-366372d37d0d None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:57.796501 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6774698-68ba-4f00-908f-366372d37d0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:57.796804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6774698-68ba-4f00-908f-366372d37d0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:57.798317 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6774698-68ba-4f00-908f-366372d37d0d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:57.800663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 525/1047] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:57.806189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c19a7f-5319-4037-837a-9ee7721c1073 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:57.816087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 523/1048] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:16:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:57.822435 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6774698-68ba-4f00-908f-366372d37d0d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:57.853703 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:57.927091 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c19a7f-5319-4037-837a-9ee7721c1073 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:57.935192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6774698-68ba-4f00-908f-366372d37d0d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:57.964961 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ab487-6d50-4755-9e38-a9760898a62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:57.965650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ab487-6d50-4755-9e38-a9760898a62f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:57.966044 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ab487-6d50-4755-9e38-a9760898a62f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:57.966316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ab487-6d50-4755-9e38-a9760898a62f None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:57.967133 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ab487-6d50-4755-9e38-a9760898a62f None admin] RBAC: Adding query filter params (type=image) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:57.967483 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ab487-6d50-4755-9e38-a9760898a62f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:57.968786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ab487-6d50-4755-9e38-a9760898a62f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:57.971631 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07651cdb-67da-4d78-8c3c-509ec8e50963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:57.972286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07651cdb-67da-4d78-8c3c-509ec8e50963 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:57.972568 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07651cdb-67da-4d78-8c3c-509ec8e50963 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:57.972841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07651cdb-67da-4d78-8c3c-509ec8e50963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:57.974183 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07651cdb-67da-4d78-8c3c-509ec8e50963 None admin] RBAC: Adding query filter params (role.id=ad9cdfc3afef42c9a483ec04f9815c3b, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=88e1572d22c048b09699a2fe50900f92) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:57.974290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 526/1049] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:16:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:57.974367 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07651cdb-67da-4d78-8c3c-509ec8e50963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:57.975684 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07651cdb-67da-4d78-8c3c-509ec8e50963 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:57.979928 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ab487-6d50-4755-9e38-a9760898a62f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:57.983331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 524/1050] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:16:57 2022] GET /identity/v3/role_assignments?user.id=88e1572d22c048b09699a2fe50900f92&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=ad9cdfc3afef42c9a483ec04f9815c3b => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:16:58.097340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ab487-6d50-4755-9e38-a9760898a62f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:58.105717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:58.135381 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584020d5-e6a6-4450-8f97-cdf02084cd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:58.137061 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584020d5-e6a6-4450-8f97-cdf02084cd68 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:58.137379 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584020d5-e6a6-4450-8f97-cdf02084cd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:58.137665 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584020d5-e6a6-4450-8f97-cdf02084cd68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:58.138427 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584020d5-e6a6-4450-8f97-cdf02084cd68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:58.139826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584020d5-e6a6-4450-8f97-cdf02084cd68 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:58.213481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 527/1051] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Jun 17 07:16:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:16:59.864028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855ddab-ba6f-48aa-b192-a5ac6a016791 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:59.864542 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855ddab-ba6f-48aa-b192-a5ac6a016791 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:59.864652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855ddab-ba6f-48aa-b192-a5ac6a016791 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:59.866149 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 525/1052] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:59.871329 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d034aae-523f-4162-897f-e5ec45b51ef9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:59.871741 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d034aae-523f-4162-897f-e5ec45b51ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:59.871929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d034aae-523f-4162-897f-e5ec45b51ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:59.889550 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2d034aae-523f-4162-897f-e5ec45b51ef9 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:59.890735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2d034aae-523f-4162-897f-e5ec45b51ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:59.967873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 528/1053] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:59.991540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855ddab-ba6f-48aa-b192-a5ac6a016791 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:00.007651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:00.102864 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855ddab-ba6f-48aa-b192-a5ac6a016791 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:00.113373 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ce4a0-191c-40e3-915f-ce6eb38412ae None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:00.113373 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ce4a0-191c-40e3-915f-ce6eb38412ae None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:00.113373 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ce4a0-191c-40e3-915f-ce6eb38412ae None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:00.114843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 529/1054] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:17:00.119968 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bc953-71cd-4500-9905-20c437999b0d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:00.120284 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bc953-71cd-4500-9905-20c437999b0d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:00.121110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bc953-71cd-4500-9905-20c437999b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:00.139133 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4d1bc953-71cd-4500-9905-20c437999b0d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:00.141879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4d1bc953-71cd-4500-9905-20c437999b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:00.141980 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d3107-d85d-4636-8b4c-9d84573601ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:00.142187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d3107-d85d-4636-8b4c-9d84573601ff None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:00.142510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d3107-d85d-4636-8b4c-9d84573601ff None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:00.142749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d3107-d85d-4636-8b4c-9d84573601ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:00.153676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d3107-d85d-4636-8b4c-9d84573601ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:17:00.161294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-9d6d3107-d85d-4636-8b4c-9d84573601ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:00.161294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:00.161294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:00.161294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:00.161294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:00.161294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:00.161294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:00.161294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:00.161294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:00.161294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:00.161294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:00.161294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:00.161294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:17:00.161294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:17:00.161294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:17:00.161294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:17:00.162294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:17:00.162294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:17:00.162294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:17:00.162294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:17:00.162294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:00.162294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:00.162294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:00.162294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:00.162294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:00.162294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:00.162294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:00.162294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:00.162294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:00.162294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:00.162294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:00.162294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:00.163827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:00.163827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:00.163827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:00.163827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:00.163827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:17:00.163827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:17:00.163827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:17:00.163827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:17:00.163827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:17:00.163827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:17:00.163827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:00.163827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:17:00.163827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 526/1055] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:16:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:00.169471 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d3107-d85d-4636-8b4c-9d84573601ff None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:00.219121 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 530/1056] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:17:00.241042 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bc953-71cd-4500-9905-20c437999b0d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:00.250409 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:00.263078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:00.285735 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d3107-d85d-4636-8b4c-9d84573601ff None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:00.324529 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d57ad1-bf9e-4ea5-8f07-31da14cdc9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:00.325278 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d57ad1-bf9e-4ea5-8f07-31da14cdc9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:00.325525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d57ad1-bf9e-4ea5-8f07-31da14cdc9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:00.325808 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d57ad1-bf9e-4ea5-8f07-31da14cdc9c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:00.326566 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d57ad1-bf9e-4ea5-8f07-31da14cdc9c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:00.327097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d57ad1-bf9e-4ea5-8f07-31da14cdc9c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:00.328437 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d57ad1-bf9e-4ea5-8f07-31da14cdc9c2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:00.344154 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 527/1057] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:17:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:00.346695 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d57ad1-bf9e-4ea5-8f07-31da14cdc9c2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:00.356190 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bc953-71cd-4500-9905-20c437999b0d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:00.394464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772cd48-6c76-4c74-8437-6c9c7c61acef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:00.395275 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772cd48-6c76-4c74-8437-6c9c7c61acef None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:00.395564 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772cd48-6c76-4c74-8437-6c9c7c61acef None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:00.395839 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772cd48-6c76-4c74-8437-6c9c7c61acef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:00.407649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772cd48-6c76-4c74-8437-6c9c7c61acef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:17:00.415735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-4772cd48-6c76-4c74-8437-6c9c7c61acef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:17:00.415735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:00.415735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:00.415735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:00.415735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:00.415735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:00.415735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:00.415735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:00.415735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:00.415735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:00.415735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:00.415735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:00.415735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:17:00.415735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:17:00.415735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:17:00.415735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:17:00.416836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:17:00.416836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:17:00.416836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:17:00.416836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:17:00.416836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:00.416836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:00.416836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:00.416836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:00.416836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:00.416836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:00.416836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:00.416836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:00.416836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:00.416836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:00.416836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:00.416836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:00.418509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:00.418509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:00.418509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:00.418509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:00.418509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:17:00.418509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:17:00.418509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:17:00.418509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:17:00.418509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:17:00.418509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:17:00.418509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:17:00.418509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:17:00.418509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 531/1058] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Jun 17 07:17:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:00.419671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4bd26-f7dc-4661-9ecd-3a5b768ee23c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:00.419671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4bd26-f7dc-4661-9ecd-3a5b768ee23c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:00.419671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4bd26-f7dc-4661-9ecd-3a5b768ee23c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:00.420867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 532/1059] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:00.423932 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4bd26-f7dc-4661-9ecd-3a5b768ee23c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:00.459201 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d57ad1-bf9e-4ea5-8f07-31da14cdc9c2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:00.518967 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291fea0-b932-4c5e-a633-4163685eefd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:00.518967 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291fea0-b932-4c5e-a633-4163685eefd9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:00.518967 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291fea0-b932-4c5e-a633-4163685eefd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:00.518967 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291fea0-b932-4c5e-a633-4163685eefd9 None admin] PATH_INFO: `/v3/users/8d790958972d4c8387eb3051a994ac1f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:00.519544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:00.519651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:00.519759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291fea0-b932-4c5e-a633-4163685eefd9 None admin] RBAC: Authorizing `identity:get_user(user_id=8d790958972d4c8387eb3051a994ac1f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:00.519759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291fea0-b932-4c5e-a633-4163685eefd9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:00.521472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 528/1060] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:17:00 2022] GET /identity/v3/users/8d790958972d4c8387eb3051a994ac1f => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:17:00.522828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6a097-d44e-4ccc-8c3c-224c699b112f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:00.523204 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6a097-d44e-4ccc-8c3c-224c699b112f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:00.523480 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6a097-d44e-4ccc-8c3c-224c699b112f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:00.537254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4bd26-f7dc-4661-9ecd-3a5b768ee23c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:00.540629 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0fe6a097-d44e-4ccc-8c3c-224c699b112f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:00.541841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0fe6a097-d44e-4ccc-8c3c-224c699b112f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:00.571275 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621344cd-72b6-46f1-8de8-a9fa65139868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:00.572025 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621344cd-72b6-46f1-8de8-a9fa65139868 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:00.572240 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621344cd-72b6-46f1-8de8-a9fa65139868 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:00.572513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621344cd-72b6-46f1-8de8-a9fa65139868 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:00.573265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621344cd-72b6-46f1-8de8-a9fa65139868 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:00.574223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621344cd-72b6-46f1-8de8-a9fa65139868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:00.575613 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621344cd-72b6-46f1-8de8-a9fa65139868 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:00.584020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 533/1061] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Jun 17 07:17:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:17:00.584899 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621344cd-72b6-46f1-8de8-a9fa65139868 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:00.611194 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 529/1062] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:00.612051 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6a097-d44e-4ccc-8c3c-224c699b112f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:00.689913 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621344cd-72b6-46f1-8de8-a9fa65139868 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:00.720271 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6a097-d44e-4ccc-8c3c-224c699b112f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:00.724498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509a5e5-5b48-4bd5-ad38-2dd0a49a10ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:00.725160 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509a5e5-5b48-4bd5-ad38-2dd0a49a10ac None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:00.725487 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509a5e5-5b48-4bd5-ad38-2dd0a49a10ac None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:00.725766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509a5e5-5b48-4bd5-ad38-2dd0a49a10ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:00.737535 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:00.743681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:00.755763 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee4838-6cd7-4cad-91ad-4bf08060beee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:00.756558 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee4838-6cd7-4cad-91ad-4bf08060beee None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:00.756836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee4838-6cd7-4cad-91ad-4bf08060beee None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:00.757104 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee4838-6cd7-4cad-91ad-4bf08060beee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:00.768559 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee4838-6cd7-4cad-91ad-4bf08060beee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:00.770238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee4838-6cd7-4cad-91ad-4bf08060beee None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:00.789029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-beee4838-6cd7-4cad-91ad-4bf08060beee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:00.789029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:00.789029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:00.789029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:00.789029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:00.789029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:00.789029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:00.789029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:00.789029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:00.789029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:00.789029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:00.789029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:00.789029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:00.789029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:00.789029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:00.790130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:00.790130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:00.790130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:00.790130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:00.790130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:00.790130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:00.790130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:00.790130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:00.790130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:00.790130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:00.790130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:00.790130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:00.790130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:00.790130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:00.790130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:00.790130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:00.790130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:00.791769 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:00.791769 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:00.791769 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:00.791769 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:17:00.791769 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 530/1063] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:00.791769 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee4838-6cd7-4cad-91ad-4bf08060beee None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:00.798478 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509a5e5-5b48-4bd5-ad38-2dd0a49a10ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:00.799945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509a5e5-5b48-4bd5-ad38-2dd0a49a10ac None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:00.905437 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee4838-6cd7-4cad-91ad-4bf08060beee None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:00.907570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 534/1064] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:17:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:17:00.908836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509a5e5-5b48-4bd5-ad38-2dd0a49a10ac None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:00.944352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7419e3-c712-4aa2-b56e-06bec5b71133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:00.945021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7419e3-c712-4aa2-b56e-06bec5b71133 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:00.945296 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7419e3-c712-4aa2-b56e-06bec5b71133 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:00.945601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7419e3-c712-4aa2-b56e-06bec5b71133 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:00.952436 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:00.996620 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:01.017490 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509a5e5-5b48-4bd5-ad38-2dd0a49a10ac None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:01.023334 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7419e3-c712-4aa2-b56e-06bec5b71133 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:01.024745 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7419e3-c712-4aa2-b56e-06bec5b71133 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:01.063107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808459c-2de7-4fba-b4d1-2cbde7b1facd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:01.063911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808459c-2de7-4fba-b4d1-2cbde7b1facd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:01.064248 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808459c-2de7-4fba-b4d1-2cbde7b1facd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:01.064532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808459c-2de7-4fba-b4d1-2cbde7b1facd None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:01.065274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808459c-2de7-4fba-b4d1-2cbde7b1facd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:01.065613 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808459c-2de7-4fba-b4d1-2cbde7b1facd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:01.069279 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808459c-2de7-4fba-b4d1-2cbde7b1facd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:01.082767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 535/1065] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:01.083667 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808459c-2de7-4fba-b4d1-2cbde7b1facd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:01.133676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 531/1066] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:17:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:17:01.134535 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7419e3-c712-4aa2-b56e-06bec5b71133 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:01.193305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:01.196089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808459c-2de7-4fba-b4d1-2cbde7b1facd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:01.230896 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3d922-8e60-4669-b472-461d0a20db7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:01.231761 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3d922-8e60-4669-b472-461d0a20db7c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:01.232036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3d922-8e60-4669-b472-461d0a20db7c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:01.232307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3d922-8e60-4669-b472-461d0a20db7c None admin] PATH_INFO: `/v3/projects/8f87d4e4d2454865abb64faafcf4d13b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:01.233557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3d922-8e60-4669-b472-461d0a20db7c None admin] RBAC: Authorizing `identity:get_project(project_id=8f87d4e4d2454865abb64faafcf4d13b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:01.234971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3d922-8e60-4669-b472-461d0a20db7c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:01.236676 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 536/1067] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:17:01 2022] GET /identity/v3/projects/8f87d4e4d2454865abb64faafcf4d13b => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:01.237532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3d922-8e60-4669-b472-461d0a20db7c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:01.239457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:01.268477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7419e3-c712-4aa2-b56e-06bec5b71133 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:01.305617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82f048-0a7c-4aa1-b9c8-e395ba0d98ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:01.306338 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82f048-0a7c-4aa1-b9c8-e395ba0d98ab None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:01.306616 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82f048-0a7c-4aa1-b9c8-e395ba0d98ab None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:01.306885 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82f048-0a7c-4aa1-b9c8-e395ba0d98ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:01.315574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82f048-0a7c-4aa1-b9c8-e395ba0d98ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:01.317030 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82f048-0a7c-4aa1-b9c8-e395ba0d98ab None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:01.333097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-9a82f048-0a7c-4aa1-b9c8-e395ba0d98ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:17:01.333097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:01.333097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:01.333097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:01.333097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:01.333097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:01.333097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:01.333097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:01.333097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:01.333097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:01.333097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:01.333097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:01.333097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:17:01.333097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:17:01.333097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:17:01.333097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:01.334353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:01.335357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:01.335357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:01.335357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:17:01.335357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:17:01.335357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:17:01.335357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:17:01.335357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:17:01.335357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:17:01.335357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:17:01.335357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:17:01.335357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 532/1068] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Jun 17 07:17:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:01.335357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82f048-0a7c-4aa1-b9c8-e395ba0d98ab None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:01.347509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3d922-8e60-4669-b472-461d0a20db7c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:01.383736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7f988-5acb-40a3-b285-683eb81fbe3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:01.384631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7f988-5acb-40a3-b285-683eb81fbe3a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:01.384917 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7f988-5acb-40a3-b285-683eb81fbe3a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:01.385194 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7f988-5acb-40a3-b285-683eb81fbe3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:01.396713 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7f988-5acb-40a3-b285-683eb81fbe3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:01.398356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7f988-5acb-40a3-b285-683eb81fbe3a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:01.416830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-1ec7f988-5acb-40a3-b285-683eb81fbe3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:01.416830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:01.416830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:01.416830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:01.416830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:01.416830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:01.416830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:01.416830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:01.416830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:01.416830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:01.416830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:01.416830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:01.416830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:01.416830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:01.416830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:01.418960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:01.418960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:01.418960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:01.418960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:01.418960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:01.418960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:01.418960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:01.418960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:01.418960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:01.418960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:01.418960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:01.418960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:01.418960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:01.418960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:01.418960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:01.418960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:01.418960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:01.419870 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:01.419870 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:01.419870 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:01.419870 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:17:01.419870 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 537/1069] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:01.419870 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7f988-5acb-40a3-b285-683eb81fbe3a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:01.444268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:01.444713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82f048-0a7c-4aa1-b9c8-e395ba0d98ab None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:01.482761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699c30c-27e9-4fba-9f60-f04a23e59fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:01.483420 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699c30c-27e9-4fba-9f60-f04a23e59fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:01.483701 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699c30c-27e9-4fba-9f60-f04a23e59fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:01.483975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699c30c-27e9-4fba-9f60-f04a23e59fd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:01.484989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699c30c-27e9-4fba-9f60-f04a23e59fd7 None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=8f87d4e4d2454865abb64faafcf4d13b, user.id=8d790958972d4c8387eb3051a994ac1f) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:01.485354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699c30c-27e9-4fba-9f60-f04a23e59fd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:01.486803 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699c30c-27e9-4fba-9f60-f04a23e59fd7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:01.488844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:01.493398 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 533/1070] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:17:01 2022] GET /identity/v3/role_assignments?user.id=8d790958972d4c8387eb3051a994ac1f&scope.project.id=8f87d4e4d2454865abb64faafcf4d13b&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:01.494250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699c30c-27e9-4fba-9f60-f04a23e59fd7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:01.536128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7f988-5acb-40a3-b285-683eb81fbe3a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:01.579270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c97e5-0b3a-4968-819b-62229277283b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:01.579991 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c97e5-0b3a-4968-819b-62229277283b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:01.580280 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c97e5-0b3a-4968-819b-62229277283b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:01.580557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c97e5-0b3a-4968-819b-62229277283b None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:01.581467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c97e5-0b3a-4968-819b-62229277283b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:01.581785 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c97e5-0b3a-4968-819b-62229277283b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:01.583277 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c97e5-0b3a-4968-819b-62229277283b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:01.606225 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 538/1071] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Jun 17 07:17:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:01.612160 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c97e5-0b3a-4968-819b-62229277283b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:01.625007 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699c30c-27e9-4fba-9f60-f04a23e59fd7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:01.689816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f5bd0-e1d6-4fa9-b86c-361b0f109ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:01.690965 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f5bd0-e1d6-4fa9-b86c-361b0f109ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:01.691511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f5bd0-e1d6-4fa9-b86c-361b0f109ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:01.692030 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f5bd0-e1d6-4fa9-b86c-361b0f109ac5 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:01.693288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f5bd0-e1d6-4fa9-b86c-361b0f109ac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:01.693834 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f5bd0-e1d6-4fa9-b86c-361b0f109ac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:01.696156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f5bd0-e1d6-4fa9-b86c-361b0f109ac5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:01.716694 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 534/1072] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:01.750056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:01.776348 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c97e5-0b3a-4968-819b-62229277283b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:01.818687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477aba5-6d28-4441-a4fd-7ec839dee5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:01.819506 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477aba5-6d28-4441-a4fd-7ec839dee5be None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:01.819786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477aba5-6d28-4441-a4fd-7ec839dee5be None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:01.820059 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477aba5-6d28-4441-a4fd-7ec839dee5be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:01.833314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477aba5-6d28-4441-a4fd-7ec839dee5be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:01.834730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477aba5-6d28-4441-a4fd-7ec839dee5be None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:01.856380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c477aba5-6d28-4441-a4fd-7ec839dee5be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:01.856380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:01.856380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:01.856380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:01.856380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:01.856380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:01.856380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:01.856380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:01.856380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:01.856380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:01.856380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:01.856380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:01.856380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:01.856380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:01.856380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:01.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:01.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:01.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:01.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:01.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:01.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:01.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:01.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:01.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:01.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:01.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:01.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:01.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:01.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:01.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:01.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:01.857649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:01.863270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:01.863270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:01.863270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:01.863270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:17:01.863270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 539/1073] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:17:01.863586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f5bd0-e1d6-4fa9-b86c-361b0f109ac5 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:01.929023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:01.972256 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f5bd0-e1d6-4fa9-b86c-361b0f109ac5 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:02.010139 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5a5d6-7b22-447f-9768-f589bb9d4c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:02.011282 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5a5d6-7b22-447f-9768-f589bb9d4c5b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:02.011566 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5a5d6-7b22-447f-9768-f589bb9d4c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:02.012264 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5a5d6-7b22-447f-9768-f589bb9d4c5b None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:02.013007 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5a5d6-7b22-447f-9768-f589bb9d4c5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:02.013314 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5a5d6-7b22-447f-9768-f589bb9d4c5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:02.014838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5a5d6-7b22-447f-9768-f589bb9d4c5b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:02.028522 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 535/1074] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:02.034515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477aba5-6d28-4441-a4fd-7ec839dee5be None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:02.142961 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477aba5-6d28-4441-a4fd-7ec839dee5be None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:02.173037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:02.178809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfeee0-c5bd-40b1-b6f4-506f2d9e75f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:02.179653 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfeee0-c5bd-40b1-b6f4-506f2d9e75f5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:02.179893 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfeee0-c5bd-40b1-b6f4-506f2d9e75f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:02.180169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfeee0-c5bd-40b1-b6f4-506f2d9e75f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:02.187864 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfeee0-c5bd-40b1-b6f4-506f2d9e75f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:02.189361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfeee0-c5bd-40b1-b6f4-506f2d9e75f5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:02.206228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-02dfeee0-c5bd-40b1-b6f4-506f2d9e75f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:17:02.206228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:02.206228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:02.206228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:02.206228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:02.206228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:02.206228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:02.206228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:02.206228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:02.206228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:02.206228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:02.206228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:02.206228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:17:02.206228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:17:02.206228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:17:02.207352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:17:02.207352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:02.207352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:02.207352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:02.207352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:02.207352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:02.207352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:02.207352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:02.207352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:02.207352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:02.207352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:02.207352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:02.207352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:02.207352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:02.207352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:02.207352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:02.207352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:02.208317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:17:02.208317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:17:02.208317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:17:02.208317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:17:02.208317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:17:02.208317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:17:02.208317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:17:02.208317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:17:02.208317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 540/1075] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:17:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:02.213725 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5a5d6-7b22-447f-9768-f589bb9d4c5b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:02.315082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5a5d6-7b22-447f-9768-f589bb9d4c5b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:02.332188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:02.348333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf31d7b-3791-4e08-bf0a-299ceaaaa1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:02.348987 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf31d7b-3791-4e08-bf0a-299ceaaaa1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:02.349265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf31d7b-3791-4e08-bf0a-299ceaaaa1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:02.349563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf31d7b-3791-4e08-bf0a-299ceaaaa1e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:02.350339 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf31d7b-3791-4e08-bf0a-299ceaaaa1e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:02.350642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf31d7b-3791-4e08-bf0a-299ceaaaa1e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:02.352184 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf31d7b-3791-4e08-bf0a-299ceaaaa1e0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:02.365733 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 536/1076] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:17:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:02.371971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfeee0-c5bd-40b1-b6f4-506f2d9e75f5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:02.473438 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfeee0-c5bd-40b1-b6f4-506f2d9e75f5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:02.506938 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb51919-6de7-48a1-aa7c-9fea28b6b6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:02.507826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb51919-6de7-48a1-aa7c-9fea28b6b6c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:02.508105 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb51919-6de7-48a1-aa7c-9fea28b6b6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:02.508377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb51919-6de7-48a1-aa7c-9fea28b6b6c3 None admin] PATH_INFO: `/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/88e1572d22c048b09699a2fe50900f92/roles/ad9cdfc3afef42c9a483ec04f9815c3b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:02.510580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb51919-6de7-48a1-aa7c-9fea28b6b6c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dffdba97abf4f59b12c4fbdc6245e9e, user_id=88e1572d22c048b09699a2fe50900f92, role_id=ad9cdfc3afef42c9a483ec04f9815c3b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:02.512838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb51919-6de7-48a1-aa7c-9fea28b6b6c3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:02.577248 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 541/1077] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:17:02 2022] PUT /identity/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/88e1572d22c048b09699a2fe50900f92/roles/ad9cdfc3afef42c9a483ec04f9815c3b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:17:03.679635 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437665e-42c4-4c5d-ae0b-2d1fd929c9b3 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:03.680158 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437665e-42c4-4c5d-ae0b-2d1fd929c9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:03.680158 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437665e-42c4-4c5d-ae0b-2d1fd929c9b3 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:03.681417 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 537/1078] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:03.687625 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefed78c-eb76-4efd-baef-ad964eac7f9b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:03.688034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefed78c-eb76-4efd-baef-ad964eac7f9b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:03.688181 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefed78c-eb76-4efd-baef-ad964eac7f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:03.705247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-fefed78c-eb76-4efd-baef-ad964eac7f9b None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:03.706473 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fefed78c-eb76-4efd-baef-ad964eac7f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:03.754046 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:03.775063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 542/1079] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:03.798525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437665e-42c4-4c5d-ae0b-2d1fd929c9b3 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:03.900563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437665e-42c4-4c5d-ae0b-2d1fd929c9b3 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:03.935545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e9f28-0d73-4e93-8777-b4a59e79ac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:03.936252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e9f28-0d73-4e93-8777-b4a59e79ac88 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:03.936532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e9f28-0d73-4e93-8777-b4a59e79ac88 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:03.936806 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e9f28-0d73-4e93-8777-b4a59e79ac88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:03.946789 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e9f28-0d73-4e93-8777-b4a59e79ac88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:17:03.955235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-959e9f28-0d73-4e93-8777-b4a59e79ac88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:03.955235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:03.955235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:03.955235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:03.955235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:03.955235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:03.955235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:03.955235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:03.955235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:03.955235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:03.955235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:03.955235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:03.955235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:17:03.955235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:17:03.955235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:17:03.955235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:17:03.956397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:17:03.956397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:17:03.956397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:17:03.956397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:17:03.956397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:03.956397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:03.956397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:03.956397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:03.956397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:03.956397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:03.956397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:03.956397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:03.956397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:03.956397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:03.956397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:03.956397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:03.962617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:03.962617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:03.962617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:03.962617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:03.962617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:17:03.962617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:17:03.962617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:17:03.962617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:17:03.962617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:17:03.962617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:17:03.962617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:03.962617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:17:03.962617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 538/1080] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:17:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:03.965757 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefed78c-eb76-4efd-baef-ad964eac7f9b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:04.064240 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefed78c-eb76-4efd-baef-ad964eac7f9b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:04.099338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5d20e-1526-4baa-8c67-8136d95ac6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:04.100019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5d20e-1526-4baa-8c67-8136d95ac6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:04.100306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5d20e-1526-4baa-8c67-8136d95ac6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:04.100587 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5d20e-1526-4baa-8c67-8136d95ac6d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:04.101362 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5d20e-1526-4baa-8c67-8136d95ac6d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:04.101679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5d20e-1526-4baa-8c67-8136d95ac6d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:04.103053 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5d20e-1526-4baa-8c67-8136d95ac6d3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:04.112219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 543/1081] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:17:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:17:04.117979 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e9f28-0d73-4e93-8777-b4a59e79ac88 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:04.160402 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:04.222035 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e9f28-0d73-4e93-8777-b4a59e79ac88 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:04.256463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8d1b3-db60-4f9d-a026-d7c565984d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:04.257351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8d1b3-db60-4f9d-a026-d7c565984d6c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:04.257638 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8d1b3-db60-4f9d-a026-d7c565984d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:04.257920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8d1b3-db60-4f9d-a026-d7c565984d6c None admin] PATH_INFO: `/v3/users/8d790958972d4c8387eb3051a994ac1f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:04.259115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8d1b3-db60-4f9d-a026-d7c565984d6c None admin] RBAC: Authorizing `identity:get_user(user_id=8d790958972d4c8387eb3051a994ac1f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:04.260569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8d1b3-db60-4f9d-a026-d7c565984d6c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:04.262683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 539/1082] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:17:04 2022] GET /identity/v3/users/8d790958972d4c8387eb3051a994ac1f => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:17:04.268397 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5d20e-1526-4baa-8c67-8136d95ac6d3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:04.314171 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:04.377820 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5d20e-1526-4baa-8c67-8136d95ac6d3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:04.412060 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebabcef-d4eb-4d01-901b-236ed4eb2560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:04.412927 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebabcef-d4eb-4d01-901b-236ed4eb2560 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:04.413209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebabcef-d4eb-4d01-901b-236ed4eb2560 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:04.413525 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebabcef-d4eb-4d01-901b-236ed4eb2560 None admin] PATH_INFO: `/v3/projects/8f87d4e4d2454865abb64faafcf4d13b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:04.414729 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebabcef-d4eb-4d01-901b-236ed4eb2560 None admin] RBAC: Authorizing `identity:get_project(project_id=8f87d4e4d2454865abb64faafcf4d13b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:04.416183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebabcef-d4eb-4d01-901b-236ed4eb2560 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:04.418838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 544/1083] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:17:04 2022] GET /identity/v3/projects/8f87d4e4d2454865abb64faafcf4d13b => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:04.424758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8d1b3-db60-4f9d-a026-d7c565984d6c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:04.524431 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8d1b3-db60-4f9d-a026-d7c565984d6c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:04.532625 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:04.559250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f929c6-ae38-4184-8c40-e228af5983ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:04.567707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f929c6-ae38-4184-8c40-e228af5983ba None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:04.567707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f929c6-ae38-4184-8c40-e228af5983ba None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:04.567707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f929c6-ae38-4184-8c40-e228af5983ba None admin] PATH_INFO: `/v3/projects/8f87d4e4d2454865abb64faafcf4d13b/users/8d790958972d4c8387eb3051a994ac1f/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:04.567707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f929c6-ae38-4184-8c40-e228af5983ba None admin] RBAC: Authorizing `identity:create_grant(project_id=8f87d4e4d2454865abb64faafcf4d13b, user_id=8d790958972d4c8387eb3051a994ac1f, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:04.567707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f929c6-ae38-4184-8c40-e228af5983ba None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:04.692899 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 540/1084] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:17:04 2022] PUT /identity/v3/projects/8f87d4e4d2454865abb64faafcf4d13b/users/8d790958972d4c8387eb3051a994ac1f/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:17:04.722379 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572f16e-c20e-4468-9228-0443a40bc259 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:04.722973 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572f16e-c20e-4468-9228-0443a40bc259 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:04.722973 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572f16e-c20e-4468-9228-0443a40bc259 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:04.724410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 545/1085] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:04.730511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe6b79-2df3-4423-a22c-d563fe725210 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:04.730798 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe6b79-2df3-4423-a22c-d563fe725210 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:04.731075 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe6b79-2df3-4423-a22c-d563fe725210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:04.749608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-20fe6b79-2df3-4423-a22c-d563fe725210 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:04.750865 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-20fe6b79-2df3-4423-a22c-d563fe725210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:04.830331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 541/1086] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:04.855503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572f16e-c20e-4468-9228-0443a40bc259 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:04.960661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572f16e-c20e-4468-9228-0443a40bc259 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:04.972149 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:04.994688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d818e-9f00-4186-8089-07ef7cf818c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:04.996250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d818e-9f00-4186-8089-07ef7cf818c1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:04.996529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d818e-9f00-4186-8089-07ef7cf818c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:04.996799 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d818e-9f00-4186-8089-07ef7cf818c1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:05.007451 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d818e-9f00-4186-8089-07ef7cf818c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:17:05.017045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-597d818e-9f00-4186-8089-07ef7cf818c1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:17:05.017045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:05.017045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:05.017045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:05.017045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:05.017045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:05.017045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:05.017045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:05.017045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:05.017045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:05.017045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:05.017045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:05.017045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:17:05.017045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:17:05.017045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:17:05.017045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:17:05.018050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:17:05.018050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:17:05.018050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:17:05.018050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:17:05.018050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:05.018050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:05.018050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:05.018050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:05.018050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:05.018050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:05.018050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:05.018050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:05.018050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:05.018050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:05.018050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:05.018050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:05.019154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:05.019154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:05.019154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:05.019154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:05.019154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:17:05.019154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:17:05.019154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:17:05.019154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:17:05.019154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:17:05.019154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:17:05.019154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:17:05.019154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:17:05.019154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 546/1087] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Jun 17 07:17:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:05.024241 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe6b79-2df3-4423-a22c-d563fe725210 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:05.118828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:05.124589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe6b79-2df3-4423-a22c-d563fe725210 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:05.161238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d1aae-cc9f-4a14-8dca-ec6cdcbc3abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:05.161957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d1aae-cc9f-4a14-8dca-ec6cdcbc3abb None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:05.162241 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d1aae-cc9f-4a14-8dca-ec6cdcbc3abb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:05.162557 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d1aae-cc9f-4a14-8dca-ec6cdcbc3abb None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:05.163310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d1aae-cc9f-4a14-8dca-ec6cdcbc3abb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:05.163616 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d1aae-cc9f-4a14-8dca-ec6cdcbc3abb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:05.165165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d1aae-cc9f-4a14-8dca-ec6cdcbc3abb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:05.174369 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 542/1088] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Jun 17 07:17:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:05.180146 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d818e-9f00-4186-8089-07ef7cf818c1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:05.285135 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d818e-9f00-4186-8089-07ef7cf818c1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:05.318148 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6991878-e08d-4256-a2ed-dc10c7718bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:05.318943 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6991878-e08d-4256-a2ed-dc10c7718bdd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:05.319220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6991878-e08d-4256-a2ed-dc10c7718bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:05.319489 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6991878-e08d-4256-a2ed-dc10c7718bdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:05.330994 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6991878-e08d-4256-a2ed-dc10c7718bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:05.332447 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6991878-e08d-4256-a2ed-dc10c7718bdd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:05.350356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b6991878-e08d-4256-a2ed-dc10c7718bdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:05.350356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:05.350356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:05.350356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:05.350356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:05.350356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:05.350356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:05.350356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:05.350356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:05.350356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:05.350356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:05.350356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:05.350356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:05.350356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:05.350356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:05.351343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:05.351343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:05.351343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:05.351343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:05.351343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:05.351343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:05.351343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:05.351343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:05.351343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:05.351343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:05.351343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:05.351343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:05.351343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:05.351343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:05.351343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:05.351343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:05.351343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:05.352414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:05.352414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:05.352414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:05.352414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:17:05.352414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 547/1089] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:05.357505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d1aae-cc9f-4a14-8dca-ec6cdcbc3abb None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:05.489785 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d1aae-cc9f-4a14-8dca-ec6cdcbc3abb None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:05.534394 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc64dfa-0527-4554-8265-8900c5080490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:05.535056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc64dfa-0527-4554-8265-8900c5080490 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:05.535334 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc64dfa-0527-4554-8265-8900c5080490 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:05.535603 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc64dfa-0527-4554-8265-8900c5080490 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:05.536312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc64dfa-0527-4554-8265-8900c5080490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:05.536609 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc64dfa-0527-4554-8265-8900c5080490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:05.538223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc64dfa-0527-4554-8265-8900c5080490 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:05.550707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 543/1090] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:05.556302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6991878-e08d-4256-a2ed-dc10c7718bdd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:05.581870 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:05.662185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6991878-e08d-4256-a2ed-dc10c7718bdd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:05.696934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65880e15-6d97-4c06-9245-6c8a428f8f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:05.697766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65880e15-6d97-4c06-9245-6c8a428f8f18 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:05.698051 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65880e15-6d97-4c06-9245-6c8a428f8f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:05.699012 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65880e15-6d97-4c06-9245-6c8a428f8f18 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:05.706357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65880e15-6d97-4c06-9245-6c8a428f8f18 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:05.707805 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65880e15-6d97-4c06-9245-6c8a428f8f18 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:05.722754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-65880e15-6d97-4c06-9245-6c8a428f8f18 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:17:05.722754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:05.722754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:05.722754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:05.722754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:05.722754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:05.722754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:05.722754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:05.722754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:05.722754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:05.722754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:05.722754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:05.722754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:17:05.722754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:17:05.722754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:17:05.722754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:05.724425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:05.725897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:05.725897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:05.725897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:17:05.725897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:17:05.725897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:17:05.725897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:17:05.725897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:17:05.725897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:17:05.725897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:17:05.725897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:17:05.725897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 548/1091] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Jun 17 07:17:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:17:05.729894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc64dfa-0527-4554-8265-8900c5080490 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:05.750392 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:05.834612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc64dfa-0527-4554-8265-8900c5080490 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:05.869023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45390a97-ef5e-4bd3-9425-f6df7bf51a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:05.869721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390a97-ef5e-4bd3-9425-f6df7bf51a2a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:05.870001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390a97-ef5e-4bd3-9425-f6df7bf51a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:05.870855 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390a97-ef5e-4bd3-9425-f6df7bf51a2a None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:05.871691 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45390a97-ef5e-4bd3-9425-f6df7bf51a2a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:05.872038 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45390a97-ef5e-4bd3-9425-f6df7bf51a2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:05.873500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45390a97-ef5e-4bd3-9425-f6df7bf51a2a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:05.891646 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 544/1092] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Jun 17 07:17:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:17:05.897438 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65880e15-6d97-4c06-9245-6c8a428f8f18 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:05.983719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:06.001455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65880e15-6d97-4c06-9245-6c8a428f8f18 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:06.036895 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac2b8f-3403-4758-92e9-db94063942f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:06.037590 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2b8f-3403-4758-92e9-db94063942f1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:06.037874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2b8f-3403-4758-92e9-db94063942f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:06.038144 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2b8f-3403-4758-92e9-db94063942f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:06.106023 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac2b8f-3403-4758-92e9-db94063942f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:06.107488 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac2b8f-3403-4758-92e9-db94063942f1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:06.186716 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:06.204861 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 549/1093] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:17:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:17:06.210577 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45390a97-ef5e-4bd3-9425-f6df7bf51a2a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:06.288521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:06.311176 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45390a97-ef5e-4bd3-9425-f6df7bf51a2a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:06.345861 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c96369-901d-42cb-bda8-ea3c311d23c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:06.346647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c96369-901d-42cb-bda8-ea3c311d23c1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:06.346921 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c96369-901d-42cb-bda8-ea3c311d23c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:06.347187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c96369-901d-42cb-bda8-ea3c311d23c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:06.357992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c96369-901d-42cb-bda8-ea3c311d23c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:06.359458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c96369-901d-42cb-bda8-ea3c311d23c1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:06.377266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-37c96369-901d-42cb-bda8-ea3c311d23c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:06.377266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:06.377266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:06.377266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:06.377266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:06.377266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:06.377266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:06.377266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:06.377266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:06.377266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:06.377266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:06.377266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:06.377266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:06.377266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:06.377266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:06.378365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:06.378365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:06.378365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:06.378365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:06.378365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:06.378365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:06.378365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:06.378365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:06.378365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:06.378365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:06.378365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:06.378365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:06.378365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:06.378365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:06.378365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:06.378365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:06.378365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:06.379262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:06.379262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:06.379262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:06.379262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:17:06.379262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 545/1094] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:06.384291 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac2b8f-3403-4758-92e9-db94063942f1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:06.486952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac2b8f-3403-4758-92e9-db94063942f1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:06.524306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789093-2ff4-4130-9945-4b4a38e33660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:06.524967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789093-2ff4-4130-9945-4b4a38e33660 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:06.525247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789093-2ff4-4130-9945-4b4a38e33660 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:06.525549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789093-2ff4-4130-9945-4b4a38e33660 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:06.526306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db789093-2ff4-4130-9945-4b4a38e33660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:06.526743 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db789093-2ff4-4130-9945-4b4a38e33660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:06.528144 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db789093-2ff4-4130-9945-4b4a38e33660 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:06.539481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 550/1095] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:06.545037 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c96369-901d-42cb-bda8-ea3c311d23c1 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:06.644508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c96369-901d-42cb-bda8-ea3c311d23c1 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:06.673154 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:06.680059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed64045-cf01-4cbd-a205-b6a721095b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:06.680867 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed64045-cf01-4cbd-a205-b6a721095b62 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:06.681146 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed64045-cf01-4cbd-a205-b6a721095b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:06.681461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed64045-cf01-4cbd-a205-b6a721095b62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:06.693011 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed64045-cf01-4cbd-a205-b6a721095b62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:06.694559 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed64045-cf01-4cbd-a205-b6a721095b62 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:06.709028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-1ed64045-cf01-4cbd-a205-b6a721095b62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:17:06.709028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:06.709028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:06.709028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:06.709028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:06.709028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:06.709028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:06.709028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:06.709028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:06.709028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:06.709028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:06.709028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:06.709028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:17:06.709028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:17:06.709028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:17:06.710143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:17:06.710143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:06.710143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:06.710143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:06.710143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:06.710143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:06.710143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:06.710143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:06.710143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:06.710143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:06.710143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:06.710143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:06.710143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:06.710143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:06.710143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:06.710143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:06.710143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:06.711059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:17:06.711059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:17:06.711059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:17:06.711059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:17:06.711059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:17:06.711059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:17:06.711059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:17:06.711059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:17:06.711059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 546/1096] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:17:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:06.716073 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789093-2ff4-4130-9945-4b4a38e33660 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:06.759853 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:06.820418 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789093-2ff4-4130-9945-4b4a38e33660 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:06.855900 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1fc90-29ce-47ed-9fdf-bd4aae4b47bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:06.856555 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1fc90-29ce-47ed-9fdf-bd4aae4b47bc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:06.856832 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1fc90-29ce-47ed-9fdf-bd4aae4b47bc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:06.857099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1fc90-29ce-47ed-9fdf-bd4aae4b47bc None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:06.857900 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1fc90-29ce-47ed-9fdf-bd4aae4b47bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:06.858202 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1fc90-29ce-47ed-9fdf-bd4aae4b47bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:06.859613 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1fc90-29ce-47ed-9fdf-bd4aae4b47bc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:06.868326 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254f59e-9895-41b7-99ca-9e3a06ac7a40 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:06.868844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254f59e-9895-41b7-99ca-9e3a06ac7a40 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:06.868844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254f59e-9895-41b7-99ca-9e3a06ac7a40 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:06.870438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 547/1097] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:06.876648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 551/1098] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:17:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:06.876844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297ab4c-3338-4ba5-afe0-c7cb73c4934b None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:06.876844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297ab4c-3338-4ba5-afe0-c7cb73c4934b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:06.876844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297ab4c-3338-4ba5-afe0-c7cb73c4934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:06.878011 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1fc90-29ce-47ed-9fdf-bd4aae4b47bc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:06.895252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0297ab4c-3338-4ba5-afe0-c7cb73c4934b None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:06.896461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0297ab4c-3338-4ba5-afe0-c7cb73c4934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:06.965368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 548/1099] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:06.980275 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1fc90-29ce-47ed-9fdf-bd4aae4b47bc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:06.982010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:06.988941 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297ab4c-3338-4ba5-afe0-c7cb73c4934b None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:07.017073 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b8a09-1364-423b-8367-8ab9966fa477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:07.017772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b8a09-1364-423b-8367-8ab9966fa477 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:07.018053 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b8a09-1364-423b-8367-8ab9966fa477 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:07.018323 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b8a09-1364-423b-8367-8ab9966fa477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:07.019156 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b8a09-1364-423b-8367-8ab9966fa477 None admin] RBAC: Adding query filter params (role.id=ad9cdfc3afef42c9a483ec04f9815c3b, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=88e1572d22c048b09699a2fe50900f92) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:07.019463 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b8a09-1364-423b-8367-8ab9966fa477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:07.020893 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b8a09-1364-423b-8367-8ab9966fa477 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:07.027466 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 552/1100] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:17:06 2022] GET /identity/v3/role_assignments?user.id=88e1572d22c048b09699a2fe50900f92&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=ad9cdfc3afef42c9a483ec04f9815c3b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:17:07.107193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297ab4c-3338-4ba5-afe0-c7cb73c4934b None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:07.127564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:07.146414 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133e643-aff5-46c1-af4c-097dec9dc267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:07.147230 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133e643-aff5-46c1-af4c-097dec9dc267 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:07.147511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133e643-aff5-46c1-af4c-097dec9dc267 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:07.147928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133e643-aff5-46c1-af4c-097dec9dc267 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:07.160389 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133e643-aff5-46c1-af4c-097dec9dc267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:17:07.169091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-a133e643-aff5-46c1-af4c-097dec9dc267 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:07.169091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:07.169091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:07.169091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:07.169091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:07.169091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:07.169091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:07.169091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:07.169091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:07.169091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:07.169091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:07.169091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:07.169091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:17:07.169091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:17:07.169091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:17:07.169091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:17:07.170370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:17:07.170370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:17:07.170370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:17:07.170370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:17:07.170370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:07.170370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:07.170370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:07.170370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:07.170370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:07.170370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:07.170370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:07.170370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:07.170370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:07.170370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:07.170370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:07.170370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:07.171239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:07.171239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:07.171239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:07.171239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:07.171239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:17:07.171239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:17:07.171239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:17:07.171239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:17:07.171239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:17:07.171239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:17:07.171239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:07.171239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:17:07.173527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 549/1101] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:17:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:17:07.176651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b8a09-1364-423b-8367-8ab9966fa477 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:07.281142 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b8a09-1364-423b-8367-8ab9966fa477 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:07.316714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775df400-7b56-421d-a6e1-f507d687cae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:07.317411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775df400-7b56-421d-a6e1-f507d687cae6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:07.317692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775df400-7b56-421d-a6e1-f507d687cae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:07.317968 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775df400-7b56-421d-a6e1-f507d687cae6 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:07.318711 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775df400-7b56-421d-a6e1-f507d687cae6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:07.319014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775df400-7b56-421d-a6e1-f507d687cae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:07.320389 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775df400-7b56-421d-a6e1-f507d687cae6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:07.330609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 553/1102] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:17:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:07.336793 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133e643-aff5-46c1-af4c-097dec9dc267 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:07.444786 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133e643-aff5-46c1-af4c-097dec9dc267 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:07.478747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c6f10-6db2-4b95-857b-dc63b96c8f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:07.480228 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c6f10-6db2-4b95-857b-dc63b96c8f6e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:07.480720 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c6f10-6db2-4b95-857b-dc63b96c8f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:07.481040 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c6f10-6db2-4b95-857b-dc63b96c8f6e None admin] PATH_INFO: `/v3/users/8d790958972d4c8387eb3051a994ac1f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:07.482293 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c6f10-6db2-4b95-857b-dc63b96c8f6e None admin] RBAC: Authorizing `identity:get_user(user_id=8d790958972d4c8387eb3051a994ac1f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:07.483749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c6f10-6db2-4b95-857b-dc63b96c8f6e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:07.485451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 550/1103] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:17:07 2022] GET /identity/v3/users/8d790958972d4c8387eb3051a994ac1f => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:07.491472 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775df400-7b56-421d-a6e1-f507d687cae6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:07.521360 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:07.597245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775df400-7b56-421d-a6e1-f507d687cae6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:07.634554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e6291-f96d-402f-bd68-90c47888a3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:07.635217 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e6291-f96d-402f-bd68-90c47888a3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:07.635499 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e6291-f96d-402f-bd68-90c47888a3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:07.635863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e6291-f96d-402f-bd68-90c47888a3e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:07.714785 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e6291-f96d-402f-bd68-90c47888a3e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:07.716171 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e6291-f96d-402f-bd68-90c47888a3e4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:07.745725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:07.826342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 554/1104] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:17:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:17:07.832423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c6f10-6db2-4b95-857b-dc63b96c8f6e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:07.881190 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:07.938304 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c6f10-6db2-4b95-857b-dc63b96c8f6e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:07.971670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290cfc0-9edf-4292-a0ad-442280f78cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:07.972443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290cfc0-9edf-4292-a0ad-442280f78cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:07.972718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290cfc0-9edf-4292-a0ad-442280f78cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:07.972995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290cfc0-9edf-4292-a0ad-442280f78cd1 None admin] PATH_INFO: `/v3/projects/8f87d4e4d2454865abb64faafcf4d13b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:07.974204 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290cfc0-9edf-4292-a0ad-442280f78cd1 None admin] RBAC: Authorizing `identity:get_project(project_id=8f87d4e4d2454865abb64faafcf4d13b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:07.975640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290cfc0-9edf-4292-a0ad-442280f78cd1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:07.977408 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 551/1105] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:17:07 2022] GET /identity/v3/projects/8f87d4e4d2454865abb64faafcf4d13b => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:07.984296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e6291-f96d-402f-bd68-90c47888a3e4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:08.081587 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e6291-f96d-402f-bd68-90c47888a3e4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:08.108066 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:08.115755 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b2fc8-9397-45cf-b456-1d7e44e0d6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:08.116408 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b2fc8-9397-45cf-b456-1d7e44e0d6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:08.116685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b2fc8-9397-45cf-b456-1d7e44e0d6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:08.116956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b2fc8-9397-45cf-b456-1d7e44e0d6e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:08.117812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b2fc8-9397-45cf-b456-1d7e44e0d6e9 None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=8f87d4e4d2454865abb64faafcf4d13b, user.id=8d790958972d4c8387eb3051a994ac1f) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:08.118122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b2fc8-9397-45cf-b456-1d7e44e0d6e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:08.119542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b2fc8-9397-45cf-b456-1d7e44e0d6e9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:08.125796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 555/1106] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:17:07 2022] GET /identity/v3/role_assignments?user.id=8d790958972d4c8387eb3051a994ac1f&scope.project.id=8f87d4e4d2454865abb64faafcf4d13b&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:10.331515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e7e79-b71d-4964-8adb-7960a7b85fc3 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:10.332050 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e7e79-b71d-4964-8adb-7960a7b85fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:10.332050 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e7e79-b71d-4964-8adb-7960a7b85fc3 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:10.333442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 552/1107] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:10.339440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a868620-4d04-481d-9eef-3f33aecf9fbe None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:10.339927 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a868620-4d04-481d-9eef-3f33aecf9fbe None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:10.340446 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a868620-4d04-481d-9eef-3f33aecf9fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:10.356970 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3a868620-4d04-481d-9eef-3f33aecf9fbe None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:10.358196 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3a868620-4d04-481d-9eef-3f33aecf9fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:10.426353 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 556/1108] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:10.452145 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e7e79-b71d-4964-8adb-7960a7b85fc3 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:10.551863 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e7e79-b71d-4964-8adb-7960a7b85fc3 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:10.565591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:10.584977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfe9a8-b1fb-4f24-b10f-f9427f2aca89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:10.585727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfe9a8-b1fb-4f24-b10f-f9427f2aca89 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:10.586016 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfe9a8-b1fb-4f24-b10f-f9427f2aca89 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:10.586289 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfe9a8-b1fb-4f24-b10f-f9427f2aca89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:10.587458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfe9a8-b1fb-4f24-b10f-f9427f2aca89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:10.589508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfe9a8-b1fb-4f24-b10f-f9427f2aca89 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:10.591118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 553/1109] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:10.597073 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a868620-4d04-481d-9eef-3f33aecf9fbe None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:10.694783 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a868620-4d04-481d-9eef-3f33aecf9fbe None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:10.717967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:10.728813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa1fe2-5191-4edd-b303-842860c2b395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:10.729602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa1fe2-5191-4edd-b303-842860c2b395 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:10.733340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa1fe2-5191-4edd-b303-842860c2b395 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:10.733340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa1fe2-5191-4edd-b303-842860c2b395 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:10.733340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa1fe2-5191-4edd-b303-842860c2b395 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:10.733340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa1fe2-5191-4edd-b303-842860c2b395 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:10.809594 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 557/1110] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:17:10 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:17:12.994618 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d73508-076b-4b05-9cb8-07d9f004f608 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:12.995140 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d73508-076b-4b05-9cb8-07d9f004f608 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:12.995234 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d73508-076b-4b05-9cb8-07d9f004f608 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:12.996609 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 554/1111] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:13.002153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adfb32-63e8-445e-8be4-1569bb768cb3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:13.002573 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adfb32-63e8-445e-8be4-1569bb768cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:13.002704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adfb32-63e8-445e-8be4-1569bb768cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:13.020023 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-88adfb32-63e8-445e-8be4-1569bb768cb3 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:13.021204 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-88adfb32-63e8-445e-8be4-1569bb768cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:13.087594 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 558/1112] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:13.111377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d73508-076b-4b05-9cb8-07d9f004f608 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:13.212560 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d73508-076b-4b05-9cb8-07d9f004f608 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:13.247052 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c884c20-772b-40e6-8596-d64af95e67b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:13.247815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884c20-772b-40e6-8596-d64af95e67b3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:13.248095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884c20-772b-40e6-8596-d64af95e67b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:13.248368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884c20-772b-40e6-8596-d64af95e67b3 None admin] PATH_INFO: `/v3/roles/930830d015f94e249715290654948151` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:13.249882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c884c20-772b-40e6-8596-d64af95e67b3 None admin] RBAC: Authorizing `identity:get_role(role_id=930830d015f94e249715290654948151)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:13.251362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c884c20-772b-40e6-8596-d64af95e67b3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:13.252740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 555/1113] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:17:13 2022] GET /identity/v3/roles/930830d015f94e249715290654948151 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:13.258766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adfb32-63e8-445e-8be4-1569bb768cb3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:13.360355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adfb32-63e8-445e-8be4-1569bb768cb3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:13.369831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:13.396841 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58050492-18d3-4d91-9a87-c05296e32bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:13.397748 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58050492-18d3-4d91-9a87-c05296e32bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:13.398032 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58050492-18d3-4d91-9a87-c05296e32bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:13.398309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58050492-18d3-4d91-9a87-c05296e32bf9 None admin] PATH_INFO: `/v3/users/b08fb1ecfff14617a129565c4bff6a13` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:13.412209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58050492-18d3-4d91-9a87-c05296e32bf9 None admin] RBAC: Authorizing `identity:get_user(user_id=b08fb1ecfff14617a129565c4bff6a13)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:13.413675 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58050492-18d3-4d91-9a87-c05296e32bf9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:13.415325 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 559/1114] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:17:13 2022] GET /identity/v3/users/b08fb1ecfff14617a129565c4bff6a13 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:13.422427 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c884c20-772b-40e6-8596-d64af95e67b3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:13.476599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:13.526530 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c884c20-772b-40e6-8596-d64af95e67b3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:13.559743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14580e-0c45-4c0d-80ea-2db51ffef08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:13.560376 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14580e-0c45-4c0d-80ea-2db51ffef08a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:13.560661 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14580e-0c45-4c0d-80ea-2db51ffef08a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:13.560939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14580e-0c45-4c0d-80ea-2db51ffef08a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:13.632143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14580e-0c45-4c0d-80ea-2db51ffef08a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:13.633623 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14580e-0c45-4c0d-80ea-2db51ffef08a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:13.680790 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:13.740576 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 556/1115] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:17:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:17:13.747662 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58050492-18d3-4d91-9a87-c05296e32bf9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:13.844615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58050492-18d3-4d91-9a87-c05296e32bf9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:13.878237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e890e34-1766-44db-bcf1-a4ed137894a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:13.879091 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e890e34-1766-44db-bcf1-a4ed137894a2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:13.879372 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e890e34-1766-44db-bcf1-a4ed137894a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:13.879645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e890e34-1766-44db-bcf1-a4ed137894a2 None admin] PATH_INFO: `/v3/projects/8f87d4e4d2454865abb64faafcf4d13b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:13.880809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e890e34-1766-44db-bcf1-a4ed137894a2 None admin] RBAC: Authorizing `identity:get_project(project_id=8f87d4e4d2454865abb64faafcf4d13b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:13.882263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e890e34-1766-44db-bcf1-a4ed137894a2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:13.883950 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 560/1116] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:17:13 2022] GET /identity/v3/projects/8f87d4e4d2454865abb64faafcf4d13b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:13.891223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14580e-0c45-4c0d-80ea-2db51ffef08a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:13.989592 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14580e-0c45-4c0d-80ea-2db51ffef08a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:14.027610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4776499-41c4-44b2-9ddb-b9222c23bbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:14.028279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4776499-41c4-44b2-9ddb-b9222c23bbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:14.028590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4776499-41c4-44b2-9ddb-b9222c23bbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:14.028867 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4776499-41c4-44b2-9ddb-b9222c23bbe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:14.029723 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4776499-41c4-44b2-9ddb-b9222c23bbe1 None admin] RBAC: Adding query filter params (role.id=930830d015f94e249715290654948151, scope.project.id=8f87d4e4d2454865abb64faafcf4d13b, user.id=b08fb1ecfff14617a129565c4bff6a13) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:14.030039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4776499-41c4-44b2-9ddb-b9222c23bbe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:14.031476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4776499-41c4-44b2-9ddb-b9222c23bbe1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:14.037060 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 557/1117] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:17:13 2022] GET /identity/v3/role_assignments?user.id=b08fb1ecfff14617a129565c4bff6a13&scope.project.id=8f87d4e4d2454865abb64faafcf4d13b&role.id=930830d015f94e249715290654948151 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:16.306449 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccef01a-123d-4759-ab8d-d39e7f72ed54 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:16.306977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccef01a-123d-4759-ab8d-d39e7f72ed54 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:16.307626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccef01a-123d-4759-ab8d-d39e7f72ed54 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:16.309039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 561/1118] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:16.314656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89060e8a-5bfa-4ad6-b491-877291d02fb9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:16.315122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89060e8a-5bfa-4ad6-b491-877291d02fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:16.315254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89060e8a-5bfa-4ad6-b491-877291d02fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:16.332101 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-89060e8a-5bfa-4ad6-b491-877291d02fb9 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:16.333272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-89060e8a-5bfa-4ad6-b491-877291d02fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:16.342571 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:16.400034 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 558/1119] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:16.423580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccef01a-123d-4759-ab8d-d39e7f72ed54 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:16.459830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:16.527447 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccef01a-123d-4759-ab8d-d39e7f72ed54 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:16.561405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f88c-3507-4119-b7af-c6e8a9c91daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:16.562210 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f88c-3507-4119-b7af-c6e8a9c91daf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:16.562489 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f88c-3507-4119-b7af-c6e8a9c91daf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:16.562761 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f88c-3507-4119-b7af-c6e8a9c91daf None admin] PATH_INFO: `/v3/roles/930830d015f94e249715290654948151` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:16.564222 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1f88c-3507-4119-b7af-c6e8a9c91daf None admin] RBAC: Authorizing `identity:get_role(role_id=930830d015f94e249715290654948151)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:16.565611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1f88c-3507-4119-b7af-c6e8a9c91daf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:16.566968 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 562/1120] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:17:16 2022] GET /identity/v3/roles/930830d015f94e249715290654948151 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:16.573123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89060e8a-5bfa-4ad6-b491-877291d02fb9 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:16.672594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89060e8a-5bfa-4ad6-b491-877291d02fb9 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:16.705914 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161754bc-0dcd-4235-a2ce-f5ebff04f231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:16.706778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161754bc-0dcd-4235-a2ce-f5ebff04f231 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:16.707058 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161754bc-0dcd-4235-a2ce-f5ebff04f231 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:16.707333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161754bc-0dcd-4235-a2ce-f5ebff04f231 None admin] PATH_INFO: `/v3/users/b08fb1ecfff14617a129565c4bff6a13` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:16.708515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161754bc-0dcd-4235-a2ce-f5ebff04f231 None admin] RBAC: Authorizing `identity:get_user(user_id=b08fb1ecfff14617a129565c4bff6a13)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:16.709994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161754bc-0dcd-4235-a2ce-f5ebff04f231 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:16.711638 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 559/1121] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:17:16 2022] GET /identity/v3/users/b08fb1ecfff14617a129565c4bff6a13 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:16.718023 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f88c-3507-4119-b7af-c6e8a9c91daf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:16.816783 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f88c-3507-4119-b7af-c6e8a9c91daf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:16.818309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:16.851071 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfabf1-8001-47b3-8d19-32a33fc5a240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:16.851944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfabf1-8001-47b3-8d19-32a33fc5a240 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:16.852408 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfabf1-8001-47b3-8d19-32a33fc5a240 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:16.852949 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfabf1-8001-47b3-8d19-32a33fc5a240 None admin] PATH_INFO: `/v3/projects/8f87d4e4d2454865abb64faafcf4d13b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:16.854163 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfabf1-8001-47b3-8d19-32a33fc5a240 None admin] RBAC: Authorizing `identity:get_project(project_id=8f87d4e4d2454865abb64faafcf4d13b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:16.855596 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfabf1-8001-47b3-8d19-32a33fc5a240 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:16.857283 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 563/1122] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:17:16 2022] GET /identity/v3/projects/8f87d4e4d2454865abb64faafcf4d13b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:16.863196 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161754bc-0dcd-4235-a2ce-f5ebff04f231 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:16.877805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:16.976319 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161754bc-0dcd-4235-a2ce-f5ebff04f231 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:17.015304 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861df86-9565-4a92-a802-5d561383b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:17.016296 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861df86-9565-4a92-a802-5d561383b99d None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:17.016643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861df86-9565-4a92-a802-5d561383b99d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:17.016952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861df86-9565-4a92-a802-5d561383b99d None admin] PATH_INFO: `/v3/projects/8f87d4e4d2454865abb64faafcf4d13b/users/b08fb1ecfff14617a129565c4bff6a13/roles/930830d015f94e249715290654948151` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:17.019430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861df86-9565-4a92-a802-5d561383b99d None admin] RBAC: Authorizing `identity:create_grant(project_id=8f87d4e4d2454865abb64faafcf4d13b, user_id=b08fb1ecfff14617a129565c4bff6a13, role_id=930830d015f94e249715290654948151)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:17.021117 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861df86-9565-4a92-a802-5d561383b99d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:17.074731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 560/1123] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:17:16 2022] PUT /identity/v3/projects/8f87d4e4d2454865abb64faafcf4d13b/users/b08fb1ecfff14617a129565c4bff6a13/roles/930830d015f94e249715290654948151 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:17:19.208903 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268afa3b-6b64-4921-884b-d1aead04831a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:19.209456 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268afa3b-6b64-4921-884b-d1aead04831a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:19.209456 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268afa3b-6b64-4921-884b-d1aead04831a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:19.210840 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 564/1124] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:19.216169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165353f6-3b3d-4ecd-b499-2c8d7fa4cf9b None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:19.216582 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165353f6-3b3d-4ecd-b499-2c8d7fa4cf9b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:19.216720 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165353f6-3b3d-4ecd-b499-2c8d7fa4cf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:19.233757 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-165353f6-3b3d-4ecd-b499-2c8d7fa4cf9b None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:19.234949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-165353f6-3b3d-4ecd-b499-2c8d7fa4cf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:19.300925 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 561/1125] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:19.324835 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268afa3b-6b64-4921-884b-d1aead04831a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:19.427986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268afa3b-6b64-4921-884b-d1aead04831a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:19.465837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18c0a3-134f-402e-be0e-a4072b5fe0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:19.466719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18c0a3-134f-402e-be0e-a4072b5fe0cd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:19.467044 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18c0a3-134f-402e-be0e-a4072b5fe0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:19.467366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18c0a3-134f-402e-be0e-a4072b5fe0cd None admin] PATH_INFO: `/v3/roles/930830d015f94e249715290654948151` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:19.469060 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18c0a3-134f-402e-be0e-a4072b5fe0cd None admin] RBAC: Authorizing `identity:get_role(role_id=930830d015f94e249715290654948151)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:19.470617 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18c0a3-134f-402e-be0e-a4072b5fe0cd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:19.472199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 565/1126] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:17:19 2022] GET /identity/v3/roles/930830d015f94e249715290654948151 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:19.477998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165353f6-3b3d-4ecd-b499-2c8d7fa4cf9b None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:19.480768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:19.576834 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165353f6-3b3d-4ecd-b499-2c8d7fa4cf9b None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:19.611504 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63b855-a8fa-4717-8c81-5910d9500114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:19.612386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63b855-a8fa-4717-8c81-5910d9500114 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:19.612722 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63b855-a8fa-4717-8c81-5910d9500114 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:19.612943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63b855-a8fa-4717-8c81-5910d9500114 None admin] PATH_INFO: `/v3/users/b08fb1ecfff14617a129565c4bff6a13` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:19.614242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63b855-a8fa-4717-8c81-5910d9500114 None admin] RBAC: Authorizing `identity:get_user(user_id=b08fb1ecfff14617a129565c4bff6a13)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:19.615668 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63b855-a8fa-4717-8c81-5910d9500114 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:19.617628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 562/1127] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:17:19 2022] GET /identity/v3/users/b08fb1ecfff14617a129565c4bff6a13 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:17:19.623554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18c0a3-134f-402e-be0e-a4072b5fe0cd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:19.667105 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:19.732179 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18c0a3-134f-402e-be0e-a4072b5fe0cd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:19.770660 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40712e4a-68a9-420b-9113-c53f3d91e4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:19.771614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40712e4a-68a9-420b-9113-c53f3d91e4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:19.772049 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40712e4a-68a9-420b-9113-c53f3d91e4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:19.772336 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40712e4a-68a9-420b-9113-c53f3d91e4f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:19.847654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40712e4a-68a9-420b-9113-c53f3d91e4f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:19.849267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40712e4a-68a9-420b-9113-c53f3d91e4f5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:19.892873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:19.957376 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 566/1128] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:17:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:17:19.964055 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63b855-a8fa-4717-8c81-5910d9500114 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:20.032311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:20.063806 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63b855-a8fa-4717-8c81-5910d9500114 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:20.098245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d6104-5c42-46b3-a236-4141ffb7f2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:20.099092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d6104-5c42-46b3-a236-4141ffb7f2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:20.099372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d6104-5c42-46b3-a236-4141ffb7f2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:20.099646 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d6104-5c42-46b3-a236-4141ffb7f2f2 None admin] PATH_INFO: `/v3/projects/8f87d4e4d2454865abb64faafcf4d13b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:20.100816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d6104-5c42-46b3-a236-4141ffb7f2f2 None admin] RBAC: Authorizing `identity:get_project(project_id=8f87d4e4d2454865abb64faafcf4d13b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:20.102277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d6104-5c42-46b3-a236-4141ffb7f2f2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:20.104170 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 563/1129] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:17:19 2022] GET /identity/v3/projects/8f87d4e4d2454865abb64faafcf4d13b => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:20.110191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40712e4a-68a9-420b-9113-c53f3d91e4f5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:20.206613 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40712e4a-68a9-420b-9113-c53f3d91e4f5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:20.239320 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f6c1f-0912-41dc-b993-d4536d9aece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:20.239959 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f6c1f-0912-41dc-b993-d4536d9aece4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:20.240237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f6c1f-0912-41dc-b993-d4536d9aece4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:20.240511 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f6c1f-0912-41dc-b993-d4536d9aece4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:20.241378 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f6c1f-0912-41dc-b993-d4536d9aece4 None admin] RBAC: Adding query filter params (role.id=930830d015f94e249715290654948151, scope.project.id=8f87d4e4d2454865abb64faafcf4d13b, user.id=b08fb1ecfff14617a129565c4bff6a13) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:20.241662 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f6c1f-0912-41dc-b993-d4536d9aece4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:20.243086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f6c1f-0912-41dc-b993-d4536d9aece4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:20.249390 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 567/1130] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:17:20 2022] GET /identity/v3/role_assignments?user.id=b08fb1ecfff14617a129565c4bff6a13&scope.project.id=8f87d4e4d2454865abb64faafcf4d13b&role.id=930830d015f94e249715290654948151 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:22.418538 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299c63d-1bb3-403b-baff-ef1fd33db6b9 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:22.419141 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299c63d-1bb3-403b-baff-ef1fd33db6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:22.419141 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299c63d-1bb3-403b-baff-ef1fd33db6b9 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:22.420505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 564/1131] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:17:22.426394 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafe09e-f27f-421c-9fcb-a5ffa884200f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:22.426869 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafe09e-f27f-421c-9fcb-a5ffa884200f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:22.426980 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafe09e-f27f-421c-9fcb-a5ffa884200f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:22.431877 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:22.444483 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-fdafe09e-f27f-421c-9fcb-a5ffa884200f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:22.445704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fdafe09e-f27f-421c-9fcb-a5ffa884200f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:22.513155 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 568/1132] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:22.537129 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299c63d-1bb3-403b-baff-ef1fd33db6b9 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:22.643407 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299c63d-1bb3-403b-baff-ef1fd33db6b9 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:22.678044 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34e00b-9e0c-4533-98cb-06680793afb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:22.678766 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34e00b-9e0c-4533-98cb-06680793afb8 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:22.679047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34e00b-9e0c-4533-98cb-06680793afb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:22.679320 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34e00b-9e0c-4533-98cb-06680793afb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:22.680501 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34e00b-9e0c-4533-98cb-06680793afb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:22.682159 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34e00b-9e0c-4533-98cb-06680793afb8 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:22.683799 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 565/1133] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:22.689636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafe09e-f27f-421c-9fcb-a5ffa884200f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:22.802606 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafe09e-f27f-421c-9fcb-a5ffa884200f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:22.831511 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:22.836307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a3ab1-7eb8-4762-9cfd-9787b692a47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:22.844417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a3ab1-7eb8-4762-9cfd-9787b692a47c None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:22.844417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a3ab1-7eb8-4762-9cfd-9787b692a47c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:22.844417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a3ab1-7eb8-4762-9cfd-9787b692a47c None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:22.844417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a3ab1-7eb8-4762-9cfd-9787b692a47c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:22.844417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a3ab1-7eb8-4762-9cfd-9787b692a47c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:22.921157 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 569/1134] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Jun 17 07:17:22 2022] POST /identity/v3/projects => generated 311 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:17:25.171462 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc7313-1829-4078-9fa4-72511c0c52e5 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:25.171996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc7313-1829-4078-9fa4-72511c0c52e5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:25.171996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc7313-1829-4078-9fa4-72511c0c52e5 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:25.173395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 566/1135] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:25.178764 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b18d8-9910-4dfb-b9de-a22ef9ef854f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:25.179213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b18d8-9910-4dfb-b9de-a22ef9ef854f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:25.179333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b18d8-9910-4dfb-b9de-a22ef9ef854f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:25.197282 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bf1b18d8-9910-4dfb-b9de-a22ef9ef854f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:25.198861 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bf1b18d8-9910-4dfb-b9de-a22ef9ef854f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:25.265241 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 570/1136] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:25.290164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc7313-1829-4078-9fa4-72511c0c52e5 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:25.299664 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:25.390266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc7313-1829-4078-9fa4-72511c0c52e5 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:25.423561 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bae67-8558-489d-8dcc-d825fc6cdffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:25.424282 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bae67-8558-489d-8dcc-d825fc6cdffb None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:25.424565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bae67-8558-489d-8dcc-d825fc6cdffb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:25.424843 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bae67-8558-489d-8dcc-d825fc6cdffb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:25.426001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bae67-8558-489d-8dcc-d825fc6cdffb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:25.427471 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bae67-8558-489d-8dcc-d825fc6cdffb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:25.429097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 567/1137] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:25.435571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b18d8-9910-4dfb-b9de-a22ef9ef854f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:25.533027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b18d8-9910-4dfb-b9de-a22ef9ef854f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:25.547827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:25.567208 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03eead-a7e9-4315-8584-bd2e2aa6e19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:25.567869 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03eead-a7e9-4315-8584-bd2e2aa6e19a None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:25.568151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03eead-a7e9-4315-8584-bd2e2aa6e19a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:25.568426 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03eead-a7e9-4315-8584-bd2e2aa6e19a None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:25.569136 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03eead-a7e9-4315-8584-bd2e2aa6e19a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:25.570685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03eead-a7e9-4315-8584-bd2e2aa6e19a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:25.651290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 571/1138] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:17:25 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:17:27.854974 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cf97e-89e5-48fd-a150-a6ed40e8c785 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:27.855499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cf97e-89e5-48fd-a150-a6ed40e8c785 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:27.855609 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cf97e-89e5-48fd-a150-a6ed40e8c785 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:27.856931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 568/1139] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:27.862145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c71937-5fb9-4816-b447-8292327bdfcf None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:27.862578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c71937-5fb9-4816-b447-8292327bdfcf None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:27.862700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c71937-5fb9-4816-b447-8292327bdfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:27.879100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-43c71937-5fb9-4816-b447-8292327bdfcf None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:27.880290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-43c71937-5fb9-4816-b447-8292327bdfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:27.952792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 572/1140] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:27.976590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cf97e-89e5-48fd-a150-a6ed40e8c785 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:28.053367 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:28.077711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cf97e-89e5-48fd-a150-a6ed40e8c785 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:28.110988 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f1e9b-5c2c-4ad6-905e-8974d05aae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:28.111760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f1e9b-5c2c-4ad6-905e-8974d05aae5b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:28.112037 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f1e9b-5c2c-4ad6-905e-8974d05aae5b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:28.112304 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f1e9b-5c2c-4ad6-905e-8974d05aae5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:28.122230 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f1e9b-5c2c-4ad6-905e-8974d05aae5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:17:28.129692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-b39f1e9b-5c2c-4ad6-905e-8974d05aae5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:28.129692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:28.129692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:28.129692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:28.129692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:28.129692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:28.129692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:28.129692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:28.129692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:28.129692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:28.129692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:28.129692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:28.129692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:17:28.129692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:17:28.129692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:17:28.129692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:17:28.130660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:17:28.130660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:17:28.130660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:17:28.130660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:17:28.130660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:28.130660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:28.130660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:28.130660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:28.130660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:28.130660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:28.130660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:28.130660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:28.130660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:28.130660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:28.130660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:28.130660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:28.131570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:28.131570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:28.131570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:28.131570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:28.131570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:17:28.131570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:17:28.131570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:17:28.131570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:17:28.131570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:17:28.131570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:17:28.131570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:28.131570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:17:28.131570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 569/1141] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:17:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:28.138054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c71937-5fb9-4816-b447-8292327bdfcf None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:28.232604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:28.235421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c71937-5fb9-4816-b447-8292327bdfcf None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:28.268595 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5552e95-a927-4ad0-b576-e426d005980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:28.269259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5552e95-a927-4ad0-b576-e426d005980b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:28.269575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5552e95-a927-4ad0-b576-e426d005980b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:28.269882 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5552e95-a927-4ad0-b576-e426d005980b None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:28.270662 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5552e95-a927-4ad0-b576-e426d005980b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:28.271163 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5552e95-a927-4ad0-b576-e426d005980b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:28.272786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5552e95-a927-4ad0-b576-e426d005980b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:28.281768 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 573/1142] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:17:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:28.288123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f1e9b-5c2c-4ad6-905e-8974d05aae5b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:28.384305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f1e9b-5c2c-4ad6-905e-8974d05aae5b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:28.417263 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c16477-d793-4266-ba87-c2e1d351876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:28.418141 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c16477-d793-4266-ba87-c2e1d351876d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:28.418413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c16477-d793-4266-ba87-c2e1d351876d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:28.418681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c16477-d793-4266-ba87-c2e1d351876d None admin] PATH_INFO: `/v3/users/b3a4004355564c37ba31979e288bfcd7` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:28.420535 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:28.432243 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c16477-d793-4266-ba87-c2e1d351876d None admin] RBAC: Authorizing `identity:get_user(user_id=b3a4004355564c37ba31979e288bfcd7)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:28.436099 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c16477-d793-4266-ba87-c2e1d351876d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:28.436099 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 570/1143] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:17:28 2022] GET /identity/v3/users/b3a4004355564c37ba31979e288bfcd7 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:28.441268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5552e95-a927-4ad0-b576-e426d005980b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:28.538788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5552e95-a927-4ad0-b576-e426d005980b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:28.570928 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee109aa-927e-42ff-95c8-61a2993723da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:28.571566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee109aa-927e-42ff-95c8-61a2993723da None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:28.571843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee109aa-927e-42ff-95c8-61a2993723da None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:28.572657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee109aa-927e-42ff-95c8-61a2993723da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:28.600738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:28.637851 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee109aa-927e-42ff-95c8-61a2993723da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:28.639278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee109aa-927e-42ff-95c8-61a2993723da None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:28.735667 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 574/1144] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:17:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:17:28.741601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c16477-d793-4266-ba87-c2e1d351876d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:28.838630 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c16477-d793-4266-ba87-c2e1d351876d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:28.871806 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c0031-2a40-486b-893d-21223de6ecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:28.872644 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c0031-2a40-486b-893d-21223de6ecb5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:28.872922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c0031-2a40-486b-893d-21223de6ecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:28.873194 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c0031-2a40-486b-893d-21223de6ecb5 None admin] PATH_INFO: `/v3/projects/b463f4aa0f7a41368dc6dbcbae1a873e` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:28.874375 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c0031-2a40-486b-893d-21223de6ecb5 None admin] RBAC: Authorizing `identity:get_project(project_id=b463f4aa0f7a41368dc6dbcbae1a873e)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:28.875791 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c0031-2a40-486b-893d-21223de6ecb5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:28.877489 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 571/1145] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:17:28 2022] GET /identity/v3/projects/b463f4aa0f7a41368dc6dbcbae1a873e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:17:28.883766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee109aa-927e-42ff-95c8-61a2993723da None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:28.943031 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:28.980430 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee109aa-927e-42ff-95c8-61a2993723da None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:29.013775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182da059-fdd9-4c91-bc9f-a7578addc86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:29.014415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182da059-fdd9-4c91-bc9f-a7578addc86a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:29.014694 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182da059-fdd9-4c91-bc9f-a7578addc86a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:29.014965 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182da059-fdd9-4c91-bc9f-a7578addc86a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:29.015773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182da059-fdd9-4c91-bc9f-a7578addc86a None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=b463f4aa0f7a41368dc6dbcbae1a873e, user.id=b3a4004355564c37ba31979e288bfcd7) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:29.016083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182da059-fdd9-4c91-bc9f-a7578addc86a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:29.017651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182da059-fdd9-4c91-bc9f-a7578addc86a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:29.022899 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 575/1146] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:17:28 2022] GET /identity/v3/role_assignments?user.id=b3a4004355564c37ba31979e288bfcd7&scope.project.id=b463f4aa0f7a41368dc6dbcbae1a873e&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:31.155983 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ff0c0-ea32-4716-a133-eab85bcc21b2 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:31.156554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ff0c0-ea32-4716-a133-eab85bcc21b2 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:31.156554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ff0c0-ea32-4716-a133-eab85bcc21b2 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:31.157924 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 572/1147] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:31.163217 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32c340-e6d7-4f9e-a20e-faadb61dd4c8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:31.163588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32c340-e6d7-4f9e-a20e-faadb61dd4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:31.163781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32c340-e6d7-4f9e-a20e-faadb61dd4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:31.182639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9f32c340-e6d7-4f9e-a20e-faadb61dd4c8 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:31.183865 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9f32c340-e6d7-4f9e-a20e-faadb61dd4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:31.252217 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 576/1148] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:31.275402 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ff0c0-ea32-4716-a133-eab85bcc21b2 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:31.337203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:31.379387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ff0c0-ea32-4716-a133-eab85bcc21b2 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:31.412539 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c15b0-b916-4d14-bef3-3827f1af383f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:31.413252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c15b0-b916-4d14-bef3-3827f1af383f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:31.413581 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c15b0-b916-4d14-bef3-3827f1af383f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:31.413858 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c15b0-b916-4d14-bef3-3827f1af383f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:31.424255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c15b0-b916-4d14-bef3-3827f1af383f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:17:31.432457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-111c15b0-b916-4d14-bef3-3827f1af383f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:31.432457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:31.432457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:31.432457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:31.432457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:31.432457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:31.432457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:31.432457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:31.432457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:31.432457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:31.432457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:31.432457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:31.432457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:17:31.432457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:17:31.432457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:17:31.432457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:17:31.433659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:17:31.433659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:17:31.433659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:17:31.433659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:17:31.433659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:31.433659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:31.433659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:31.433659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:31.433659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:31.433659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:31.433659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:31.433659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:31.433659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:31.433659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:31.433659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:31.433659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:31.434747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:31.434747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:31.434747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:31.434747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:31.434747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:17:31.434747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:17:31.434747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:17:31.434747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:17:31.434747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:17:31.434747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:17:31.434747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:31.434747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:17:31.434747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 573/1149] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:17:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:31.440020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32c340-e6d7-4f9e-a20e-faadb61dd4c8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:31.495467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:31.541737 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32c340-e6d7-4f9e-a20e-faadb61dd4c8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:31.574252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36251b5e-325e-41ee-b20b-2f0d2e94c353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:31.574914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36251b5e-325e-41ee-b20b-2f0d2e94c353 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:31.575196 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36251b5e-325e-41ee-b20b-2f0d2e94c353 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:31.575471 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36251b5e-325e-41ee-b20b-2f0d2e94c353 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:31.576206 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36251b5e-325e-41ee-b20b-2f0d2e94c353 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:31.576512 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36251b5e-325e-41ee-b20b-2f0d2e94c353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:31.577910 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36251b5e-325e-41ee-b20b-2f0d2e94c353 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:31.586339 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 577/1150] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:17:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:31.592701 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c15b0-b916-4d14-bef3-3827f1af383f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:31.690658 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c15b0-b916-4d14-bef3-3827f1af383f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:31.710017 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:31.731652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef67e43-86b6-4e6e-8a03-7acd5b0d7ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:31.732520 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef67e43-86b6-4e6e-8a03-7acd5b0d7ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:31.732798 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef67e43-86b6-4e6e-8a03-7acd5b0d7ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:31.733069 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef67e43-86b6-4e6e-8a03-7acd5b0d7ed6 None admin] PATH_INFO: `/v3/users/b3a4004355564c37ba31979e288bfcd7` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:31.734293 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef67e43-86b6-4e6e-8a03-7acd5b0d7ed6 None admin] RBAC: Authorizing `identity:get_user(user_id=b3a4004355564c37ba31979e288bfcd7)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:31.735737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef67e43-86b6-4e6e-8a03-7acd5b0d7ed6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:31.737483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 574/1151] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:17:31 2022] GET /identity/v3/users/b3a4004355564c37ba31979e288bfcd7 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:31.743384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36251b5e-325e-41ee-b20b-2f0d2e94c353 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:31.850815 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36251b5e-325e-41ee-b20b-2f0d2e94c353 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:31.867582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:31.883851 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3fcee-6aeb-43c8-b0fb-6c5f8e92076a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:31.885227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3fcee-6aeb-43c8-b0fb-6c5f8e92076a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:31.885831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3fcee-6aeb-43c8-b0fb-6c5f8e92076a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:31.886107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3fcee-6aeb-43c8-b0fb-6c5f8e92076a None admin] PATH_INFO: `/v3/projects/b463f4aa0f7a41368dc6dbcbae1a873e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:31.887282 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3fcee-6aeb-43c8-b0fb-6c5f8e92076a None admin] RBAC: Authorizing `identity:get_project(project_id=b463f4aa0f7a41368dc6dbcbae1a873e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:31.888709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3fcee-6aeb-43c8-b0fb-6c5f8e92076a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:31.890470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 578/1152] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:17:31 2022] GET /identity/v3/projects/b463f4aa0f7a41368dc6dbcbae1a873e => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:31.896489 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef67e43-86b6-4e6e-8a03-7acd5b0d7ed6 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:31.998302 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef67e43-86b6-4e6e-8a03-7acd5b0d7ed6 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:32.031544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b0bba-8b9c-4485-9f73-add32d5b5281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:32.032428 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b0bba-8b9c-4485-9f73-add32d5b5281 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:32.032706 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b0bba-8b9c-4485-9f73-add32d5b5281 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:32.032976 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b0bba-8b9c-4485-9f73-add32d5b5281 None admin] PATH_INFO: `/v3/projects/b463f4aa0f7a41368dc6dbcbae1a873e/users/b3a4004355564c37ba31979e288bfcd7/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:32.035002 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b0bba-8b9c-4485-9f73-add32d5b5281 None admin] RBAC: Authorizing `identity:create_grant(project_id=b463f4aa0f7a41368dc6dbcbae1a873e, user_id=b3a4004355564c37ba31979e288bfcd7, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:32.036431 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b0bba-8b9c-4485-9f73-add32d5b5281 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:32.142580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 575/1153] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:17:31 2022] PUT /identity/v3/projects/b463f4aa0f7a41368dc6dbcbae1a873e/users/b3a4004355564c37ba31979e288bfcd7/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:17:34.235844 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2914b9e-cb53-4f0e-a963-b9f6b6b84c11 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:34.236414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2914b9e-cb53-4f0e-a963-b9f6b6b84c11 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:34.236414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2914b9e-cb53-4f0e-a963-b9f6b6b84c11 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:34.237798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 579/1154] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:34.242843 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae594-9cc2-419b-9b61-a6b3a9a3c5a8 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:34.243231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae594-9cc2-419b-9b61-a6b3a9a3c5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:34.243382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae594-9cc2-419b-9b61-a6b3a9a3c5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:34.261033 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b65ae594-9cc2-419b-9b61-a6b3a9a3c5a8 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:34.262235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b65ae594-9cc2-419b-9b61-a6b3a9a3c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:34.303797 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:34.330179 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 576/1155] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:34.354267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2914b9e-cb53-4f0e-a963-b9f6b6b84c11 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:34.455333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2914b9e-cb53-4f0e-a963-b9f6b6b84c11 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:34.489274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609773f6-4ea5-4455-9395-0ef4dd21bf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:34.490022 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609773f6-4ea5-4455-9395-0ef4dd21bf8a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:34.490303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609773f6-4ea5-4455-9395-0ef4dd21bf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:34.490574 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609773f6-4ea5-4455-9395-0ef4dd21bf8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:34.500820 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609773f6-4ea5-4455-9395-0ef4dd21bf8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:17:34.508542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-609773f6-4ea5-4455-9395-0ef4dd21bf8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:34.508542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:34.508542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:34.508542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:34.508542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:34.508542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:34.508542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:34.508542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:34.508542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:34.508542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:34.508542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:34.508542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:34.508542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:17:34.508542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:17:34.508542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:17:34.508542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:17:34.509589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:17:34.509589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:17:34.509589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:17:34.509589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:17:34.509589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:34.509589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:34.509589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:34.509589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:34.509589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:34.509589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:34.509589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:34.509589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:34.509589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:34.509589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:34.509589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:34.509589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:34.510862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:34.510862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:34.510862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:34.510862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:34.510862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:17:34.510862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:17:34.510862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:17:34.510862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:17:34.510862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:17:34.510862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:17:34.510862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:34.510862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:17:34.510862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 580/1156] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:17:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:34.516071 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ae594-9cc2-419b-9b61-a6b3a9a3c5a8 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:34.613336 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ae594-9cc2-419b-9b61-a6b3a9a3c5a8 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:34.646004 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd8ad2-cc56-46f4-a027-cdc922cab0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:34.646661 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd8ad2-cc56-46f4-a027-cdc922cab0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:34.646941 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd8ad2-cc56-46f4-a027-cdc922cab0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:34.647208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd8ad2-cc56-46f4-a027-cdc922cab0e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:34.647944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd8ad2-cc56-46f4-a027-cdc922cab0e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:34.648245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd8ad2-cc56-46f4-a027-cdc922cab0e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:34.649638 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd8ad2-cc56-46f4-a027-cdc922cab0e9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:34.658030 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 577/1157] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:17:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:34.663923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609773f6-4ea5-4455-9395-0ef4dd21bf8a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:34.710930 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:34.764974 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609773f6-4ea5-4455-9395-0ef4dd21bf8a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:34.798194 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bdc26-07eb-4a62-b66a-6ee65b1b394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:34.799059 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bdc26-07eb-4a62-b66a-6ee65b1b394a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:34.799342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bdc26-07eb-4a62-b66a-6ee65b1b394a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:34.799613 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bdc26-07eb-4a62-b66a-6ee65b1b394a None admin] PATH_INFO: `/v3/users/b3a4004355564c37ba31979e288bfcd7` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:34.800769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bdc26-07eb-4a62-b66a-6ee65b1b394a None admin] RBAC: Authorizing `identity:get_user(user_id=b3a4004355564c37ba31979e288bfcd7)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:34.802220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bdc26-07eb-4a62-b66a-6ee65b1b394a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:34.803822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 581/1158] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:17:34 2022] GET /identity/v3/users/b3a4004355564c37ba31979e288bfcd7 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:34.810494 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd8ad2-cc56-46f4-a027-cdc922cab0e9 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:34.852570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:34.910230 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd8ad2-cc56-46f4-a027-cdc922cab0e9 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:34.942548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42003673-8af5-4dab-a6c1-d0ced9e095d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:34.943202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42003673-8af5-4dab-a6c1-d0ced9e095d5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:34.943468 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42003673-8af5-4dab-a6c1-d0ced9e095d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:34.943742 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42003673-8af5-4dab-a6c1-d0ced9e095d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:35.010879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42003673-8af5-4dab-a6c1-d0ced9e095d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:35.012331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42003673-8af5-4dab-a6c1-d0ced9e095d5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:35.051458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:35.109627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 578/1159] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:17:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:17:35.115577 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bdc26-07eb-4a62-b66a-6ee65b1b394a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:35.217478 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bdc26-07eb-4a62-b66a-6ee65b1b394a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:35.230704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:35.249763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32b915-9990-416f-a721-777ca26b6aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:35.250610 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32b915-9990-416f-a721-777ca26b6aca None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:35.250888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32b915-9990-416f-a721-777ca26b6aca None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:35.251158 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32b915-9990-416f-a721-777ca26b6aca None admin] PATH_INFO: `/v3/projects/b463f4aa0f7a41368dc6dbcbae1a873e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:35.252306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32b915-9990-416f-a721-777ca26b6aca None admin] RBAC: Authorizing `identity:get_project(project_id=b463f4aa0f7a41368dc6dbcbae1a873e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:35.253758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32b915-9990-416f-a721-777ca26b6aca None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:35.255552 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 582/1160] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:17:35 2022] GET /identity/v3/projects/b463f4aa0f7a41368dc6dbcbae1a873e => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:35.262771 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42003673-8af5-4dab-a6c1-d0ced9e095d5 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:35.358234 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42003673-8af5-4dab-a6c1-d0ced9e095d5 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:35.391387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c679e-94ba-4a58-8712-bf5774c717d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:35.392025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c679e-94ba-4a58-8712-bf5774c717d8 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:35.392302 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c679e-94ba-4a58-8712-bf5774c717d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:35.392573 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c679e-94ba-4a58-8712-bf5774c717d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:35.393413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c679e-94ba-4a58-8712-bf5774c717d8 None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=b463f4aa0f7a41368dc6dbcbae1a873e, user.id=b3a4004355564c37ba31979e288bfcd7) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:35.393719 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c679e-94ba-4a58-8712-bf5774c717d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:35.395143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c679e-94ba-4a58-8712-bf5774c717d8 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:35.400791 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 579/1161] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:17:35 2022] GET /identity/v3/role_assignments?user.id=b3a4004355564c37ba31979e288bfcd7&scope.project.id=b463f4aa0f7a41368dc6dbcbae1a873e&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:37.593038 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392520e7-311e-48e9-87f8-591fb57ac4c1 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:37.593629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392520e7-311e-48e9-87f8-591fb57ac4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:37.593629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392520e7-311e-48e9-87f8-591fb57ac4c1 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:37.595000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 583/1162] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:37.600168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaec67-5118-4426-8519-c4334d76b954 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:37.600571 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaec67-5118-4426-8519-c4334d76b954 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:37.600711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaec67-5118-4426-8519-c4334d76b954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:37.607515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:37.618677 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-22eaec67-5118-4426-8519-c4334d76b954 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:37.619940 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-22eaec67-5118-4426-8519-c4334d76b954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:37.685017 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 580/1163] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:37.707336 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392520e7-311e-48e9-87f8-591fb57ac4c1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:37.807990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392520e7-311e-48e9-87f8-591fb57ac4c1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:37.841079 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699727d-d6ac-4842-a456-2da3f5dc60ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:37.841851 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699727d-d6ac-4842-a456-2da3f5dc60ac None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:37.842131 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699727d-d6ac-4842-a456-2da3f5dc60ac None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:37.842403 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699727d-d6ac-4842-a456-2da3f5dc60ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:37.890657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:37.908966 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699727d-d6ac-4842-a456-2da3f5dc60ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:37.915233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699727d-d6ac-4842-a456-2da3f5dc60ac None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:38.019764 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 584/1164] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:17:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:17:38.026133 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaec67-5118-4426-8519-c4334d76b954 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:38.122479 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaec67-5118-4426-8519-c4334d76b954 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:38.155902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d0b84-7fe0-4d03-807c-1047b69a7c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:38.156628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d0b84-7fe0-4d03-807c-1047b69a7c66 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:38.156904 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d0b84-7fe0-4d03-807c-1047b69a7c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:38.157172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d0b84-7fe0-4d03-807c-1047b69a7c66 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:38.159109 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:38.164359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d0b84-7fe0-4d03-807c-1047b69a7c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:38.165821 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d0b84-7fe0-4d03-807c-1047b69a7c66 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:38.180323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-a72d0b84-7fe0-4d03-807c-1047b69a7c66 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 17 07:17:38.180323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:38.180323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 17 07:17:38.180323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 17 07:17:38.180323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:17:38.180323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:17:38.180323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:17:38.180323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:17:38.180323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 17 07:17:38.180323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:17:38.180323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:17:38.180323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:17:38.180323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:38.180323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:38.180323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:38.180323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:38.180323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:38.184426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:38.184426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:38.184426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:38.184426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:38.184426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:38.184426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:38.184426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:38.184426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:38.184426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:38.184426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:38.184426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:38.184426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:38.184426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:38.184426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:38.184426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:38.184426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:38.185299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:38.185299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:38.185299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:38.185299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:38.185299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:38.185299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:38.185299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:38.185299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:38.185299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:38.185299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:38.185299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 17 07:17:38.185299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:38.185299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 17 07:17:38.185299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:17:38.185299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 581/1165] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Jun 17 07:17:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:38.188525 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699727d-d6ac-4842-a456-2da3f5dc60ac None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:38.268479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:38.286584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699727d-d6ac-4842-a456-2da3f5dc60ac None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:38.321275 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8c509-6447-4b6b-a0a8-f35db01c90d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:38.321986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8c509-6447-4b6b-a0a8-f35db01c90d8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:38.322269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8c509-6447-4b6b-a0a8-f35db01c90d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:38.322648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8c509-6447-4b6b-a0a8-f35db01c90d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:38.323718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8c509-6447-4b6b-a0a8-f35db01c90d8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:38.324029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8c509-6447-4b6b-a0a8-f35db01c90d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:38.325416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8c509-6447-4b6b-a0a8-f35db01c90d8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:38.332569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 585/1166] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Jun 17 07:17:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:40.483922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9098c0-8157-45a9-9456-7520e15f472c None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:40.484493 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9098c0-8157-45a9-9456-7520e15f472c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:40.484493 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9098c0-8157-45a9-9456-7520e15f472c None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:40.485898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 582/1167] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:40.491115 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e336da-b0a8-4a61-8208-2622297e8d86 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:40.491508 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e336da-b0a8-4a61-8208-2622297e8d86 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:40.491677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e336da-b0a8-4a61-8208-2622297e8d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:40.508374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-76e336da-b0a8-4a61-8208-2622297e8d86 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:40.509571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-76e336da-b0a8-4a61-8208-2622297e8d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:40.573820 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 586/1168] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:40.597586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9098c0-8157-45a9-9456-7520e15f472c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:40.697535 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9098c0-8157-45a9-9456-7520e15f472c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:40.732835 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ca629-906c-437d-a6c8-c8395be8a15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:40.733522 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ca629-906c-437d-a6c8-c8395be8a15b None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:40.733808 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ca629-906c-437d-a6c8-c8395be8a15b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:40.734134 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ca629-906c-437d-a6c8-c8395be8a15b None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:40.734815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ca629-906c-437d-a6c8-c8395be8a15b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:40.736195 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ca629-906c-437d-a6c8-c8395be8a15b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:40.820961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 583/1169] 10.222.0.52 () {60 vars in 1138 bytes} [Fri Jun 17 07:17:40 2022] POST /identity/v3/domains => generated 267 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:17:43.179928 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759e68b-20cd-47cd-8cce-682628812165 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:43.180488 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759e68b-20cd-47cd-8cce-682628812165 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:43.180579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759e68b-20cd-47cd-8cce-682628812165 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:43.182617 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 587/1170] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:43.188031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d9ce3-6b02-49b9-b72e-61e38561d540 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:43.188432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d9ce3-6b02-49b9-b72e-61e38561d540 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:43.188583 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d9ce3-6b02-49b9-b72e-61e38561d540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:43.205995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-520d9ce3-6b02-49b9-b72e-61e38561d540 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:43.207172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-520d9ce3-6b02-49b9-b72e-61e38561d540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:43.255422 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:43.272544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 584/1171] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:43.296321 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759e68b-20cd-47cd-8cce-682628812165 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:43.375229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:43.398275 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759e68b-20cd-47cd-8cce-682628812165 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:43.433417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6ba2c-d3a4-47d7-ada5-8ad50675c76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:43.434219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6ba2c-d3a4-47d7-ada5-8ad50675c76d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:43.434497 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6ba2c-d3a4-47d7-ada5-8ad50675c76d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:43.434772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6ba2c-d3a4-47d7-ada5-8ad50675c76d None admin] PATH_INFO: `/v3/domains/c1d22acc82db4e00b0e413d2b526d4cc` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:43.445061 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6ba2c-d3a4-47d7-ada5-8ad50675c76d None admin] RBAC: Authorizing `identity:get_domain(domain_id=c1d22acc82db4e00b0e413d2b526d4cc)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:43.446547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6ba2c-d3a4-47d7-ada5-8ad50675c76d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:43.448587 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 588/1172] 10.222.0.52 () {56 vars in 1183 bytes} [Fri Jun 17 07:17:43 2022] GET /identity/v3/domains/c1d22acc82db4e00b0e413d2b526d4cc => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:43.454717 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d9ce3-6b02-49b9-b72e-61e38561d540 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:43.553909 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d9ce3-6b02-49b9-b72e-61e38561d540 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:43.586509 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeec708-ad15-430f-acbf-74f95c7f77ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:43.587168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeec708-ad15-430f-acbf-74f95c7f77ba None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:43.587451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeec708-ad15-430f-acbf-74f95c7f77ba None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:43.587730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeec708-ad15-430f-acbf-74f95c7f77ba None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:43.589061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeec708-ad15-430f-acbf-74f95c7f77ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:43.590541 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeec708-ad15-430f-acbf-74f95c7f77ba None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:43.709046 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 585/1173] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Jun 17 07:17:43 2022] POST /identity/v3/projects => generated 361 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:17:45.898067 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd35168-95b9-42b7-aedb-2c36a49c2537 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:45.898614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd35168-95b9-42b7-aedb-2c36a49c2537 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:45.898614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd35168-95b9-42b7-aedb-2c36a49c2537 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:45.899958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 589/1174] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:45.905803 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eaa73a-a283-45a6-a8be-468ed91b85e4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:45.906183 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eaa73a-a283-45a6-a8be-468ed91b85e4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:45.906353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eaa73a-a283-45a6-a8be-468ed91b85e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:45.923378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-83eaa73a-a283-45a6-a8be-468ed91b85e4 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:45.924552 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-83eaa73a-a283-45a6-a8be-468ed91b85e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:45.952568 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:45.991094 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 586/1175] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:46.016357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd35168-95b9-42b7-aedb-2c36a49c2537 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:46.115146 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd35168-95b9-42b7-aedb-2c36a49c2537 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:46.147645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d7906-a948-43a8-a733-b9d0e21f598a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:46.148490 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d7906-a948-43a8-a733-b9d0e21f598a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:46.148764 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d7906-a948-43a8-a733-b9d0e21f598a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:46.149033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d7906-a948-43a8-a733-b9d0e21f598a None admin] PATH_INFO: `/v3/domains/c1d22acc82db4e00b0e413d2b526d4cc` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:46.150234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d7906-a948-43a8-a733-b9d0e21f598a None admin] RBAC: Authorizing `identity:get_domain(domain_id=c1d22acc82db4e00b0e413d2b526d4cc)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:46.151684 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d7906-a948-43a8-a733-b9d0e21f598a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:46.153255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 590/1176] 10.222.0.52 () {56 vars in 1183 bytes} [Fri Jun 17 07:17:46 2022] GET /identity/v3/domains/c1d22acc82db4e00b0e413d2b526d4cc => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:46.159002 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eaa73a-a283-45a6-a8be-468ed91b85e4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:46.257900 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eaa73a-a283-45a6-a8be-468ed91b85e4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:46.290686 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835d590-f477-4070-a711-bc1bdc63044a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:46.292172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835d590-f477-4070-a711-bc1bdc63044a None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:46.292458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835d590-f477-4070-a711-bc1bdc63044a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:46.292734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835d590-f477-4070-a711-bc1bdc63044a None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:46.293471 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835d590-f477-4070-a711-bc1bdc63044a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:46.294928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835d590-f477-4070-a711-bc1bdc63044a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:46.380822 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 587/1177] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:17:46 2022] POST /identity/v3/users => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:17:48.623078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa0b47-54be-4a11-bb5c-6c3728da1c48 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:48.623642 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa0b47-54be-4a11-bb5c-6c3728da1c48 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:48.623642 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa0b47-54be-4a11-bb5c-6c3728da1c48 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:48.624988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 591/1178] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:48.630423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c8027-82eb-40f9-bc40-8b2cca71cf5f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:48.630823 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c8027-82eb-40f9-bc40-8b2cca71cf5f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:48.631073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c8027-82eb-40f9-bc40-8b2cca71cf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:48.648651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-2e0c8027-82eb-40f9-bc40-8b2cca71cf5f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:48.649860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2e0c8027-82eb-40f9-bc40-8b2cca71cf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:48.666971 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:48.716904 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 588/1179] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:17:48.740620 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa0b47-54be-4a11-bb5c-6c3728da1c48 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:48.744871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:48.842166 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa0b47-54be-4a11-bb5c-6c3728da1c48 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:48.875123 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e15fa2-b3fc-46b1-97d9-875419aa511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:48.875839 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15fa2-b3fc-46b1-97d9-875419aa511c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:48.876115 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15fa2-b3fc-46b1-97d9-875419aa511c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:48.876386 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15fa2-b3fc-46b1-97d9-875419aa511c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:48.886545 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e15fa2-b3fc-46b1-97d9-875419aa511c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:17:48.894075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-92e15fa2-b3fc-46b1-97d9-875419aa511c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:48.894075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:48.894075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:48.894075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:48.894075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:48.894075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:48.894075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:48.894075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:48.894075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:48.894075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:48.894075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:48.894075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:48.894075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:17:48.894075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:17:48.894075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:17:48.894075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:17:48.895183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:17:48.895183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:17:48.895183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:17:48.895183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:17:48.895183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:48.895183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:48.895183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:48.895183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:48.895183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:48.895183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:48.895183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:48.895183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:48.895183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:48.895183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:48.895183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:48.895183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:48.896214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:48.896214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:48.896214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:48.896214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:48.896214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:17:48.896214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:17:48.896214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:17:48.896214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:17:48.896214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:17:48.896214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:17:48.896214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:48.896214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:17:48.896214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 592/1180] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:17:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:48.901866 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c8027-82eb-40f9-bc40-8b2cca71cf5f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:48.996798 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c8027-82eb-40f9-bc40-8b2cca71cf5f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:49.030467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7beeb-138c-4214-beab-09743fb30939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:49.031130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7beeb-138c-4214-beab-09743fb30939 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:49.031405 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7beeb-138c-4214-beab-09743fb30939 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:49.031676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7beeb-138c-4214-beab-09743fb30939 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:49.032402 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7beeb-138c-4214-beab-09743fb30939 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:49.032701 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7beeb-138c-4214-beab-09743fb30939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:49.034087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7beeb-138c-4214-beab-09743fb30939 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:49.042498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 589/1181] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:17:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:49.048449 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e15fa2-b3fc-46b1-97d9-875419aa511c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:49.110522 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:49.148919 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e15fa2-b3fc-46b1-97d9-875419aa511c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:49.270361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488535ee-79c0-41e6-b433-9fe8f418acef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:49.271238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488535ee-79c0-41e6-b433-9fe8f418acef None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:49.271519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488535ee-79c0-41e6-b433-9fe8f418acef None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:49.271793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488535ee-79c0-41e6-b433-9fe8f418acef None admin] PATH_INFO: `/v3/users/d0c4b46dca484dc7bdd07f270e913b1b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:49.285743 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488535ee-79c0-41e6-b433-9fe8f418acef None admin] RBAC: Authorizing `identity:get_user(user_id=d0c4b46dca484dc7bdd07f270e913b1b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:49.287184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488535ee-79c0-41e6-b433-9fe8f418acef None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:49.288832 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 593/1182] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:17:49 2022] GET /identity/v3/users/d0c4b46dca484dc7bdd07f270e913b1b => generated 311 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:49.294715 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7beeb-138c-4214-beab-09743fb30939 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:49.311045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:49.394930 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7beeb-138c-4214-beab-09743fb30939 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:49.429612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776f0f5-932b-4e45-8a43-b6ce9ede3933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:49.430180 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776f0f5-932b-4e45-8a43-b6ce9ede3933 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:49.430460 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776f0f5-932b-4e45-8a43-b6ce9ede3933 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:49.430732 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776f0f5-932b-4e45-8a43-b6ce9ede3933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:49.497926 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776f0f5-932b-4e45-8a43-b6ce9ede3933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:49.499387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776f0f5-932b-4e45-8a43-b6ce9ede3933 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:49.514494 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:49.601688 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 590/1183] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:17:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:17:49.608534 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488535ee-79c0-41e6-b433-9fe8f418acef None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:49.723329 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488535ee-79c0-41e6-b433-9fe8f418acef None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:49.746233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:49.757129 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd41f28-2d9d-4dfe-b996-19b5b36fd69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:49.761030 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd41f28-2d9d-4dfe-b996-19b5b36fd69d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:49.761030 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd41f28-2d9d-4dfe-b996-19b5b36fd69d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:49.761030 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd41f28-2d9d-4dfe-b996-19b5b36fd69d None admin] PATH_INFO: `/v3/projects/003ab01d32d94c5fa1c8f983136b9e06` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:49.761030 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd41f28-2d9d-4dfe-b996-19b5b36fd69d None admin] RBAC: Authorizing `identity:get_project(project_id=003ab01d32d94c5fa1c8f983136b9e06)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:49.761535 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd41f28-2d9d-4dfe-b996-19b5b36fd69d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:49.763211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 594/1184] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:17:49 2022] GET /identity/v3/projects/003ab01d32d94c5fa1c8f983136b9e06 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:49.769364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776f0f5-932b-4e45-8a43-b6ce9ede3933 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:49.866592 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776f0f5-932b-4e45-8a43-b6ce9ede3933 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:49.879689 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:49.899336 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af27115-ca39-4786-833a-ca70a6018e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:49.899975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af27115-ca39-4786-833a-ca70a6018e92 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:49.900802 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af27115-ca39-4786-833a-ca70a6018e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:49.901074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af27115-ca39-4786-833a-ca70a6018e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:49.901914 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af27115-ca39-4786-833a-ca70a6018e92 None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=003ab01d32d94c5fa1c8f983136b9e06, user.id=d0c4b46dca484dc7bdd07f270e913b1b) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:49.902219 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af27115-ca39-4786-833a-ca70a6018e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:49.903636 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af27115-ca39-4786-833a-ca70a6018e92 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:49.908914 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 591/1185] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:17:49 2022] GET /identity/v3/role_assignments?user.id=d0c4b46dca484dc7bdd07f270e913b1b&scope.project.id=003ab01d32d94c5fa1c8f983136b9e06&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:52.035276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3f02e-eb9e-4395-adea-6ef04dcabd16 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:52.035807 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3f02e-eb9e-4395-adea-6ef04dcabd16 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:52.035807 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3f02e-eb9e-4395-adea-6ef04dcabd16 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:52.037109 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 595/1186] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:52.043048 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871ff43-905f-4abd-b453-a3f8a90ddf6e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:52.043457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871ff43-905f-4abd-b453-a3f8a90ddf6e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:52.043583 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871ff43-905f-4abd-b453-a3f8a90ddf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:52.060527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0871ff43-905f-4abd-b453-a3f8a90ddf6e None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:52.061760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0871ff43-905f-4abd-b453-a3f8a90ddf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:52.128080 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 592/1187] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:52.152346 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3f02e-eb9e-4395-adea-6ef04dcabd16 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:52.250912 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3f02e-eb9e-4395-adea-6ef04dcabd16 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:52.284604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70335755-9bcb-4104-8867-26c984f5b841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:52.285469 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70335755-9bcb-4104-8867-26c984f5b841 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:52.285698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70335755-9bcb-4104-8867-26c984f5b841 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:52.285971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70335755-9bcb-4104-8867-26c984f5b841 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:52.296668 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70335755-9bcb-4104-8867-26c984f5b841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:17:52.304235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-70335755-9bcb-4104-8867-26c984f5b841 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:52.304235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:52.304235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:52.304235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:52.304235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:52.304235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:52.304235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:52.304235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:52.304235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:52.304235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:52.304235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:52.304235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:52.304235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:17:52.304235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:17:52.304235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:17:52.304235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:17:52.305305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:17:52.305305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:17:52.305305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:17:52.305305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:17:52.305305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:52.305305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:52.305305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:52.305305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:52.305305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:52.305305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:52.305305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:52.305305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:52.305305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:52.305305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:52.305305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:52.305305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:52.306288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:52.306288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:52.306288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:52.306288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:52.306288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:17:52.306288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:17:52.306288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:17:52.306288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:17:52.306288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:17:52.306288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:17:52.306288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:52.306288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:17:52.306288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 596/1188] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:17:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:52.312670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871ff43-905f-4abd-b453-a3f8a90ddf6e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:52.411383 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871ff43-905f-4abd-b453-a3f8a90ddf6e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:52.420810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:52.445084 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bfe95-8ffa-44c8-a49b-6b670308d51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:52.445780 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bfe95-8ffa-44c8-a49b-6b670308d51b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:52.446063 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bfe95-8ffa-44c8-a49b-6b670308d51b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:52.446338 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bfe95-8ffa-44c8-a49b-6b670308d51b None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:52.447868 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bfe95-8ffa-44c8-a49b-6b670308d51b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:52.448281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bfe95-8ffa-44c8-a49b-6b670308d51b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:52.449697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bfe95-8ffa-44c8-a49b-6b670308d51b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:52.458009 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 593/1189] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:17:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:52.464298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70335755-9bcb-4104-8867-26c984f5b841 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:52.513964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:52.563594 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70335755-9bcb-4104-8867-26c984f5b841 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:52.596476 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd727ac8-2220-4e01-bafd-eb7ee8c6d23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:52.597367 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd727ac8-2220-4e01-bafd-eb7ee8c6d23e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:52.597649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd727ac8-2220-4e01-bafd-eb7ee8c6d23e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:52.597921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd727ac8-2220-4e01-bafd-eb7ee8c6d23e None admin] PATH_INFO: `/v3/users/d0c4b46dca484dc7bdd07f270e913b1b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:52.599080 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd727ac8-2220-4e01-bafd-eb7ee8c6d23e None admin] RBAC: Authorizing `identity:get_user(user_id=d0c4b46dca484dc7bdd07f270e913b1b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:52.600500 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd727ac8-2220-4e01-bafd-eb7ee8c6d23e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:52.602132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 597/1190] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:17:52 2022] GET /identity/v3/users/d0c4b46dca484dc7bdd07f270e913b1b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:52.608683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bfe95-8ffa-44c8-a49b-6b670308d51b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:52.712255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bfe95-8ffa-44c8-a49b-6b670308d51b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:52.746838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f603c7e-f530-4713-94eb-6332951787f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:52.747697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f603c7e-f530-4713-94eb-6332951787f2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:52.747972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f603c7e-f530-4713-94eb-6332951787f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:52.748251 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f603c7e-f530-4713-94eb-6332951787f2 None admin] PATH_INFO: `/v3/projects/003ab01d32d94c5fa1c8f983136b9e06` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:52.749443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f603c7e-f530-4713-94eb-6332951787f2 None admin] RBAC: Authorizing `identity:get_project(project_id=003ab01d32d94c5fa1c8f983136b9e06)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:52.750879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f603c7e-f530-4713-94eb-6332951787f2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:52.752578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 594/1191] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:17:52 2022] GET /identity/v3/projects/003ab01d32d94c5fa1c8f983136b9e06 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:52.758493 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd727ac8-2220-4e01-bafd-eb7ee8c6d23e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:52.856489 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd727ac8-2220-4e01-bafd-eb7ee8c6d23e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:52.872400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:52.889220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850389d-2a7a-4c4e-937e-1ff7ec2ef733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:52.890137 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850389d-2a7a-4c4e-937e-1ff7ec2ef733 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:52.890412 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850389d-2a7a-4c4e-937e-1ff7ec2ef733 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:52.890683 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850389d-2a7a-4c4e-937e-1ff7ec2ef733 None admin] PATH_INFO: `/v3/projects/003ab01d32d94c5fa1c8f983136b9e06/users/d0c4b46dca484dc7bdd07f270e913b1b/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:52.892606 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850389d-2a7a-4c4e-937e-1ff7ec2ef733 None admin] RBAC: Authorizing `identity:create_grant(project_id=003ab01d32d94c5fa1c8f983136b9e06, user_id=d0c4b46dca484dc7bdd07f270e913b1b, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:52.901653 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850389d-2a7a-4c4e-937e-1ff7ec2ef733 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:52.979466 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 598/1192] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:17:52 2022] PUT /identity/v3/projects/003ab01d32d94c5fa1c8f983136b9e06/users/d0c4b46dca484dc7bdd07f270e913b1b/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:17:55.068933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce0a8c-aee6-4436-972d-c27e530a9929 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:55.069472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce0a8c-aee6-4436-972d-c27e530a9929 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:55.069472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce0a8c-aee6-4436-972d-c27e530a9929 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:55.070786 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 595/1193] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:55.076755 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ac938-5710-403e-8e7d-00e5f4547487 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:55.077151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ac938-5710-403e-8e7d-00e5f4547487 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:55.077302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ac938-5710-403e-8e7d-00e5f4547487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:55.094395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3a8ac938-5710-403e-8e7d-00e5f4547487 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:55.095582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3a8ac938-5710-403e-8e7d-00e5f4547487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:55.160295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 599/1194] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:55.184732 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce0a8c-aee6-4436-972d-c27e530a9929 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:55.224811 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:55.284102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce0a8c-aee6-4436-972d-c27e530a9929 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:55.317622 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f762d7-84e8-4218-82cd-622387c9a470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:55.318394 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f762d7-84e8-4218-82cd-622387c9a470 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:55.318668 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f762d7-84e8-4218-82cd-622387c9a470 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:55.318984 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f762d7-84e8-4218-82cd-622387c9a470 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:55.328991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f762d7-84e8-4218-82cd-622387c9a470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:17:55.336550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-73f762d7-84e8-4218-82cd-622387c9a470 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:55.336550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:55.336550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:55.336550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:55.336550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:55.336550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:55.336550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:55.336550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:55.336550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:55.336550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:55.336550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:55.336550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:55.336550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:17:55.336550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:17:55.336550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:17:55.336550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:17:55.337931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:17:55.337931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:17:55.337931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:17:55.337931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:17:55.337931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:55.337931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:55.337931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:55.337931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:55.337931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:55.337931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:55.337931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:55.337931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:55.337931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:55.337931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:55.337931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:55.337931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:55.339127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:55.339127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:55.339127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:55.339127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:55.339127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:17:55.339127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:17:55.339127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:17:55.339127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:17:55.339127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:17:55.339127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:17:55.339127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:55.339127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:17:55.339127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 596/1195] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:17:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:55.343889 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ac938-5710-403e-8e7d-00e5f4547487 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:55.443306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ac938-5710-403e-8e7d-00e5f4547487 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:55.453798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:55.479510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ba4d-bcf8-45d9-8d5d-364e0a3953f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:55.480180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ba4d-bcf8-45d9-8d5d-364e0a3953f3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:55.480460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ba4d-bcf8-45d9-8d5d-364e0a3953f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:55.480734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ba4d-bcf8-45d9-8d5d-364e0a3953f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:55.481562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814ba4d-bcf8-45d9-8d5d-364e0a3953f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:55.481877 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814ba4d-bcf8-45d9-8d5d-364e0a3953f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:55.483245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814ba4d-bcf8-45d9-8d5d-364e0a3953f3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:55.491188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 600/1196] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:17:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:55.497463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f762d7-84e8-4218-82cd-622387c9a470 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:55.594825 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:55.598516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f762d7-84e8-4218-82cd-622387c9a470 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:55.631217 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbae553-8591-40ca-b4c8-8b335e212099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:55.632250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbae553-8591-40ca-b4c8-8b335e212099 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:55.632568 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbae553-8591-40ca-b4c8-8b335e212099 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:55.632969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbae553-8591-40ca-b4c8-8b335e212099 None admin] PATH_INFO: `/v3/users/d0c4b46dca484dc7bdd07f270e913b1b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:55.634710 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbae553-8591-40ca-b4c8-8b335e212099 None admin] RBAC: Authorizing `identity:get_user(user_id=d0c4b46dca484dc7bdd07f270e913b1b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:55.636246 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbae553-8591-40ca-b4c8-8b335e212099 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:55.637885 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 597/1197] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Jun 17 07:17:55 2022] GET /identity/v3/users/d0c4b46dca484dc7bdd07f270e913b1b => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:55.643600 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ba4d-bcf8-45d9-8d5d-364e0a3953f3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:55.744684 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ba4d-bcf8-45d9-8d5d-364e0a3953f3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:55.778127 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464ecbe-d02e-4ec5-8e47-cdfdedf6d638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:55.778773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464ecbe-d02e-4ec5-8e47-cdfdedf6d638 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:55.779056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464ecbe-d02e-4ec5-8e47-cdfdedf6d638 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:55.779333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464ecbe-d02e-4ec5-8e47-cdfdedf6d638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:55.818230 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:55.846836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464ecbe-d02e-4ec5-8e47-cdfdedf6d638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:55.848217 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464ecbe-d02e-4ec5-8e47-cdfdedf6d638 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:55.943503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 601/1198] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:17:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:17:55.950025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbae553-8591-40ca-b4c8-8b335e212099 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:56.046277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbae553-8591-40ca-b4c8-8b335e212099 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:56.091629 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc505374-59af-4fed-ad6a-20cc78a877b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:56.092711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc505374-59af-4fed-ad6a-20cc78a877b1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:56.092986 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc505374-59af-4fed-ad6a-20cc78a877b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:56.093258 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc505374-59af-4fed-ad6a-20cc78a877b1 None admin] PATH_INFO: `/v3/projects/003ab01d32d94c5fa1c8f983136b9e06` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:56.094471 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc505374-59af-4fed-ad6a-20cc78a877b1 None admin] RBAC: Authorizing `identity:get_project(project_id=003ab01d32d94c5fa1c8f983136b9e06)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:56.095904 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc505374-59af-4fed-ad6a-20cc78a877b1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:56.097683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 598/1199] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Jun 17 07:17:55 2022] GET /identity/v3/projects/003ab01d32d94c5fa1c8f983136b9e06 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:56.104205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464ecbe-d02e-4ec5-8e47-cdfdedf6d638 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:56.171948 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:56.203066 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464ecbe-d02e-4ec5-8e47-cdfdedf6d638 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:56.235028 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d218e-6397-427a-bb25-bab341e5ba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:56.235674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d218e-6397-427a-bb25-bab341e5ba73 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:56.235955 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d218e-6397-427a-bb25-bab341e5ba73 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:56.236231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d218e-6397-427a-bb25-bab341e5ba73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:56.237052 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d218e-6397-427a-bb25-bab341e5ba73 None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=003ab01d32d94c5fa1c8f983136b9e06, user.id=d0c4b46dca484dc7bdd07f270e913b1b) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:56.237382 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d218e-6397-427a-bb25-bab341e5ba73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:56.238811 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d218e-6397-427a-bb25-bab341e5ba73 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:56.245007 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 602/1200] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:17:56 2022] GET /identity/v3/role_assignments?user.id=d0c4b46dca484dc7bdd07f270e913b1b&scope.project.id=003ab01d32d94c5fa1c8f983136b9e06&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:18:06.083897 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=83 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:18:06.241883 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=33 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:11.346701 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7eac49-bad3-42b1-9c07-2ae557c10bf0 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:11.347303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7eac49-bad3-42b1-9c07-2ae557c10bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:11.347303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7eac49-bad3-42b1-9c07-2ae557c10bf0 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:11.348636 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 599/1201] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:11.354614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378a539-457c-489d-9a11-2261722208df None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:11.360127 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378a539-457c-489d-9a11-2261722208df None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:11.360127 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378a539-457c-489d-9a11-2261722208df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:11.373833 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f378a539-457c-489d-9a11-2261722208df None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:11.375028 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f378a539-457c-489d-9a11-2261722208df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:11.441733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 603/1202] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:19:11.466714 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7eac49-bad3-42b1-9c07-2ae557c10bf0 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:11.572135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7eac49-bad3-42b1-9c07-2ae557c10bf0 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:11.607556 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68970c28-d356-46ee-b971-1ae3250daea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:11.608295 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68970c28-d356-46ee-b971-1ae3250daea3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:11.608574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68970c28-d356-46ee-b971-1ae3250daea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:11.608841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68970c28-d356-46ee-b971-1ae3250daea3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:11.624186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68970c28-d356-46ee-b971-1ae3250daea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:11.624186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68970c28-d356-46ee-b971-1ae3250daea3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:11.638832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-68970c28-d356-46ee-b971-1ae3250daea3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:11.638832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:11.638832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:11.638832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:11.638832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:11.638832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:11.638832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:11.638832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:11.638832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:11.638832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:11.638832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:11.638832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:11.638832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:19:11.638832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:19:11.638832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:19:11.640138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:19:11.640138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:11.640138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:11.640138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:11.640138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:11.640138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:11.640138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:11.640138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:11.640138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:11.640138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:11.640138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:11.640138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:11.640138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:11.640138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:11.640138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:11.640138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:11.640138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:11.641543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:19:11.641543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:19:11.641543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:11.641543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:19:11.641543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 600/1203] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:11.646179 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378a539-457c-489d-9a11-2261722208df None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:11.750692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378a539-457c-489d-9a11-2261722208df None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:11.780090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:11.786345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e7c65-7390-4f5e-9616-55c0c9f5b5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:11.787041 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e7c65-7390-4f5e-9616-55c0c9f5b5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:11.787326 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e7c65-7390-4f5e-9616-55c0c9f5b5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:11.787600 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e7c65-7390-4f5e-9616-55c0c9f5b5c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:11.788322 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e7c65-7390-4f5e-9616-55c0c9f5b5c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:11.788630 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e7c65-7390-4f5e-9616-55c0c9f5b5c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:11.790027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e7c65-7390-4f5e-9616-55c0c9f5b5c6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:11.804039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 604/1204] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:11.810108 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68970c28-d356-46ee-b971-1ae3250daea3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:11.864063 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:11.911269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68970c28-d356-46ee-b971-1ae3250daea3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:11.944712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75ab8f-7dab-4751-ae25-a7a0f2f0e850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:11.945392 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75ab8f-7dab-4751-ae25-a7a0f2f0e850 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:11.945673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75ab8f-7dab-4751-ae25-a7a0f2f0e850 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:11.946072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75ab8f-7dab-4751-ae25-a7a0f2f0e850 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:11.947353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75ab8f-7dab-4751-ae25-a7a0f2f0e850 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:11.949011 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75ab8f-7dab-4751-ae25-a7a0f2f0e850 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:12.061345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 601/1205] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Jun 17 07:19:11 2022] POST /identity/v3/users => generated 251 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:19:14.296836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d845f3-7356-4da2-8912-f290c046c090 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:14.297394 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d845f3-7356-4da2-8912-f290c046c090 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:14.297394 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d845f3-7356-4da2-8912-f290c046c090 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:14.298786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 605/1206] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:14.304023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9de0bd-3043-4d6f-96e4-753daba44e34 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:14.304468 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9de0bd-3043-4d6f-96e4-753daba44e34 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:14.304618 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9de0bd-3043-4d6f-96e4-753daba44e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:14.322376 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-aa9de0bd-3043-4d6f-96e4-753daba44e34 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:14.323587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-aa9de0bd-3043-4d6f-96e4-753daba44e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:14.391730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 602/1207] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:19:14.417195 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d845f3-7356-4da2-8912-f290c046c090 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:14.525109 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d845f3-7356-4da2-8912-f290c046c090 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:14.560250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b522663-605f-4d2c-942e-be01c2ce310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:14.560974 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b522663-605f-4d2c-942e-be01c2ce310f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:14.561288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b522663-605f-4d2c-942e-be01c2ce310f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:14.561666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b522663-605f-4d2c-942e-be01c2ce310f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:14.572335 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b522663-605f-4d2c-942e-be01c2ce310f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:19:14.580238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-1b522663-605f-4d2c-942e-be01c2ce310f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:19:14.580238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:14.580238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:14.580238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:14.580238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:14.580238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:14.580238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:14.580238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:14.580238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:14.580238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:14.580238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:14.580238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:14.580238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:19:14.580238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:19:14.580238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:19:14.580238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:19:14.588198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:19:14.588198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:19:14.588198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:19:14.588198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:19:14.588198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:14.588198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:14.588198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:14.588198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:14.588198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:14.588198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:14.588198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:14.588198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:14.588198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:14.588198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:14.588198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:14.588198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:14.589736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:14.589736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:14.589736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:14.589736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:14.589736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:19:14.589736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:19:14.589736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:19:14.589736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:19:14.589736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:19:14.589736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:19:14.589736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:19:14.589736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:14.589736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 606/1208] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:19:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:14.590757 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9de0bd-3043-4d6f-96e4-753daba44e34 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:14.630919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:14.694767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9de0bd-3043-4d6f-96e4-753daba44e34 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:14.730440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc94cfc-c9bd-490c-a517-ae1faf13b8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:14.731118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc94cfc-c9bd-490c-a517-ae1faf13b8ec None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:14.731399 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc94cfc-c9bd-490c-a517-ae1faf13b8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:14.731675 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc94cfc-c9bd-490c-a517-ae1faf13b8ec None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:14.732418 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc94cfc-c9bd-490c-a517-ae1faf13b8ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:14.732723 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc94cfc-c9bd-490c-a517-ae1faf13b8ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:14.734148 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc94cfc-c9bd-490c-a517-ae1faf13b8ec None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:14.742453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 603/1209] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:19:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:14.748381 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b522663-605f-4d2c-942e-be01c2ce310f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:14.801078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:14.854218 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b522663-605f-4d2c-942e-be01c2ce310f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:14.888283 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6294c-3c5c-4c34-872e-8e90bf9798f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:14.889089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6294c-3c5c-4c34-872e-8e90bf9798f6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:14.889401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6294c-3c5c-4c34-872e-8e90bf9798f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:14.889677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6294c-3c5c-4c34-872e-8e90bf9798f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:14.901020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6294c-3c5c-4c34-872e-8e90bf9798f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:14.902600 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6294c-3c5c-4c34-872e-8e90bf9798f6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:14.920125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8db6294c-3c5c-4c34-872e-8e90bf9798f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:14.920125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:14.920125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:14.920125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:14.920125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:14.920125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:14.920125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:14.920125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:14.920125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:14.920125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:14.920125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:14.920125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:14.920125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:19:14.920125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:19:14.920125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:19:14.921267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:19:14.921267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:14.921267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:14.921267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:14.921267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:14.921267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:14.921267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:14.921267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:14.921267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:14.921267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:14.921267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:14.921267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:14.921267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:14.921267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:14.921267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:14.921267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:14.921267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:14.922303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:19:14.922303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:19:14.922303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:14.922303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:14.922303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 607/1210] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:14.927325 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc94cfc-c9bd-490c-a517-ae1faf13b8ec None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:15.025465 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:15.028517 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc94cfc-c9bd-490c-a517-ae1faf13b8ec None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:15.065372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50eb2d4-14b5-45dc-bda4-503ea81c1a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:15.066031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50eb2d4-14b5-45dc-bda4-503ea81c1a25 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:15.066315 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50eb2d4-14b5-45dc-bda4-503ea81c1a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:15.066576 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50eb2d4-14b5-45dc-bda4-503ea81c1a25 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:15.067291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50eb2d4-14b5-45dc-bda4-503ea81c1a25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:15.067591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50eb2d4-14b5-45dc-bda4-503ea81c1a25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:15.069003 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50eb2d4-14b5-45dc-bda4-503ea81c1a25 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:15.080836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 604/1211] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:15.096962 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6294c-3c5c-4c34-872e-8e90bf9798f6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:15.188794 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6294c-3c5c-4c34-872e-8e90bf9798f6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:15.190302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:15.223911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532767e-9920-446a-83b2-67d036f407db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:15.225002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532767e-9920-446a-83b2-67d036f407db None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:15.225002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532767e-9920-446a-83b2-67d036f407db None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:15.225242 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532767e-9920-446a-83b2-67d036f407db None admin] PATH_INFO: `/v3/users/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:15.233538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532767e-9920-446a-83b2-67d036f407db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:15.235009 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532767e-9920-446a-83b2-67d036f407db None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:15.250510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8532767e-9920-446a-83b2-67d036f407db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:19:15.250510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:15.250510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:15.250510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:15.250510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:15.250510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:15.250510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:15.250510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:15.250510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:15.250510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:15.250510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:15.250510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:15.250510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:19:15.250510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:19:15.250510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:19:15.250510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:15.251681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:15.253039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:15.253039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:15.253039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:19:15.253039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:19:15.253039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:19:15.253039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:19:15.253039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:19:15.253039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:19:15.253039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:19:15.253039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:15.253039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 608/1212] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:15.258080 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50eb2d4-14b5-45dc-bda4-503ea81c1a25 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:15.362798 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50eb2d4-14b5-45dc-bda4-503ea81c1a25 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:15.397800 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461011cd-2fce-4a3f-ab45-90fa1e18fc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:15.398528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461011cd-2fce-4a3f-ab45-90fa1e18fc5e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:15.398796 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461011cd-2fce-4a3f-ab45-90fa1e18fc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:15.399070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461011cd-2fce-4a3f-ab45-90fa1e18fc5e None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:15.400327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461011cd-2fce-4a3f-ab45-90fa1e18fc5e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:15.400647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461011cd-2fce-4a3f-ab45-90fa1e18fc5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:15.402113 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461011cd-2fce-4a3f-ab45-90fa1e18fc5e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:15.420121 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 605/1213] 10.222.0.52 () {56 vars in 1143 bytes} [Fri Jun 17 07:19:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:15.426059 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532767e-9920-446a-83b2-67d036f407db None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:15.530615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532767e-9920-446a-83b2-67d036f407db None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:15.565170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707176b-36a9-442d-b64f-23e371e24d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:15.565853 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707176b-36a9-442d-b64f-23e371e24d28 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:15.566131 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707176b-36a9-442d-b64f-23e371e24d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:15.566400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707176b-36a9-442d-b64f-23e371e24d28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:15.595907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:15.643173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707176b-36a9-442d-b64f-23e371e24d28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:15.644668 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707176b-36a9-442d-b64f-23e371e24d28 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:15.746955 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 609/1214] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:19:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:19:15.752907 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461011cd-2fce-4a3f-ab45-90fa1e18fc5e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:15.771866 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:15.852456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461011cd-2fce-4a3f-ab45-90fa1e18fc5e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:15.887737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dce1c-71c7-4158-99c5-184f71410742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:15.888543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dce1c-71c7-4158-99c5-184f71410742 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:15.888823 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dce1c-71c7-4158-99c5-184f71410742 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:15.889111 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dce1c-71c7-4158-99c5-184f71410742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:15.899515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dce1c-71c7-4158-99c5-184f71410742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:15.901001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dce1c-71c7-4158-99c5-184f71410742 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:15.919481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-326dce1c-71c7-4158-99c5-184f71410742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:15.919481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:15.919481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:15.919481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:15.919481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:15.919481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:15.919481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:15.919481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:15.919481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:15.919481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:15.919481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:15.919481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:15.919481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:19:15.919481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:19:15.919481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:19:15.920516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:19:15.920516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:15.920516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:15.920516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:15.920516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:15.920516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:15.920516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:15.920516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:15.920516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:15.920516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:15.920516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:15.920516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:15.920516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:15.920516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:15.920516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:15.920516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:15.920516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:15.921456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:19:15.921456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:19:15.921456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:15.921456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:19:15.921456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 606/1215] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:15.926548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707176b-36a9-442d-b64f-23e371e24d28 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:15.989108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:16.028042 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707176b-36a9-442d-b64f-23e371e24d28 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:16.062897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1dc61e-e56f-45c9-8c2c-03cfc3d3d3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:16.063563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dc61e-e56f-45c9-8c2c-03cfc3d3d3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:16.063883 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dc61e-e56f-45c9-8c2c-03cfc3d3d3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:16.064158 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dc61e-e56f-45c9-8c2c-03cfc3d3d3c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:16.064865 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1dc61e-e56f-45c9-8c2c-03cfc3d3d3c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:16.065195 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1dc61e-e56f-45c9-8c2c-03cfc3d3d3c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:16.067040 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1dc61e-e56f-45c9-8c2c-03cfc3d3d3c2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:16.080020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 610/1216] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:16.085741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dce1c-71c7-4158-99c5-184f71410742 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:16.161227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:16.191997 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dce1c-71c7-4158-99c5-184f71410742 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:16.227908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b0f2f-0e54-4e4d-9ceb-b50aa30e63dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:16.229007 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b0f2f-0e54-4e4d-9ceb-b50aa30e63dd None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:16.229288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b0f2f-0e54-4e4d-9ceb-b50aa30e63dd None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:16.229593 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b0f2f-0e54-4e4d-9ceb-b50aa30e63dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:16.236388 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b0f2f-0e54-4e4d-9ceb-b50aa30e63dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:16.237876 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b0f2f-0e54-4e4d-9ceb-b50aa30e63dd None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:16.252126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-748b0f2f-0e54-4e4d-9ceb-b50aa30e63dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:19:16.252126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:16.252126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:16.252126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:16.252126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:16.252126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:16.252126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:16.252126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:16.252126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:16.252126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:16.252126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:16.252126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:16.252126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:19:16.252126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:19:16.252126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:19:16.253220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:19:16.253220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:16.253220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:16.253220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:16.253220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:16.253220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:16.253220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:16.253220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:16.253220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:16.253220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:16.253220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:16.253220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:16.253220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:16.253220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:16.253220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:16.253220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:16.253220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:16.254351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:19:16.254351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:19:16.254351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:19:16.254351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:19:16.254351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:19:16.254351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:19:16.254351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:19:16.254351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:19:16.254351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 607/1217] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:19:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:16.260434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1dc61e-e56f-45c9-8c2c-03cfc3d3d3c2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:16.360822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1dc61e-e56f-45c9-8c2c-03cfc3d3d3c2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:16.384635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:16.395958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc6e84-8d98-488c-8be6-72e6d2f43022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:16.396620 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc6e84-8d98-488c-8be6-72e6d2f43022 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:16.396900 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc6e84-8d98-488c-8be6-72e6d2f43022 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:16.397180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc6e84-8d98-488c-8be6-72e6d2f43022 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:16.397991 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc6e84-8d98-488c-8be6-72e6d2f43022 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:16.398296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc6e84-8d98-488c-8be6-72e6d2f43022 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:16.399908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc6e84-8d98-488c-8be6-72e6d2f43022 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:16.411857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 611/1218] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:19:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:16.418344 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b0f2f-0e54-4e4d-9ceb-b50aa30e63dd None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:16.519031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b0f2f-0e54-4e4d-9ceb-b50aa30e63dd None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:16.549177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:16.555081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd09e6-eb28-476d-b882-6af0614a5462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:16.555876 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd09e6-eb28-476d-b882-6af0614a5462 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:16.556667 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd09e6-eb28-476d-b882-6af0614a5462 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:16.556950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd09e6-eb28-476d-b882-6af0614a5462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:16.557792 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd09e6-eb28-476d-b882-6af0614a5462 None admin] RBAC: Adding query filter params (role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=71adc8b93e5c41929b928002e004df6e) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:16.558100 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd09e6-eb28-476d-b882-6af0614a5462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:16.559532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd09e6-eb28-476d-b882-6af0614a5462 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:16.565150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 608/1219] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:19:16 2022] GET /identity/v3/role_assignments?user.id=71adc8b93e5c41929b928002e004df6e&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:18.706749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b5bab-af0f-49f7-a92a-bf52b09df3be None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:18.707265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b5bab-af0f-49f7-a92a-bf52b09df3be None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:18.707352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b5bab-af0f-49f7-a92a-bf52b09df3be None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:18.708708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 612/1220] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:18.714774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af4a08-de29-4811-a7cb-a3647737283c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:18.717222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af4a08-de29-4811-a7cb-a3647737283c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:18.717222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af4a08-de29-4811-a7cb-a3647737283c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:18.733003 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-19af4a08-de29-4811-a7cb-a3647737283c None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:18.734228 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-19af4a08-de29-4811-a7cb-a3647737283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:18.802521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 609/1221] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:19:18.826800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b5bab-af0f-49f7-a92a-bf52b09df3be None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:18.933151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b5bab-af0f-49f7-a92a-bf52b09df3be None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:18.967098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb9a0b-3acb-412b-b963-b5856a02ec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:18.967898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb9a0b-3acb-412b-b963-b5856a02ec37 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:18.968226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb9a0b-3acb-412b-b963-b5856a02ec37 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:18.968496 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb9a0b-3acb-412b-b963-b5856a02ec37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:18.979385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb9a0b-3acb-412b-b963-b5856a02ec37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:19:18.987063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-47eb9a0b-3acb-412b-b963-b5856a02ec37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:19:18.987063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:18.987063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:18.987063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:18.987063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:18.987063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:18.987063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:18.987063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:18.987063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:18.987063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:18.987063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:18.987063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:18.987063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:19:18.987063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:19:18.987063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:19:18.987063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:19:18.988215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:19:18.988215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:19:18.988215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:19:18.988215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:19:18.988215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:18.988215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:18.988215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:18.988215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:18.988215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:18.988215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:18.988215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:18.988215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:18.988215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:18.988215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:18.988215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:18.988215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:18.989260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:18.989260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:18.989260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:18.989260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:18.989260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:19:18.989260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:19:18.989260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:19:18.989260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:19:18.989260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:19:18.989260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:19:18.989260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:19:18.989260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:18.989260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 613/1222] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:19:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:18.994766 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af4a08-de29-4811-a7cb-a3647737283c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:19.093100 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af4a08-de29-4811-a7cb-a3647737283c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:19.118088 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:19.129228 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0429c01-400a-4242-9f77-9ba9e24e6954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:19.129946 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429c01-400a-4242-9f77-9ba9e24e6954 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:19.130214 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429c01-400a-4242-9f77-9ba9e24e6954 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:19.130488 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429c01-400a-4242-9f77-9ba9e24e6954 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:19.131504 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0429c01-400a-4242-9f77-9ba9e24e6954 None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:19.131807 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0429c01-400a-4242-9f77-9ba9e24e6954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:19.133196 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0429c01-400a-4242-9f77-9ba9e24e6954 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:19.141850 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 610/1223] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:19:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:19:19.147595 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb9a0b-3acb-412b-b963-b5856a02ec37 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:19.193853 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:19.249186 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb9a0b-3acb-412b-b963-b5856a02ec37 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:19.283012 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d67593-6790-4a5a-922d-30634fc3e27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:19.283803 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d67593-6790-4a5a-922d-30634fc3e27e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:19.284083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d67593-6790-4a5a-922d-30634fc3e27e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:19.284358 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d67593-6790-4a5a-922d-30634fc3e27e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:19.295670 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d67593-6790-4a5a-922d-30634fc3e27e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:19.297144 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d67593-6790-4a5a-922d-30634fc3e27e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:19.314192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-20d67593-6790-4a5a-922d-30634fc3e27e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:19.314192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:19.314192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:19.314192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:19.314192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:19.314192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:19.314192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:19.314192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:19.314192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:19.314192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:19.314192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:19.314192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:19.314192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:19:19.314192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:19:19.314192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:19:19.315307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:19:19.315307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:19.315307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:19.315307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:19.315307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:19.315307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:19.315307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:19.315307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:19.315307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:19.315307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:19.315307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:19.315307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:19.315307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:19.315307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:19.315307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:19.315307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:19.315307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:19.316424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:19:19.316424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:19:19.316424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:19.316424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:19.316424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 614/1224] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:19.321357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0429c01-400a-4242-9f77-9ba9e24e6954 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:19.421941 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0429c01-400a-4242-9f77-9ba9e24e6954 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:19.456592 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe9a23-0e75-4262-89ec-81b3f7a82044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:19.457188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe9a23-0e75-4262-89ec-81b3f7a82044 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:19.457505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe9a23-0e75-4262-89ec-81b3f7a82044 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:19.457786 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe9a23-0e75-4262-89ec-81b3f7a82044 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:19.458511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe9a23-0e75-4262-89ec-81b3f7a82044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:19.458821 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe9a23-0e75-4262-89ec-81b3f7a82044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:19.460198 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe9a23-0e75-4262-89ec-81b3f7a82044 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:19.473013 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 611/1225] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:19.478915 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d67593-6790-4a5a-922d-30634fc3e27e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:19.575072 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:19.581620 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d67593-6790-4a5a-922d-30634fc3e27e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:19.615238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03975f87-cd1c-4096-8404-45b5fc2af097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:19.616041 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03975f87-cd1c-4096-8404-45b5fc2af097 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:19.616315 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03975f87-cd1c-4096-8404-45b5fc2af097 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:19.616582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03975f87-cd1c-4096-8404-45b5fc2af097 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:19.624251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03975f87-cd1c-4096-8404-45b5fc2af097 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:19.625718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03975f87-cd1c-4096-8404-45b5fc2af097 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:19.641220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-03975f87-cd1c-4096-8404-45b5fc2af097 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:19:19.641220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:19.641220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:19.641220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:19.641220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:19.641220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:19.641220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:19.641220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:19.641220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:19.641220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:19.641220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:19.641220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:19.641220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:19:19.641220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:19:19.641220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:19:19.641220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:19.647560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:19.648672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:19.648672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:19.648672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:19:19.648672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:19:19.648672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:19:19.648672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:19:19.648672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:19:19.648672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:19:19.648672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:19:19.648672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:19.648672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 615/1226] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:19.650038 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe9a23-0e75-4262-89ec-81b3f7a82044 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:19.700026 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:19.753916 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe9a23-0e75-4262-89ec-81b3f7a82044 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:19.788295 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12f702-2382-42da-8a4f-afcff0b6586f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:19.788958 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12f702-2382-42da-8a4f-afcff0b6586f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:19.789236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12f702-2382-42da-8a4f-afcff0b6586f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:19.789538 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12f702-2382-42da-8a4f-afcff0b6586f None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:19.795129 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12f702-2382-42da-8a4f-afcff0b6586f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:19.795129 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12f702-2382-42da-8a4f-afcff0b6586f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:19.795129 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12f702-2382-42da-8a4f-afcff0b6586f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:19.810806 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 612/1227] 10.222.0.52 () {56 vars in 1143 bytes} [Fri Jun 17 07:19:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:19.816791 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03975f87-cd1c-4096-8404-45b5fc2af097 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:19.916786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03975f87-cd1c-4096-8404-45b5fc2af097 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:19.951479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd7211-a21a-41eb-9928-5db8bd42c29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:19.952275 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd7211-a21a-41eb-9928-5db8bd42c29b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:19.952551 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd7211-a21a-41eb-9928-5db8bd42c29b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:19.952822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd7211-a21a-41eb-9928-5db8bd42c29b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:19.962882 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd7211-a21a-41eb-9928-5db8bd42c29b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:19.966156 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd7211-a21a-41eb-9928-5db8bd42c29b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:19.981547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c5fd7211-a21a-41eb-9928-5db8bd42c29b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:19.981547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:19.981547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:19.981547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:19.981547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:19.981547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:19.981547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:19.981547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:19.981547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:19.981547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:19.981547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:19.981547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:19.981547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:19:19.981547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:19:19.981547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:19:19.982539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:19:19.982539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:19.982539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:19.982539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:19.982539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:19.982539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:19.982539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:19.982539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:19.982539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:19.982539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:19.982539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:19.982539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:19.982539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:19.982539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:19.982539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:19.982539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:19.982539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:19.983906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:19:19.983906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:19:19.983906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:19.983906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:19.983906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 616/1228] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:19.988572 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12f702-2382-42da-8a4f-afcff0b6586f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:20.092871 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12f702-2382-42da-8a4f-afcff0b6586f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:20.095304 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:20.127372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d8db8-8525-4e8e-9e4e-5694046bc0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:20.128033 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d8db8-8525-4e8e-9e4e-5694046bc0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:20.128311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d8db8-8525-4e8e-9e4e-5694046bc0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:20.128578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d8db8-8525-4e8e-9e4e-5694046bc0c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:20.129293 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d8db8-8525-4e8e-9e4e-5694046bc0c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:20.129636 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d8db8-8525-4e8e-9e4e-5694046bc0c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:20.131268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d8db8-8525-4e8e-9e4e-5694046bc0c7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:20.142817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 613/1229] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:20.148551 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd7211-a21a-41eb-9928-5db8bd42c29b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:20.157657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:20.277974 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd7211-a21a-41eb-9928-5db8bd42c29b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:20.335893 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87e0b6-208b-46e2-a157-b8c4dd65d245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:20.337464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87e0b6-208b-46e2-a157-b8c4dd65d245 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:20.337963 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87e0b6-208b-46e2-a157-b8c4dd65d245 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:20.338435 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87e0b6-208b-46e2-a157-b8c4dd65d245 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:20.347314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87e0b6-208b-46e2-a157-b8c4dd65d245 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:20.348708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87e0b6-208b-46e2-a157-b8c4dd65d245 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:20.365128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ea87e0b6-208b-46e2-a157-b8c4dd65d245 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:19:20.365128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:20.365128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:20.365128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:20.365128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:20.365128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:20.365128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:20.365128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:20.365128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:20.365128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:20.365128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:20.365128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:20.365128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:19:20.365128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:19:20.365128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:19:20.370247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:19:20.370247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:20.370247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:20.370247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:20.370247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:20.370247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:20.370247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:20.370247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:20.370247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:20.370247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:20.370247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:20.370247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:20.370247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:20.370247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:20.370247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:20.370247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:20.370247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:20.371263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:19:20.371263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:19:20.371263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:19:20.371263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:19:20.371263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:19:20.371263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:19:20.371263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:19:20.371263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:20.371263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 617/1230] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:19:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:20.373403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d8db8-8525-4e8e-9e4e-5694046bc0c7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:20.487072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d8db8-8525-4e8e-9e4e-5694046bc0c7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:20.519903 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44129bca-fad1-4f48-b6bf-e09cbf45a872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:20.520560 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44129bca-fad1-4f48-b6bf-e09cbf45a872 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:20.520837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44129bca-fad1-4f48-b6bf-e09cbf45a872 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:20.521111 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44129bca-fad1-4f48-b6bf-e09cbf45a872 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:20.524080 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44129bca-fad1-4f48-b6bf-e09cbf45a872 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:20.524080 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44129bca-fad1-4f48-b6bf-e09cbf45a872 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:20.524080 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44129bca-fad1-4f48-b6bf-e09cbf45a872 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:20.535971 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 614/1231] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:19:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:20.545475 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87e0b6-208b-46e2-a157-b8c4dd65d245 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:20.617883 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:20.654971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87e0b6-208b-46e2-a157-b8c4dd65d245 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:20.689894 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d18efd-f552-4816-91e0-29c8eb12def5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:20.690770 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d18efd-f552-4816-91e0-29c8eb12def5 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:20.691252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d18efd-f552-4816-91e0-29c8eb12def5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:20.691688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d18efd-f552-4816-91e0-29c8eb12def5 None admin] PATH_INFO: `/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/71adc8b93e5c41929b928002e004df6e/roles/b2b4f9b1ccfc4e63b260aa4d8c230bf6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:20.707081 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d18efd-f552-4816-91e0-29c8eb12def5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dffdba97abf4f59b12c4fbdc6245e9e, user_id=71adc8b93e5c41929b928002e004df6e, role_id=b2b4f9b1ccfc4e63b260aa4d8c230bf6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:20.708538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d18efd-f552-4816-91e0-29c8eb12def5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:20.778959 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 618/1232] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:19:20 2022] PUT /identity/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/71adc8b93e5c41929b928002e004df6e/roles/b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:19:22.883474 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5702cb7-2f34-4f76-b476-05eb0d4dfe75 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:22.884240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5702cb7-2f34-4f76-b476-05eb0d4dfe75 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:22.884240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5702cb7-2f34-4f76-b476-05eb0d4dfe75 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:22.885527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 615/1233] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:22.890835 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ee00a-1006-413c-80cb-cac4000e3a01 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:22.891271 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ee00a-1006-413c-80cb-cac4000e3a01 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:22.891406 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ee00a-1006-413c-80cb-cac4000e3a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:22.909593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-dd1ee00a-1006-413c-80cb-cac4000e3a01 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:22.910910 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dd1ee00a-1006-413c-80cb-cac4000e3a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:22.982421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 619/1234] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:19:23.005520 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5702cb7-2f34-4f76-b476-05eb0d4dfe75 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:23.031567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:23.111485 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5702cb7-2f34-4f76-b476-05eb0d4dfe75 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:23.146957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52e3c3-d4ce-4a3d-a22d-e98b26797d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:23.147691 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e3c3-d4ce-4a3d-a22d-e98b26797d25 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:23.147977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e3c3-d4ce-4a3d-a22d-e98b26797d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:23.148252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e3c3-d4ce-4a3d-a22d-e98b26797d25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:23.158550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52e3c3-d4ce-4a3d-a22d-e98b26797d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:19:23.168310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-8d52e3c3-d4ce-4a3d-a22d-e98b26797d25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:19:23.168310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:23.168310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:23.168310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:23.168310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:23.168310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:23.168310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:23.168310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:23.168310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:23.168310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:23.168310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:23.168310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:23.168310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:19:23.168310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:19:23.168310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:19:23.168310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:19:23.169578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:19:23.169578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:19:23.169578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:19:23.169578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:19:23.169578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:23.169578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:23.169578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:23.169578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:23.169578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:23.169578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:23.169578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:23.169578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:23.169578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:23.169578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:23.169578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:23.169578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:23.170496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:23.170496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:23.170496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:23.170496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:23.170496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:19:23.170496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:19:23.170496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:19:23.170496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:19:23.170496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:19:23.170496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:19:23.170496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:19:23.170496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:19:23.170496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 616/1235] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Jun 17 07:19:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:23.176295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ee00a-1006-413c-80cb-cac4000e3a01 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:23.226631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:23.282451 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ee00a-1006-413c-80cb-cac4000e3a01 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:23.315385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db13be-aef2-4607-bd28-8705f4e2bf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:23.316048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db13be-aef2-4607-bd28-8705f4e2bf78 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:23.316325 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db13be-aef2-4607-bd28-8705f4e2bf78 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:23.316595 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db13be-aef2-4607-bd28-8705f4e2bf78 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:23.317397 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db13be-aef2-4607-bd28-8705f4e2bf78 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:23.317704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db13be-aef2-4607-bd28-8705f4e2bf78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:23.324874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db13be-aef2-4607-bd28-8705f4e2bf78 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:23.327989 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 620/1236] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Jun 17 07:19:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:23.333850 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52e3c3-d4ce-4a3d-a22d-e98b26797d25 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:23.422162 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:23.437875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52e3c3-d4ce-4a3d-a22d-e98b26797d25 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:23.472455 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350a59e-6d6d-46c2-9f29-061c03fee106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:23.473254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350a59e-6d6d-46c2-9f29-061c03fee106 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:23.473564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350a59e-6d6d-46c2-9f29-061c03fee106 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:23.473843 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350a59e-6d6d-46c2-9f29-061c03fee106 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:23.484169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350a59e-6d6d-46c2-9f29-061c03fee106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:23.485681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350a59e-6d6d-46c2-9f29-061c03fee106 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:23.504922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-c350a59e-6d6d-46c2-9f29-061c03fee106 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:23.504922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:23.504922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:23.504922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:23.504922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:23.504922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:23.504922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:23.504922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:23.504922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:23.504922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:23.504922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:23.504922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:23.504922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:19:23.504922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:19:23.504922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:19:23.510487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:19:23.510487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:23.510487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:23.510487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:23.510487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:23.510487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:23.510487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:23.510487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:23.510487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:23.510487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:23.510487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:23.510487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:23.510487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:23.510487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:23.510487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:23.510487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:23.510487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:23.511681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:19:23.511681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:19:23.511681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:23.511681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:19:23.511681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 617/1237] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:23.512857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db13be-aef2-4607-bd28-8705f4e2bf78 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:23.621401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db13be-aef2-4607-bd28-8705f4e2bf78 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:23.630203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:23.657058 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38b38-3b2a-4911-be06-7a4939015782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:23.657756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38b38-3b2a-4911-be06-7a4939015782 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:23.658035 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38b38-3b2a-4911-be06-7a4939015782 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:23.658310 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38b38-3b2a-4911-be06-7a4939015782 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:23.659033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b38b38-3b2a-4911-be06-7a4939015782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:23.659337 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b38b38-3b2a-4911-be06-7a4939015782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:23.660717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b38b38-3b2a-4911-be06-7a4939015782 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:23.673602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 621/1238] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:23.679304 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350a59e-6d6d-46c2-9f29-061c03fee106 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:23.785387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350a59e-6d6d-46c2-9f29-061c03fee106 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:23.822052 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a69f0-bba1-497a-8d85-0fb5c5b33429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:23.822853 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a69f0-bba1-497a-8d85-0fb5c5b33429 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:23.823131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a69f0-bba1-497a-8d85-0fb5c5b33429 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:23.823445 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a69f0-bba1-497a-8d85-0fb5c5b33429 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:23.826639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:23.831686 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a69f0-bba1-497a-8d85-0fb5c5b33429 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:23.833162 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a69f0-bba1-497a-8d85-0fb5c5b33429 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:23.848540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-038a69f0-bba1-497a-8d85-0fb5c5b33429 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:19:23.848540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:23.848540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:23.848540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:23.848540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:23.848540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:23.848540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:23.848540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:23.848540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:23.848540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:23.848540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:23.848540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:23.848540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:19:23.848540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:19:23.848540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:19:23.848540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:23.858380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:23.859484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:23.859484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:23.859484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:19:23.859484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:19:23.859484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:19:23.859484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:19:23.859484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:19:23.859484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:19:23.859484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:19:23.859484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:19:23.859484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 618/1239] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:23.860126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38b38-3b2a-4911-be06-7a4939015782 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:23.957914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38b38-3b2a-4911-be06-7a4939015782 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:23.992447 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19617e15-8571-4793-9687-6abd0b19f511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:23.993726 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19617e15-8571-4793-9687-6abd0b19f511 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:23.994006 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19617e15-8571-4793-9687-6abd0b19f511 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:23.994277 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19617e15-8571-4793-9687-6abd0b19f511 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:23.995100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19617e15-8571-4793-9687-6abd0b19f511 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:23.995404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19617e15-8571-4793-9687-6abd0b19f511 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:23.996828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19617e15-8571-4793-9687-6abd0b19f511 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:24.014130 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 622/1240] 10.222.0.52 () {56 vars in 1143 bytes} [Fri Jun 17 07:19:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:19:24.019955 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a69f0-bba1-497a-8d85-0fb5c5b33429 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:24.119543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a69f0-bba1-497a-8d85-0fb5c5b33429 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:24.156524 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c604f60-5c81-4f28-94b6-64754bf2c449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:24.157214 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c604f60-5c81-4f28-94b6-64754bf2c449 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:24.157522 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c604f60-5c81-4f28-94b6-64754bf2c449 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:24.157797 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c604f60-5c81-4f28-94b6-64754bf2c449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:24.222530 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:24.229846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c604f60-5c81-4f28-94b6-64754bf2c449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:24.231362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c604f60-5c81-4f28-94b6-64754bf2c449 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:24.330364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 619/1241] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:19:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:19:24.336197 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19617e15-8571-4793-9687-6abd0b19f511 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:24.363847 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:24.439730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19617e15-8571-4793-9687-6abd0b19f511 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:24.476997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21769f43-9db9-42ff-832a-47f131c58c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:24.478303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21769f43-9db9-42ff-832a-47f131c58c9e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:24.478586 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21769f43-9db9-42ff-832a-47f131c58c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:24.478863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21769f43-9db9-42ff-832a-47f131c58c9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:24.489985 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21769f43-9db9-42ff-832a-47f131c58c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:24.491456 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21769f43-9db9-42ff-832a-47f131c58c9e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:24.511602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-21769f43-9db9-42ff-832a-47f131c58c9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:24.511602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:24.511602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:24.511602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:24.511602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:24.511602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:24.511602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:24.511602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:24.511602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:24.511602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:24.511602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:24.511602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:24.511602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:19:24.511602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:19:24.511602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:19:24.512812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:19:24.512812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:24.512812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:24.512812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:24.512812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:24.512812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:24.512812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:24.512812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:24.512812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:24.512812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:24.512812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:24.512812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:24.512812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:24.512812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:24.512812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:24.512812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:24.512812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:24.513825 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:19:24.513825 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:19:24.513825 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:24.513825 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:24.513825 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 623/1242] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:24.518939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c604f60-5c81-4f28-94b6-64754bf2c449 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:24.618019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:24.623942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c604f60-5c81-4f28-94b6-64754bf2c449 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:24.667697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278b422-b019-4d0a-a1f1-55ca7b9635ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:24.668430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278b422-b019-4d0a-a1f1-55ca7b9635ac None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:24.668716 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278b422-b019-4d0a-a1f1-55ca7b9635ac None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:24.668993 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278b422-b019-4d0a-a1f1-55ca7b9635ac None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:24.669767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278b422-b019-4d0a-a1f1-55ca7b9635ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:24.670073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278b422-b019-4d0a-a1f1-55ca7b9635ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:24.671470 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278b422-b019-4d0a-a1f1-55ca7b9635ac None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:24.685053 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 620/1243] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:24.690850 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21769f43-9db9-42ff-832a-47f131c58c9e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:24.775707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:24.796834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21769f43-9db9-42ff-832a-47f131c58c9e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:24.829837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb6dd8-a534-4e78-bed0-d5cb19f3a5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:24.830623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb6dd8-a534-4e78-bed0-d5cb19f3a5fc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:24.830911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb6dd8-a534-4e78-bed0-d5cb19f3a5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:24.831187 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb6dd8-a534-4e78-bed0-d5cb19f3a5fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:24.837743 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb6dd8-a534-4e78-bed0-d5cb19f3a5fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:24.839174 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb6dd8-a534-4e78-bed0-d5cb19f3a5fc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:24.853199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-0feb6dd8-a534-4e78-bed0-d5cb19f3a5fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:19:24.853199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:24.853199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:24.853199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:24.853199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:24.853199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:24.853199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:24.853199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:24.853199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:24.853199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:24.853199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:24.853199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:24.853199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:19:24.853199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:19:24.853199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:19:24.854298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:19:24.854298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:24.854298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:24.854298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:24.854298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:24.854298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:24.854298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:24.854298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:24.854298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:24.854298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:24.854298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:24.854298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:24.854298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:24.854298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:24.854298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:24.854298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:24.854298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:24.855251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:19:24.855251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:19:24.855251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:19:24.855251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:19:24.855251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:19:24.855251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:19:24.855251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:19:24.855251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:24.855251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 624/1244] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:19:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:24.860239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278b422-b019-4d0a-a1f1-55ca7b9635ac None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:24.960216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278b422-b019-4d0a-a1f1-55ca7b9635ac None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:24.993741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403f309-f2ed-46a7-8c20-6efd0ce87b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:24.994417 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403f309-f2ed-46a7-8c20-6efd0ce87b13 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:24.994699 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403f309-f2ed-46a7-8c20-6efd0ce87b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:24.994975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403f309-f2ed-46a7-8c20-6efd0ce87b13 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:24.995765 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403f309-f2ed-46a7-8c20-6efd0ce87b13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:24.996062 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403f309-f2ed-46a7-8c20-6efd0ce87b13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:24.997502 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403f309-f2ed-46a7-8c20-6efd0ce87b13 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:25.010512 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 621/1245] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:19:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:25.016622 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb6dd8-a534-4e78-bed0-d5cb19f3a5fc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:25.116591 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb6dd8-a534-4e78-bed0-d5cb19f3a5fc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:25.150337 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7a5ca-80bf-41b6-b9f4-08ce523dcc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:25.151006 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7a5ca-80bf-41b6-b9f4-08ce523dcc20 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:25.151288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7a5ca-80bf-41b6-b9f4-08ce523dcc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:25.151564 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7a5ca-80bf-41b6-b9f4-08ce523dcc20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:25.152395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7a5ca-80bf-41b6-b9f4-08ce523dcc20 None admin] RBAC: Adding query filter params (role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=71adc8b93e5c41929b928002e004df6e) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:25.152706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7a5ca-80bf-41b6-b9f4-08ce523dcc20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:25.154232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7a5ca-80bf-41b6-b9f4-08ce523dcc20 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:25.160083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 625/1246] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:19:25 2022] GET /identity/v3/role_assignments?user.id=71adc8b93e5c41929b928002e004df6e&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=b2b4f9b1ccfc4e63b260aa4d8c230bf6 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:27.370960 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899761b3-bd4f-4cda-b6b6-fa0be023942e None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:27.371495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899761b3-bd4f-4cda-b6b6-fa0be023942e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:27.371495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899761b3-bd4f-4cda-b6b6-fa0be023942e None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:27.372841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 622/1247] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:19:27.378044 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4045-2570-467a-a2dd-a94ddbdbbb2a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:27.378446 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4045-2570-467a-a2dd-a94ddbdbbb2a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:27.378601 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4045-2570-467a-a2dd-a94ddbdbbb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:27.384534 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:27.396689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-05ab4045-2570-467a-a2dd-a94ddbdbbb2a None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:27.398067 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-05ab4045-2570-467a-a2dd-a94ddbdbbb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:27.465346 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 626/1248] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:19:27.488955 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899761b3-bd4f-4cda-b6b6-fa0be023942e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:27.507898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:27.593816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899761b3-bd4f-4cda-b6b6-fa0be023942e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:27.630945 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e57dc-dbd1-4f1a-b6a2-482720fe9d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:27.631740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e57dc-dbd1-4f1a-b6a2-482720fe9d19 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:27.632018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e57dc-dbd1-4f1a-b6a2-482720fe9d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:27.632289 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e57dc-dbd1-4f1a-b6a2-482720fe9d19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:27.642427 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e57dc-dbd1-4f1a-b6a2-482720fe9d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:19:27.649961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-690e57dc-dbd1-4f1a-b6a2-482720fe9d19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:19:27.649961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:27.649961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:27.649961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:27.649961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:27.649961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:27.649961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:27.649961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:27.649961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:27.649961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:27.649961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:27.649961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:27.649961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:19:27.649961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:19:27.649961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:19:27.649961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:19:27.651089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:19:27.651089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:19:27.651089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:19:27.651089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:19:27.651089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:27.651089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:27.651089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:27.651089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:27.651089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:27.651089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:27.651089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:27.651089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:27.651089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:27.651089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:27.651089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:27.651089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:27.652189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:27.652189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:27.652189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:27.652189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:27.652189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:19:27.652189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:19:27.652189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:19:27.652189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:19:27.652189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:19:27.652189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:19:27.652189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:19:27.652189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:19:27.652189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 623/1249] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:19:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:27.657093 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab4045-2570-467a-a2dd-a94ddbdbbb2a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:27.756159 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab4045-2570-467a-a2dd-a94ddbdbbb2a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:27.783865 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:27.788556 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d180c81-f283-4ae3-ab55-d8c8b48bd84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:27.789212 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180c81-f283-4ae3-ab55-d8c8b48bd84a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:27.790052 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180c81-f283-4ae3-ab55-d8c8b48bd84a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:27.790336 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180c81-f283-4ae3-ab55-d8c8b48bd84a None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:27.791061 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d180c81-f283-4ae3-ab55-d8c8b48bd84a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:27.791360 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d180c81-f283-4ae3-ab55-d8c8b48bd84a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:27.792709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d180c81-f283-4ae3-ab55-d8c8b48bd84a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:27.800517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 627/1250] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:19:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:27.807126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e57dc-dbd1-4f1a-b6a2-482720fe9d19 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:27.884729 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:27.906809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e57dc-dbd1-4f1a-b6a2-482720fe9d19 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:27.940583 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca6597-67d4-4394-a47f-78eba2c63900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:27.941430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca6597-67d4-4394-a47f-78eba2c63900 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:27.941713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca6597-67d4-4394-a47f-78eba2c63900 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:27.941996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca6597-67d4-4394-a47f-78eba2c63900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:27.952423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca6597-67d4-4394-a47f-78eba2c63900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:27.953913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca6597-67d4-4394-a47f-78eba2c63900 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:27.971163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-73ca6597-67d4-4394-a47f-78eba2c63900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:27.971163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:27.971163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:27.971163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:27.971163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:27.971163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:27.971163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:27.971163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:27.971163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:27.971163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:27.971163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:27.971163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:27.971163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:19:27.971163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:19:27.971163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:19:27.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:19:27.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:27.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:27.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:27.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:27.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:27.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:27.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:27.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:27.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:27.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:27.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:27.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:27.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:27.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:27.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:27.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:27.973308 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:19:27.973308 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:19:27.973308 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:27.973308 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:19:27.973308 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 624/1251] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:27.978806 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d180c81-f283-4ae3-ab55-d8c8b48bd84a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:28.081519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d180c81-f283-4ae3-ab55-d8c8b48bd84a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:28.114715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311305a-31ae-4643-ae10-4f6a8ea8511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:28.115369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311305a-31ae-4643-ae10-4f6a8ea8511a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:28.115645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311305a-31ae-4643-ae10-4f6a8ea8511a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:28.116014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311305a-31ae-4643-ae10-4f6a8ea8511a None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:28.116714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311305a-31ae-4643-ae10-4f6a8ea8511a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:28.117119 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311305a-31ae-4643-ae10-4f6a8ea8511a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:28.118818 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311305a-31ae-4643-ae10-4f6a8ea8511a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:28.133097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 628/1252] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:28.139250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca6597-67d4-4394-a47f-78eba2c63900 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:28.241459 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca6597-67d4-4394-a47f-78eba2c63900 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:28.270124 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:28.279334 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2bb73-bd23-4239-8241-908e992de02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:28.280140 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2bb73-bd23-4239-8241-908e992de02b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:28.280416 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2bb73-bd23-4239-8241-908e992de02b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:28.280730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2bb73-bd23-4239-8241-908e992de02b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:28.288745 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2bb73-bd23-4239-8241-908e992de02b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:28.290948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2bb73-bd23-4239-8241-908e992de02b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:28.305185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-51f2bb73-bd23-4239-8241-908e992de02b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:19:28.305185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:28.305185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:28.305185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:28.305185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:28.305185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:28.305185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:28.305185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:28.305185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:28.305185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:28.305185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:28.305185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:28.305185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:19:28.305185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:19:28.305185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:19:28.305185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:28.306260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:28.307575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:28.307575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:28.307575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:19:28.307575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:19:28.307575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:19:28.307575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:19:28.307575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:19:28.307575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:19:28.307575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:19:28.307575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:19:28.307575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 625/1253] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:28.312301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311305a-31ae-4643-ae10-4f6a8ea8511a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:28.369446 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:28.414031 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311305a-31ae-4643-ae10-4f6a8ea8511a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:28.448584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353adf2c-7d45-43d3-94ec-155100253946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:28.449447 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353adf2c-7d45-43d3-94ec-155100253946 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:28.452439 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353adf2c-7d45-43d3-94ec-155100253946 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:28.452439 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353adf2c-7d45-43d3-94ec-155100253946 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:28.452439 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353adf2c-7d45-43d3-94ec-155100253946 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:28.452439 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353adf2c-7d45-43d3-94ec-155100253946 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:28.453135 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353adf2c-7d45-43d3-94ec-155100253946 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:28.471295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 629/1254] 10.222.0.52 () {56 vars in 1143 bytes} [Fri Jun 17 07:19:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:28.477068 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2bb73-bd23-4239-8241-908e992de02b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:28.579270 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2bb73-bd23-4239-8241-908e992de02b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:28.613709 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5692345-73f7-4796-a883-243fe90c1fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:28.614452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5692345-73f7-4796-a883-243fe90c1fcc None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:28.614735 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5692345-73f7-4796-a883-243fe90c1fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:28.615011 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5692345-73f7-4796-a883-243fe90c1fcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:28.674861 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:28.685650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5692345-73f7-4796-a883-243fe90c1fcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:28.687209 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5692345-73f7-4796-a883-243fe90c1fcc None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:28.787100 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 626/1255] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:19:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:19:28.792998 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353adf2c-7d45-43d3-94ec-155100253946 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:28.896342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353adf2c-7d45-43d3-94ec-155100253946 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:28.909421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:28.931252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46302546-5992-497a-92a1-ef8833579051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:28.931984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46302546-5992-497a-92a1-ef8833579051 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:28.932269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46302546-5992-497a-92a1-ef8833579051 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:28.932546 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46302546-5992-497a-92a1-ef8833579051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:28.942510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46302546-5992-497a-92a1-ef8833579051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:28.943942 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46302546-5992-497a-92a1-ef8833579051 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:28.961838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-46302546-5992-497a-92a1-ef8833579051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:28.961838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:28.961838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:28.961838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:28.961838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:28.961838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:28.961838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:28.961838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:28.961838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:28.961838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:28.961838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:28.961838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:28.961838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:19:28.961838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:19:28.961838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:19:28.962956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:19:28.962956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:28.962956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:28.962956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:28.962956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:28.962956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:28.962956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:28.962956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:28.962956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:28.962956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:28.962956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:28.962956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:28.962956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:28.962956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:28.962956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:28.962956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:28.962956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:28.964356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:19:28.964356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:19:28.964356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:28.964356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:28.964356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 630/1256] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:28.970096 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5692345-73f7-4796-a883-243fe90c1fcc None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:29.057577 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:29.069161 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5692345-73f7-4796-a883-243fe90c1fcc None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:29.103414 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ad8ca-42eb-4338-8098-eeb4188c3651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:29.104072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ad8ca-42eb-4338-8098-eeb4188c3651 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:29.104354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ad8ca-42eb-4338-8098-eeb4188c3651 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:29.104634 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ad8ca-42eb-4338-8098-eeb4188c3651 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:29.105363 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ad8ca-42eb-4338-8098-eeb4188c3651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:29.105668 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ad8ca-42eb-4338-8098-eeb4188c3651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:29.107026 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ad8ca-42eb-4338-8098-eeb4188c3651 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:29.118640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 627/1257] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:29.124531 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46302546-5992-497a-92a1-ef8833579051 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:29.224542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46302546-5992-497a-92a1-ef8833579051 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:29.260047 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550c0fe-3496-4f86-867c-4bd305b93bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:29.260836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550c0fe-3496-4f86-867c-4bd305b93bba None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:29.261113 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550c0fe-3496-4f86-867c-4bd305b93bba None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:29.261409 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550c0fe-3496-4f86-867c-4bd305b93bba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:29.267918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550c0fe-3496-4f86-867c-4bd305b93bba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:29.269365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550c0fe-3496-4f86-867c-4bd305b93bba None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:29.282906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b550c0fe-3496-4f86-867c-4bd305b93bba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:19:29.282906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:29.282906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:29.282906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:29.282906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:29.282906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:29.282906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:29.282906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:29.282906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:29.282906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:29.282906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:29.282906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:29.282906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:19:29.282906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:19:29.282906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:19:29.283986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:19:29.283986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:29.283986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:29.283986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:29.283986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:29.283986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:29.283986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:29.283986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:29.283986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:29.283986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:29.283986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:29.283986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:29.283986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:29.283986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:29.283986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:29.283986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:29.283986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:29.284922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:19:29.284922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:19:29.284922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:19:29.284922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:19:29.284922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:19:29.284922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:19:29.284922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:19:29.284922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:29.284922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 631/1258] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:19:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:29.290662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ad8ca-42eb-4338-8098-eeb4188c3651 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:29.390849 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ad8ca-42eb-4338-8098-eeb4188c3651 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:29.427005 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36faaca3-0e24-4431-96e4-4f5d176ef229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:29.427660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faaca3-0e24-4431-96e4-4f5d176ef229 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:29.427936 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faaca3-0e24-4431-96e4-4f5d176ef229 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:29.428208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faaca3-0e24-4431-96e4-4f5d176ef229 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:29.428978 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36faaca3-0e24-4431-96e4-4f5d176ef229 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:29.429280 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36faaca3-0e24-4431-96e4-4f5d176ef229 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:29.431393 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36faaca3-0e24-4431-96e4-4f5d176ef229 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:29.443689 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 628/1259] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:19:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:29.449995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550c0fe-3496-4f86-867c-4bd305b93bba None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:29.476545 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:29.554489 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550c0fe-3496-4f86-867c-4bd305b93bba None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:29.595422 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aca095-00cc-4924-a738-5e1e737b66c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:29.596116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aca095-00cc-4924-a738-5e1e737b66c3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:29.596397 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aca095-00cc-4924-a738-5e1e737b66c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:29.596667 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aca095-00cc-4924-a738-5e1e737b66c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:29.597517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aca095-00cc-4924-a738-5e1e737b66c3 None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=71adc8b93e5c41929b928002e004df6e) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:29.597836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aca095-00cc-4924-a738-5e1e737b66c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:29.599321 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aca095-00cc-4924-a738-5e1e737b66c3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:29.605848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 632/1260] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:19:29 2022] GET /identity/v3/role_assignments?user.id=71adc8b93e5c41929b928002e004df6e&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:31.795502 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d2403-7673-4772-a378-d1a5963b2033 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:31.796019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d2403-7673-4772-a378-d1a5963b2033 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:31.796123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d2403-7673-4772-a378-d1a5963b2033 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:31.797516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 629/1261] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:31.802828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd32bb-1d90-4886-bec9-9f81a1d35758 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:31.803267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd32bb-1d90-4886-bec9-9f81a1d35758 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:31.803387 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd32bb-1d90-4886-bec9-9f81a1d35758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:31.821501 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3bbd32bb-1d90-4886-bec9-9f81a1d35758 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:31.823088 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3bbd32bb-1d90-4886-bec9-9f81a1d35758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:31.892784 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 633/1262] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:19:31.917114 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d2403-7673-4772-a378-d1a5963b2033 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:31.928140 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:32.026663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d2403-7673-4772-a378-d1a5963b2033 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:32.062940 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d471291-aab7-4c69-8be4-050038e3a9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:32.063733 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d471291-aab7-4c69-8be4-050038e3a9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:32.064014 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d471291-aab7-4c69-8be4-050038e3a9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:32.064288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d471291-aab7-4c69-8be4-050038e3a9d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:32.074862 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d471291-aab7-4c69-8be4-050038e3a9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:19:32.082453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-8d471291-aab7-4c69-8be4-050038e3a9d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:19:32.082453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:32.082453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:32.082453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:32.082453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:32.082453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:32.082453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:32.082453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:32.082453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:32.082453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:32.082453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:32.082453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:32.082453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:19:32.082453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:19:32.082453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:19:32.082453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:19:32.083670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:19:32.083670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:19:32.083670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:19:32.083670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:19:32.083670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:32.083670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:32.083670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:32.083670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:32.083670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:32.083670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:32.083670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:32.083670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:32.083670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:32.083670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:32.083670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:32.083670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:32.084599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:32.084599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:32.084599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:32.084599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:32.084599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:19:32.084599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:19:32.084599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:19:32.084599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:19:32.084599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:19:32.084599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:19:32.084599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:19:32.084599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:19:32.084599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 630/1263] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:19:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:32.090902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd32bb-1d90-4886-bec9-9f81a1d35758 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:32.109879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:32.200707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd32bb-1d90-4886-bec9-9f81a1d35758 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:32.237095 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938da48-2edb-49f2-93f9-ade2c467841d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:32.237794 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938da48-2edb-49f2-93f9-ade2c467841d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:32.238119 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938da48-2edb-49f2-93f9-ade2c467841d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:32.238392 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938da48-2edb-49f2-93f9-ade2c467841d None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:32.239132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938da48-2edb-49f2-93f9-ade2c467841d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:32.239465 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938da48-2edb-49f2-93f9-ade2c467841d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:32.240849 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938da48-2edb-49f2-93f9-ade2c467841d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:32.251288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 634/1264] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:19:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:32.257706 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d471291-aab7-4c69-8be4-050038e3a9d3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:32.333381 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:32.378827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d471291-aab7-4c69-8be4-050038e3a9d3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:32.415176 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759e64e-d044-460e-bb99-4544288ddf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:32.416181 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759e64e-d044-460e-bb99-4544288ddf21 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:32.416466 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759e64e-d044-460e-bb99-4544288ddf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:32.416743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759e64e-d044-460e-bb99-4544288ddf21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:32.428770 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759e64e-d044-460e-bb99-4544288ddf21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:32.432758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759e64e-d044-460e-bb99-4544288ddf21 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:32.449142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-7759e64e-d044-460e-bb99-4544288ddf21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:32.449142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:32.449142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:32.449142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:32.449142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:32.449142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:32.449142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:32.449142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:32.449142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:32.449142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:32.449142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:32.449142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:32.449142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:19:32.449142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:19:32.449142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:19:32.450224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:19:32.450224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:32.450224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:32.450224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:32.450224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:32.450224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:32.450224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:32.450224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:32.450224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:32.450224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:32.450224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:32.450224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:32.450224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:32.450224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:32.450224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:32.450224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:32.450224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:32.451322 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:19:32.451322 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:19:32.451322 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:32.451322 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:19:32.451322 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 631/1265] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:19:32.456468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938da48-2edb-49f2-93f9-ade2c467841d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:32.547897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:32.569424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938da48-2edb-49f2-93f9-ade2c467841d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:32.615232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a8e82-7a8b-4fb9-929b-fda2a78f37ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:32.615232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a8e82-7a8b-4fb9-929b-fda2a78f37ab None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:32.615513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a8e82-7a8b-4fb9-929b-fda2a78f37ab None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:32.615605 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a8e82-7a8b-4fb9-929b-fda2a78f37ab None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:32.616309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a8e82-7a8b-4fb9-929b-fda2a78f37ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:32.616682 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a8e82-7a8b-4fb9-929b-fda2a78f37ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:32.618441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a8e82-7a8b-4fb9-929b-fda2a78f37ab None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:32.629925 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 635/1266] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:32.636196 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759e64e-d044-460e-bb99-4544288ddf21 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:32.745222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759e64e-d044-460e-bb99-4544288ddf21 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:32.765660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:32.781458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3c1d2-dac1-4af1-a8d8-611bd5b44d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:32.782566 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3c1d2-dac1-4af1-a8d8-611bd5b44d80 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:32.782841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3c1d2-dac1-4af1-a8d8-611bd5b44d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:32.783192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3c1d2-dac1-4af1-a8d8-611bd5b44d80 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:32.792891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3c1d2-dac1-4af1-a8d8-611bd5b44d80 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:32.794438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3c1d2-dac1-4af1-a8d8-611bd5b44d80 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:32.809303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-00a3c1d2-dac1-4af1-a8d8-611bd5b44d80 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:19:32.809303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:32.809303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:32.809303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:32.809303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:32.809303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:32.809303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:32.809303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:32.809303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:32.809303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:32.809303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:32.809303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:32.809303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:19:32.809303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:19:32.809303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:19:32.809303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:32.811143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:32.812461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:32.812461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:32.812461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:19:32.812461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:19:32.812461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:19:32.812461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:19:32.812461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:19:32.812461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:19:32.812461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:19:32.812461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:19:32.812461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 632/1267] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:32.816564 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a8e82-7a8b-4fb9-929b-fda2a78f37ab None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:32.922079 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a8e82-7a8b-4fb9-929b-fda2a78f37ab None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:32.957956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33327e7-28c8-491f-9d9e-5a6e19686010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:32.958637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33327e7-28c8-491f-9d9e-5a6e19686010 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:32.958921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33327e7-28c8-491f-9d9e-5a6e19686010 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:32.959195 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33327e7-28c8-491f-9d9e-5a6e19686010 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:32.960103 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33327e7-28c8-491f-9d9e-5a6e19686010 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:32.960412 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33327e7-28c8-491f-9d9e-5a6e19686010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:32.962921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33327e7-28c8-491f-9d9e-5a6e19686010 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:32.973124 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:32.983112 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 636/1268] 10.222.0.52 () {56 vars in 1143 bytes} [Fri Jun 17 07:19:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:32.989449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3c1d2-dac1-4af1-a8d8-611bd5b44d80 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:33.108090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3c1d2-dac1-4af1-a8d8-611bd5b44d80 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:33.147055 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2ac6-9c70-4161-b8f3-569b543209f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:33.147842 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2ac6-9c70-4161-b8f3-569b543209f6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:33.148139 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2ac6-9c70-4161-b8f3-569b543209f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:33.148394 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2ac6-9c70-4161-b8f3-569b543209f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:33.159568 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb2ac6-9c70-4161-b8f3-569b543209f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:33.161025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb2ac6-9c70-4161-b8f3-569b543209f6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:33.180718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-f6bb2ac6-9c70-4161-b8f3-569b543209f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:33.180718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:33.180718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:33.180718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:33.180718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:33.180718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:33.180718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:33.180718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:33.180718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:33.180718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:33.180718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:33.180718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:33.180718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:19:33.180718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:19:33.180718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:19:33.181890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:19:33.181890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:33.181890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:33.181890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:33.181890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:33.181890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:33.181890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:33.181890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:33.181890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:33.181890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:33.181890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:33.181890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:33.181890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:33.181890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:33.181890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:33.181890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:33.181890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:33.183034 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:19:33.183034 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:19:33.183034 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:33.183034 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:19:33.183034 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 633/1269] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:33.187068 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33327e7-28c8-491f-9d9e-5a6e19686010 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:33.299449 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33327e7-28c8-491f-9d9e-5a6e19686010 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:33.333300 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c6f98-089f-4327-a383-487b242a5e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:33.333996 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c6f98-089f-4327-a383-487b242a5e53 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:33.334342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c6f98-089f-4327-a383-487b242a5e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:33.334617 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c6f98-089f-4327-a383-487b242a5e53 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:33.335335 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c6f98-089f-4327-a383-487b242a5e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:33.335633 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c6f98-089f-4327-a383-487b242a5e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:33.337741 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c6f98-089f-4327-a383-487b242a5e53 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:33.349122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 637/1270] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:33.355875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2ac6-9c70-4161-b8f3-569b543209f6 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:33.387380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:33.466426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2ac6-9c70-4161-b8f3-569b543209f6 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:33.503771 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1f0ef-b425-427f-8869-e6744e7c159d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:33.504549 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1f0ef-b425-427f-8869-e6744e7c159d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:33.504830 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1f0ef-b425-427f-8869-e6744e7c159d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:33.505102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1f0ef-b425-427f-8869-e6744e7c159d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:33.513426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1f0ef-b425-427f-8869-e6744e7c159d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:33.515073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1f0ef-b425-427f-8869-e6744e7c159d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:33.529396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-2dc1f0ef-b425-427f-8869-e6744e7c159d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:19:33.529396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:33.529396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:33.529396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:33.529396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:33.529396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:33.529396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:33.529396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:33.529396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:33.529396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:33.529396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:33.529396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:33.529396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:19:33.529396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:19:33.529396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:19:33.530578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:19:33.530578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:33.530578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:33.530578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:33.530578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:33.530578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:33.530578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:33.530578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:33.530578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:33.530578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:33.530578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:33.530578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:33.530578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:33.530578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:33.530578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:33.530578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:33.530578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:33.531594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:19:33.531594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:19:33.531594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:19:33.531594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:19:33.531594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:19:33.531594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:19:33.531594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:19:33.531594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:19:33.531594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 634/1271] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:19:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:19:33.536588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c6f98-089f-4327-a383-487b242a5e53 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:33.606748 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:33.654111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c6f98-089f-4327-a383-487b242a5e53 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:33.689941 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f80ebe-a17a-4419-be64-b90b5a1a1848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:33.690606 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f80ebe-a17a-4419-be64-b90b5a1a1848 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:33.690888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f80ebe-a17a-4419-be64-b90b5a1a1848 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:33.691162 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f80ebe-a17a-4419-be64-b90b5a1a1848 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:33.692106 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f80ebe-a17a-4419-be64-b90b5a1a1848 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:33.692255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f80ebe-a17a-4419-be64-b90b5a1a1848 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:33.693720 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f80ebe-a17a-4419-be64-b90b5a1a1848 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:33.708800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 638/1272] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:19:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:33.714963 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1f0ef-b425-427f-8869-e6744e7c159d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:33.814557 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:33.823041 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1f0ef-b425-427f-8869-e6744e7c159d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:33.857144 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742fdab-7b45-4013-aa6f-65ab0fca2edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:33.858136 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742fdab-7b45-4013-aa6f-65ab0fca2edb None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:33.858412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742fdab-7b45-4013-aa6f-65ab0fca2edb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:33.858689 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742fdab-7b45-4013-aa6f-65ab0fca2edb None admin] PATH_INFO: `/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/71adc8b93e5c41929b928002e004df6e/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:33.860672 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742fdab-7b45-4013-aa6f-65ab0fca2edb None admin] RBAC: Authorizing `identity:create_grant(project_id=0dffdba97abf4f59b12c4fbdc6245e9e, user_id=71adc8b93e5c41929b928002e004df6e, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:33.862156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742fdab-7b45-4013-aa6f-65ab0fca2edb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:33.965597 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 635/1273] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Jun 17 07:19:33 2022] PUT /identity/v3/projects/0dffdba97abf4f59b12c4fbdc6245e9e/users/71adc8b93e5c41929b928002e004df6e/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:19:36.096866 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3af29-a99b-42cc-9504-4e56c89fe3ab None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:36.097554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3af29-a99b-42cc-9504-4e56c89fe3ab None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:36.097554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3af29-a99b-42cc-9504-4e56c89fe3ab None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:36.098887 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 639/1274] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:36.105706 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01067cd1-5f09-46a9-82e5-3dea27546684 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:36.106300 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01067cd1-5f09-46a9-82e5-3dea27546684 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:36.106300 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01067cd1-5f09-46a9-82e5-3dea27546684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:36.124959 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-01067cd1-5f09-46a9-82e5-3dea27546684 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:36.126230 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-01067cd1-5f09-46a9-82e5-3dea27546684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:36.197853 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 636/1275] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:19:36.222283 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3af29-a99b-42cc-9504-4e56c89fe3ab None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:36.326538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3af29-a99b-42cc-9504-4e56c89fe3ab None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:36.343912 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:36.360605 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a16e2c-1598-46b2-bc1c-618ef539e0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:36.361349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a16e2c-1598-46b2-bc1c-618ef539e0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:36.361693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a16e2c-1598-46b2-bc1c-618ef539e0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:36.361972 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a16e2c-1598-46b2-bc1c-618ef539e0f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:36.372522 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a16e2c-1598-46b2-bc1c-618ef539e0f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:19:36.380604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-15a16e2c-1598-46b2-bc1c-618ef539e0f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:19:36.380604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:36.380604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:36.380604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:36.380604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:36.380604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:36.380604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:36.380604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:36.380604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:36.380604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:36.380604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:36.380604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:36.380604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:19:36.380604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:19:36.380604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:19:36.380604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:19:36.381867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:19:36.381867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:19:36.381867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:19:36.381867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:19:36.381867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:36.381867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:36.381867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:36.381867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:36.381867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:36.381867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:36.381867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:36.381867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:36.381867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:36.381867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:36.381867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:36.381867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:36.383772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:36.383772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:36.383772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:36.383772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:36.383772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:19:36.383772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:19:36.383772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:19:36.383772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:19:36.383772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:19:36.383772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:19:36.383772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:19:36.383772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:36.383772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 640/1276] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Jun 17 07:19:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:36.388719 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01067cd1-5f09-46a9-82e5-3dea27546684 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:36.471261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:36.490267 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01067cd1-5f09-46a9-82e5-3dea27546684 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:36.527749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f0661-176a-4c01-9c24-865ccb3dbce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:36.528423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f0661-176a-4c01-9c24-865ccb3dbce2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:36.528703 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f0661-176a-4c01-9c24-865ccb3dbce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:36.528976 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f0661-176a-4c01-9c24-865ccb3dbce2 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:36.529758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f0661-176a-4c01-9c24-865ccb3dbce2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:36.530062 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f0661-176a-4c01-9c24-865ccb3dbce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:36.531443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f0661-176a-4c01-9c24-865ccb3dbce2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:36.540389 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 637/1277] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Jun 17 07:19:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:36.546374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a16e2c-1598-46b2-bc1c-618ef539e0f2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:36.648375 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a16e2c-1598-46b2-bc1c-618ef539e0f2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:36.683329 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ecb12-c6ee-4839-9c06-c9d58755f4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:36.684177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ecb12-c6ee-4839-9c06-c9d58755f4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:36.684457 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ecb12-c6ee-4839-9c06-c9d58755f4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:36.684736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ecb12-c6ee-4839-9c06-c9d58755f4a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:36.696651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ecb12-c6ee-4839-9c06-c9d58755f4a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:36.698202 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ecb12-c6ee-4839-9c06-c9d58755f4a4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:36.716537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-515ecb12-c6ee-4839-9c06-c9d58755f4a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:36.716537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:36.716537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:36.716537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:36.716537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:36.716537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:36.716537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:36.716537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:36.716537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:36.716537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:36.716537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:36.716537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:36.716537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:19:36.716537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:19:36.716537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:19:36.717717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:19:36.717717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:36.717717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:36.717717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:36.717717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:36.717717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:36.717717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:36.717717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:36.717717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:36.717717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:36.717717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:36.717717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:36.717717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:36.717717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:36.717717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:36.717717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:36.717717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:36.718922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:19:36.718922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:19:36.718922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:36.718922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:36.718922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 641/1278] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:36.723820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f0661-176a-4c01-9c24-865ccb3dbce2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:36.828770 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f0661-176a-4c01-9c24-865ccb3dbce2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:36.862956 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8f17c-7be3-4d70-9256-0cbec71474e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:36.863644 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8f17c-7be3-4d70-9256-0cbec71474e5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:36.863927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8f17c-7be3-4d70-9256-0cbec71474e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:36.864201 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8f17c-7be3-4d70-9256-0cbec71474e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:36.864953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8f17c-7be3-4d70-9256-0cbec71474e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:36.865254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8f17c-7be3-4d70-9256-0cbec71474e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:36.866688 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8f17c-7be3-4d70-9256-0cbec71474e5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:36.880789 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 638/1279] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:36.886944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ecb12-c6ee-4839-9c06-c9d58755f4a4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:36.919420 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:36.992278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ecb12-c6ee-4839-9c06-c9d58755f4a4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:37.027152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb6ebb-f7ed-49fc-a83f-5a4e7387df37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:37.027968 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb6ebb-f7ed-49fc-a83f-5a4e7387df37 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:37.028246 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb6ebb-f7ed-49fc-a83f-5a4e7387df37 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:37.028525 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb6ebb-f7ed-49fc-a83f-5a4e7387df37 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:37.036308 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb6ebb-f7ed-49fc-a83f-5a4e7387df37 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:37.037792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb6ebb-f7ed-49fc-a83f-5a4e7387df37 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:37.053657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-bdfb6ebb-f7ed-49fc-a83f-5a4e7387df37 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:19:37.053657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:37.053657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:37.053657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:37.053657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:37.053657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:37.053657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:37.053657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:37.053657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:37.053657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:37.053657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:37.053657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:37.053657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:19:37.053657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:19:37.053657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:19:37.053657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:37.055557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:37.056679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:37.056679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:37.056679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:19:37.056679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:19:37.056679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:19:37.056679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:19:37.056679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:19:37.056679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:19:37.056679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:19:37.056679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:37.056679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 642/1280] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:37.061278 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8f17c-7be3-4d70-9256-0cbec71474e5 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:37.065080 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:37.164124 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8f17c-7be3-4d70-9256-0cbec71474e5 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:37.200558 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4f638-2b3b-46d0-8221-86d5949601f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:37.201141 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4f638-2b3b-46d0-8221-86d5949601f7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:37.201441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4f638-2b3b-46d0-8221-86d5949601f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:37.201715 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4f638-2b3b-46d0-8221-86d5949601f7 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:37.202548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4f638-2b3b-46d0-8221-86d5949601f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:37.202851 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4f638-2b3b-46d0-8221-86d5949601f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:37.204287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4f638-2b3b-46d0-8221-86d5949601f7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:37.222100 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 639/1281] 10.222.0.52 () {56 vars in 1143 bytes} [Fri Jun 17 07:19:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:37.228044 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb6ebb-f7ed-49fc-a83f-5a4e7387df37 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:37.321093 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:37.330290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb6ebb-f7ed-49fc-a83f-5a4e7387df37 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:37.363782 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5e284-e16a-42c5-8bc3-a4c0ee623ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:37.364428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5e284-e16a-42c5-8bc3-a4c0ee623ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:37.364705 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5e284-e16a-42c5-8bc3-a4c0ee623ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:37.364977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5e284-e16a-42c5-8bc3-a4c0ee623ae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:37.434928 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5e284-e16a-42c5-8bc3-a4c0ee623ae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:37.436419 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5e284-e16a-42c5-8bc3-a4c0ee623ae8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:37.524896 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:37.534641 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 643/1282] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Jun 17 07:19:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:19:37.541103 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4f638-2b3b-46d0-8221-86d5949601f7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:37.607450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:37.646384 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4f638-2b3b-46d0-8221-86d5949601f7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:37.680985 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a7956-8935-4135-a817-76f23e9d1c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:37.681937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a7956-8935-4135-a817-76f23e9d1c3b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:37.682095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a7956-8935-4135-a817-76f23e9d1c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:37.682368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a7956-8935-4135-a817-76f23e9d1c3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:37.694829 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a7956-8935-4135-a817-76f23e9d1c3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:37.697031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a7956-8935-4135-a817-76f23e9d1c3b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:37.713952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-665a7956-8935-4135-a817-76f23e9d1c3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:37.713952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:37.713952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:37.713952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:37.713952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:37.713952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:37.713952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:37.713952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:37.713952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:37.713952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:37.713952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:37.713952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:37.713952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:19:37.713952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:19:37.713952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:19:37.714920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:19:37.714920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:37.714920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:37.714920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:37.714920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:37.714920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:37.714920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:37.714920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:37.714920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:37.714920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:37.714920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:37.714920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:37.714920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:37.714920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:37.714920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:37.714920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:37.714920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:37.715900 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:19:37.715900 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:19:37.715900 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:19:37.715900 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:19:37.715900 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 640/1283] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:37.721012 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5e284-e16a-42c5-8bc3-a4c0ee623ae8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:37.822561 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5e284-e16a-42c5-8bc3-a4c0ee623ae8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:37.857434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46ddbd-2cff-4069-933a-fdfc5450085e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:37.858096 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46ddbd-2cff-4069-933a-fdfc5450085e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:37.858424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46ddbd-2cff-4069-933a-fdfc5450085e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:37.858693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46ddbd-2cff-4069-933a-fdfc5450085e None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:37.859411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46ddbd-2cff-4069-933a-fdfc5450085e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:37.859714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46ddbd-2cff-4069-933a-fdfc5450085e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:37.861070 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46ddbd-2cff-4069-933a-fdfc5450085e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:37.872472 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 644/1284] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Jun 17 07:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:37.878347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a7956-8935-4135-a817-76f23e9d1c3b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:37.978511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a7956-8935-4135-a817-76f23e9d1c3b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:37.991978 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:38.012732 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7182c-13f8-4f42-9df1-e0cde758cac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:38.013552 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7182c-13f8-4f42-9df1-e0cde758cac0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:38.013887 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7182c-13f8-4f42-9df1-e0cde758cac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:38.014163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7182c-13f8-4f42-9df1-e0cde758cac0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:38.020810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7182c-13f8-4f42-9df1-e0cde758cac0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:38.022278 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7182c-13f8-4f42-9df1-e0cde758cac0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:38.037118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-a8d7182c-13f8-4f42-9df1-e0cde758cac0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:19:38.037118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:38.037118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:38.037118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:38.037118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:38.037118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:38.037118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:38.037118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:38.037118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:38.037118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:38.037118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:38.037118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:38.037118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:19:38.037118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:19:38.037118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:19:38.038164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:19:38.038164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:38.038164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:38.038164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:38.038164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:38.038164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:38.038164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:38.038164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:38.038164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:38.038164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:38.038164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:38.038164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:38.038164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:38.038164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:38.038164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:38.038164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:38.038164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:38.039727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:19:38.039727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:19:38.039727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:19:38.039727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:19:38.039727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:19:38.039727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:19:38.039727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:19:38.039727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jun 17 07:19:38.039727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 641/1285] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Jun 17 07:19:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:38.045259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46ddbd-2cff-4069-933a-fdfc5450085e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:38.095092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:38.145213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46ddbd-2cff-4069-933a-fdfc5450085e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:38.181650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88dc65-27ff-40d0-82c3-882373ad83a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:38.182324 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88dc65-27ff-40d0-82c3-882373ad83a1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:38.182607 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88dc65-27ff-40d0-82c3-882373ad83a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:38.182883 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88dc65-27ff-40d0-82c3-882373ad83a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:38.183692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88dc65-27ff-40d0-82c3-882373ad83a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:38.183999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88dc65-27ff-40d0-82c3-882373ad83a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:38.185467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88dc65-27ff-40d0-82c3-882373ad83a1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:38.198448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 645/1286] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Jun 17 07:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:38.204582 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7182c-13f8-4f42-9df1-e0cde758cac0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:38.306244 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7182c-13f8-4f42-9df1-e0cde758cac0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:38.340169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42445834-56f7-471e-a666-1cb28bd8bc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:38.340825 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42445834-56f7-471e-a666-1cb28bd8bc60 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:38.341104 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42445834-56f7-471e-a666-1cb28bd8bc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:38.341403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42445834-56f7-471e-a666-1cb28bd8bc60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:38.342228 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42445834-56f7-471e-a666-1cb28bd8bc60 None admin] RBAC: Adding query filter params (role.id=456b9cf0313d4ef38999b86ad7fbf268, scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e, user.id=71adc8b93e5c41929b928002e004df6e) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:38.342533 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42445834-56f7-471e-a666-1cb28bd8bc60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:38.343965 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42445834-56f7-471e-a666-1cb28bd8bc60 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:38.349925 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 642/1287] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Jun 17 07:19:38 2022] GET /identity/v3/role_assignments?user.id=71adc8b93e5c41929b928002e004df6e&scope.project.id=0dffdba97abf4f59b12c4fbdc6245e9e&role.id=456b9cf0313d4ef38999b86ad7fbf268 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:40.608610 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7e44a-4780-4e0b-bf74-3f8b9eff44af None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:40.609171 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7e44a-4780-4e0b-bf74-3f8b9eff44af None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:40.609171 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7e44a-4780-4e0b-bf74-3f8b9eff44af None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:40.610564 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 646/1288] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:40.616048 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfcbcb-8aa6-4b04-bbb1-b2638ad0b211 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:40.616516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfcbcb-8aa6-4b04-bbb1-b2638ad0b211 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:40.619318 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfcbcb-8aa6-4b04-bbb1-b2638ad0b211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:40.634581 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-27bfcbcb-8aa6-4b04-bbb1-b2638ad0b211 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:40.635756 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-27bfcbcb-8aa6-4b04-bbb1-b2638ad0b211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:40.665212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:40.717174 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 643/1289] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:19:40.741293 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7e44a-4780-4e0b-bf74-3f8b9eff44af None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:40.843890 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7e44a-4780-4e0b-bf74-3f8b9eff44af None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:40.855259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:40.878087 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e94f64-8640-497d-b505-ca89269f6ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:40.878807 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e94f64-8640-497d-b505-ca89269f6ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:40.879095 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e94f64-8640-497d-b505-ca89269f6ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:40.879371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e94f64-8640-497d-b505-ca89269f6ac7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:40.880274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e94f64-8640-497d-b505-ca89269f6ac7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:40.881707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e94f64-8640-497d-b505-ca89269f6ac7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:40.893516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-39e94f64-8640-497d-b505-ca89269f6ac7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:19:40.893516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:40.893516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:19:40.893516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:19:40.893516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:19:40.893516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:19:40.893516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:19:40.893516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:19:40.893516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:19:40.893516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:40.893516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:19:40.893516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:40.893516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:40.893516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:40.893516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:40.893516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:40.893516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:40.894754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:40.894754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:40.894754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:40.894754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:40.894754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:40.894754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:40.894754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:19:40.894754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:19:40.894754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:19:40.894754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:19:40.894754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:40.894754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:40.894754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:40.894754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:40.894754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:40.894754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:40.895681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:40.895681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:40.895681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:40.895681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:40.895681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:40.895681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:40.895681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:40.895681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:40.895681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:40.895681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:40.895681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:19:40.895681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:19:40.895681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:19:40.895681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:40.895681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 647/1290] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Jun 17 07:19:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:40.901317 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfcbcb-8aa6-4b04-bbb1-b2638ad0b211 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:41.009649 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfcbcb-8aa6-4b04-bbb1-b2638ad0b211 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:41.044125 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edade5-9346-4687-9b36-783d5f7b02e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:41.044810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edade5-9346-4687-9b36-783d5f7b02e6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:41.045098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edade5-9346-4687-9b36-783d5f7b02e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:41.045403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edade5-9346-4687-9b36-783d5f7b02e6 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:41.046118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edade5-9346-4687-9b36-783d5f7b02e6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:41.046426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edade5-9346-4687-9b36-783d5f7b02e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:41.047810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edade5-9346-4687-9b36-783d5f7b02e6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:41.052938 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 644/1291] 10.222.0.52 () {56 vars in 1116 bytes} [Fri Jun 17 07:19:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:41.059026 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e94f64-8640-497d-b505-ca89269f6ac7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:41.160112 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e94f64-8640-497d-b505-ca89269f6ac7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:41.196250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9b2b2-24ec-4f30-924b-209e14d59caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:41.196916 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9b2b2-24ec-4f30-924b-209e14d59caf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:41.197197 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9b2b2-24ec-4f30-924b-209e14d59caf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:41.197499 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9b2b2-24ec-4f30-924b-209e14d59caf None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:41.198205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9b2b2-24ec-4f30-924b-209e14d59caf None admin] RBAC: Adding query filter params (type=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:41.198508 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9b2b2-24ec-4f30-924b-209e14d59caf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:41.199885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9b2b2-24ec-4f30-924b-209e14d59caf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:41.204389 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 648/1292] 10.222.0.52 () {56 vars in 1116 bytes} [Fri Jun 17 07:19:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:43.353799 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbff208-4f1b-4283-b197-4564e40ec172 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:43.354437 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbff208-4f1b-4283-b197-4564e40ec172 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:43.354437 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbff208-4f1b-4283-b197-4564e40ec172 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:43.355731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 645/1293] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:43.361140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7989ce-810d-42b3-8164-382c3cd43325 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:43.361637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7989ce-810d-42b3-8164-382c3cd43325 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:43.361741 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7989ce-810d-42b3-8164-382c3cd43325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:43.378682 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bb7989ce-810d-42b3-8164-382c3cd43325 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:43.379889 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bb7989ce-810d-42b3-8164-382c3cd43325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:43.411277 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:43.463326 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 649/1294] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:19:43.486438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbff208-4f1b-4283-b197-4564e40ec172 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:43.519285 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:43.599651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbff208-4f1b-4283-b197-4564e40ec172 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:43.640162 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306912f-4a2f-4cf5-b983-695ab8c9fe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:43.640802 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306912f-4a2f-4cf5-b983-695ab8c9fe3b None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:43.641070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306912f-4a2f-4cf5-b983-695ab8c9fe3b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:43.641373 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306912f-4a2f-4cf5-b983-695ab8c9fe3b None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:43.642103 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306912f-4a2f-4cf5-b983-695ab8c9fe3b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:43.643495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306912f-4a2f-4cf5-b983-695ab8c9fe3b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:43.714874 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 646/1295] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Jun 17 07:19:43 2022] POST /identity/v3/services => generated 246 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:19:45.923541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e39118-2b69-4517-99bb-288e96a2c636 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:45.924129 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e39118-2b69-4517-99bb-288e96a2c636 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:45.924129 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e39118-2b69-4517-99bb-288e96a2c636 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:45.925539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 650/1296] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:45.931537 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc33cb-4180-4e0a-9da7-f508b8b77be0 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:45.931988 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc33cb-4180-4e0a-9da7-f508b8b77be0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:45.932081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc33cb-4180-4e0a-9da7-f508b8b77be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:45.949359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-82bc33cb-4180-4e0a-9da7-f508b8b77be0 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:45.950478 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-82bc33cb-4180-4e0a-9da7-f508b8b77be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:46.025071 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 647/1297] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:19:46.048777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e39118-2b69-4517-99bb-288e96a2c636 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:46.149593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e39118-2b69-4517-99bb-288e96a2c636 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:46.183433 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4139c-eac2-4d0c-aacb-f67c250bf2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:46.184251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4139c-eac2-4d0c-aacb-f67c250bf2ed None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:46.184525 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4139c-eac2-4d0c-aacb-f67c250bf2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:46.184802 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4139c-eac2-4d0c-aacb-f67c250bf2ed None admin] PATH_INFO: `/v3/services/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:46.185496 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4139c-eac2-4d0c-aacb-f67c250bf2ed None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:46.187033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4139c-eac2-4d0c-aacb-f67c250bf2ed None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:46.200356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-36d4139c-eac2-4d0c-aacb-f67c250bf2ed None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:19:46.200356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:46.200356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:19:46.200356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:19:46.200356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:19:46.200356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:19:46.200356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:19:46.200356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:19:46.200356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:19:46.200356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:46.200356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:19:46.200356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:46.200356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:46.200356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:46.200356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:46.200356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:46.200356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:46.201661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:46.201661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:46.201661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:46.201661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:46.201661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:46.201661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:46.201661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:19:46.201661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:19:46.201661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:19:46.201661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:19:46.201661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:46.201661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:46.201661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:46.201661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:46.201661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:46.201661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:46.202918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:46.202918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:46.202918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:46.202918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:46.202918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:46.202918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:46.202918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:46.202918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:46.202918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:46.202918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:46.202918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:19:46.202918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:19:46.202918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:19:46.202918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:46.202918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 651/1298] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Jun 17 07:19:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:46.207612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc33cb-4180-4e0a-9da7-f508b8b77be0 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:46.227342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:46.313971 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc33cb-4180-4e0a-9da7-f508b8b77be0 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:46.348172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc7362-faa1-4347-975d-75903a7e4c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:46.348843 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc7362-faa1-4347-975d-75903a7e4c0f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:46.349123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc7362-faa1-4347-975d-75903a7e4c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:46.349427 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc7362-faa1-4347-975d-75903a7e4c0f None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:46.350133 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc7362-faa1-4347-975d-75903a7e4c0f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:46.350437 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc7362-faa1-4347-975d-75903a7e4c0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:46.352460 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc7362-faa1-4347-975d-75903a7e4c0f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:46.357736 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 648/1299] 10.222.0.52 () {56 vars in 1116 bytes} [Fri Jun 17 07:19:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:46.363699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4139c-eac2-4d0c-aacb-f67c250bf2ed None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:46.396372 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:46.465353 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4139c-eac2-4d0c-aacb-f67c250bf2ed None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:46.498874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c1af8-e4b9-4b1c-bb0c-fd793abce6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:46.499533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c1af8-e4b9-4b1c-bb0c-fd793abce6ac None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:46.499848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c1af8-e4b9-4b1c-bb0c-fd793abce6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:46.500120 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c1af8-e4b9-4b1c-bb0c-fd793abce6ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:46.500899 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c1af8-e4b9-4b1c-bb0c-fd793abce6ac None admin] RBAC: Adding query filter params (interface=public, service_id=5954989e64a042c3aeaa352889af89ee, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:46.501204 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c1af8-e4b9-4b1c-bb0c-fd793abce6ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:46.502593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c1af8-e4b9-4b1c-bb0c-fd793abce6ac None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:46.508448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 652/1300] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Jun 17 07:19:46 2022] GET /identity/v3/endpoints?service_id=5954989e64a042c3aeaa352889af89ee&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:46.514603 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc7362-faa1-4347-975d-75903a7e4c0f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:46.599152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:46.616418 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc7362-faa1-4347-975d-75903a7e4c0f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:46.650323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637023f-e11d-46d3-8309-649958f43a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:46.650976 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637023f-e11d-46d3-8309-649958f43a73 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:46.651254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637023f-e11d-46d3-8309-649958f43a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:46.651523 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637023f-e11d-46d3-8309-649958f43a73 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:46.652193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637023f-e11d-46d3-8309-649958f43a73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:46.653579 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637023f-e11d-46d3-8309-649958f43a73 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:46.661374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 649/1301] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Jun 17 07:19:46 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:19:48.800411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc73329-4a02-4166-b3bc-6b27fb962d57 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:48.800976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc73329-4a02-4166-b3bc-6b27fb962d57 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:48.800976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc73329-4a02-4166-b3bc-6b27fb962d57 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:48.802368 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 653/1302] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:48.808316 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fcdc3-df48-4757-8eb9-4d2ab34caa02 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:48.808755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fcdc3-df48-4757-8eb9-4d2ab34caa02 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:48.808854 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fcdc3-df48-4757-8eb9-4d2ab34caa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:48.825701 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-222fcdc3-df48-4757-8eb9-4d2ab34caa02 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:48.826881 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-222fcdc3-df48-4757-8eb9-4d2ab34caa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:48.893746 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 650/1303] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:19:48.916964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc73329-4a02-4166-b3bc-6b27fb962d57 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:49.011507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:49.018168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc73329-4a02-4166-b3bc-6b27fb962d57 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:49.052188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9ad9a-10ad-4d69-9aea-0dcbac5335e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:49.052961 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9ad9a-10ad-4d69-9aea-0dcbac5335e0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:49.053238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9ad9a-10ad-4d69-9aea-0dcbac5335e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:49.053529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9ad9a-10ad-4d69-9aea-0dcbac5335e0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:49.054194 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9ad9a-10ad-4d69-9aea-0dcbac5335e0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:49.055538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9ad9a-10ad-4d69-9aea-0dcbac5335e0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:49.067188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b8c9ad9a-10ad-4d69-9aea-0dcbac5335e0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:19:49.067188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:49.067188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:19:49.067188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:19:49.067188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:19:49.067188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:19:49.067188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:19:49.067188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:19:49.067188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:19:49.067188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:49.067188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:19:49.067188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:49.067188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:19:49.067188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:19:49.067188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:19:49.067188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:19:49.067188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:19:49.071189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:19:49.071189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:19:49.071189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:19:49.071189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:19:49.071189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:19:49.071189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:19:49.071189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:19:49.071189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:19:49.071189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:19:49.071189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:19:49.071189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:19:49.071189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:19:49.071189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:19:49.071189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:19:49.071189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:19:49.071189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:19:49.072260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:19:49.072260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 17 07:19:49.072260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:19:49.072260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:19:49.072260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:19:49.072260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:19:49.072260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:19:49.072260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:19:49.072260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:19:49.072260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:19:49.072260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:19:49.072260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:19:49.072260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:19:49.072260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 17 07:19:49.072260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 654/1304] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Jun 17 07:19:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:19:49.074539 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fcdc3-df48-4757-8eb9-4d2ab34caa02 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:49.152218 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:49.175024 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fcdc3-df48-4757-8eb9-4d2ab34caa02 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:49.209317 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dec9a-0a21-4593-bea9-c909c381bb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:49.209996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dec9a-0a21-4593-bea9-c909c381bb22 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:49.210828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dec9a-0a21-4593-bea9-c909c381bb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:49.211104 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dec9a-0a21-4593-bea9-c909c381bb22 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:49.211802 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dec9a-0a21-4593-bea9-c909c381bb22 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:19:49.212106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dec9a-0a21-4593-bea9-c909c381bb22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:49.213808 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dec9a-0a21-4593-bea9-c909c381bb22 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:49.218974 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 651/1305] 10.222.0.52 () {56 vars in 1116 bytes} [Fri Jun 17 07:19:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:19:49.224854 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9ad9a-10ad-4d69-9aea-0dcbac5335e0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:49.325497 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9ad9a-10ad-4d69-9aea-0dcbac5335e0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:49.359278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c800e5-c79a-4e84-bc29-7b7f76af7e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:49.359929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c800e5-c79a-4e84-bc29-7b7f76af7e6e None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:49.360208 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c800e5-c79a-4e84-bc29-7b7f76af7e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:49.360482 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c800e5-c79a-4e84-bc29-7b7f76af7e6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:49.361266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c800e5-c79a-4e84-bc29-7b7f76af7e6e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:49.362651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c800e5-c79a-4e84-bc29-7b7f76af7e6e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:49.455698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 655/1306] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Jun 17 07:19:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:19:59.216061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=30 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:59.451032 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:59.121712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e08a81-3435-4c99-b335-11a3939dab0f None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:25:59.122158 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e08a81-3435-4c99-b335-11a3939dab0f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:25:59.122322 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e08a81-3435-4c99-b335-11a3939dab0f None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:25:59.123957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 652/1307] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:25:59.129197 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190569c9-0b01-49de-808f-e2ac4d32b1ea None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:25:59.129652 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190569c9-0b01-49de-808f-e2ac4d32b1ea None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:25:59.129801 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190569c9-0b01-49de-808f-e2ac4d32b1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:25:59.262029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-190569c9-0b01-49de-808f-e2ac4d32b1ea None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:25:59.263240 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-190569c9-0b01-49de-808f-e2ac4d32b1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:25:59.403556 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 656/1308] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:25:59.466099 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c75f4-b662-4365-a068-d81f7aeb31e6 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:25:59.466386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c75f4-b662-4365-a068-d81f7aeb31e6 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:25:59.466827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c75f4-b662-4365-a068-d81f7aeb31e6 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:25:59.468188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 653/1309] 10.222.0.52 () {54 vars in 964 bytes} [Fri Jun 17 07:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:25:59.474589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65f11e-d677-4b6e-8262-b2536527a2ba None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:25:59.474874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65f11e-d677-4b6e-8262-b2536527a2ba None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:25:59.475156 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65f11e-d677-4b6e-8262-b2536527a2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:25:59.563364 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4f65f11e-d677-4b6e-8262-b2536527a2ba None None] MFA Rules not processed for user `ad436c2fecba4754875b7c7cb26852a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:25:59.564576 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4f65f11e-d677-4b6e-8262-b2536527a2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:25:59.588110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:59.652176 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 657/1310] 10.222.0.52 () {58 vars in 1061 bytes} [Fri Jun 17 07:25:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:25:59.661918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c75f4-b662-4365-a068-d81f7aeb31e6 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:25:59.664018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b54c75f4-b662-4365-a068-d81f7aeb31e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:25:59.788650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c75f4-b662-4365-a068-d81f7aeb31e6 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:25:59.866775 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8af697-1408-425d-b4e9-d96da9ed0881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:25:59.867429 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8af697-1408-425d-b4e9-d96da9ed0881 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:25:59.867710 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8af697-1408-425d-b4e9-d96da9ed0881 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:25:59.867984 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8af697-1408-425d-b4e9-d96da9ed0881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:25:59.869661 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8e8af697-1408-425d-b4e9-d96da9ed0881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:25:59.928342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:59.987203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8af697-1408-425d-b4e9-d96da9ed0881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:25:59.988674 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8af697-1408-425d-b4e9-d96da9ed0881 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:26:00.009197 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 654/1311] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:26:02.492735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3c31e-6bfe-40e6-946a-615f4f88a14d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:02.493899 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3c31e-6bfe-40e6-946a-615f4f88a14d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:02.493899 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3c31e-6bfe-40e6-946a-615f4f88a14d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:02.495801 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 658/1312] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:02.501147 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599784b-0737-450f-b285-ce26c4d1ac0b None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:02.501638 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599784b-0737-450f-b285-ce26c4d1ac0b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:02.501819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599784b-0737-450f-b285-ce26c4d1ac0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:02.575599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d599784b-0737-450f-b285-ce26c4d1ac0b None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:02.576817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d599784b-0737-450f-b285-ce26c4d1ac0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:02.690786 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 655/1313] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:26:02.730710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3c31e-6bfe-40e6-946a-615f4f88a14d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:26:02.732359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-55d3c31e-6bfe-40e6-946a-615f4f88a14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:02.850373 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3c31e-6bfe-40e6-946a-615f4f88a14d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:26:02.921288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:02.923551 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf32d84-748c-479a-8129-c39786eb33ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:26:02.924197 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf32d84-748c-479a-8129-c39786eb33ed service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:02.924483 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf32d84-748c-479a-8129-c39786eb33ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:02.924763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf32d84-748c-479a-8129-c39786eb33ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:02.926436 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8cf32d84-748c-479a-8129-c39786eb33ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:03.038258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf32d84-748c-479a-8129-c39786eb33ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:26:03.039769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf32d84-748c-479a-8129-c39786eb33ed service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:26:03.060467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 659/1314] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:26:05.738033 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb14896-d864-4ade-a555-cb67e822355e None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:05.738539 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb14896-d864-4ade-a555-cb67e822355e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:05.738649 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb14896-d864-4ade-a555-cb67e822355e None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:05.740021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 656/1315] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:05.745395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485660b-54c4-4357-a268-ec82daabea56 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:05.745837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485660b-54c4-4357-a268-ec82daabea56 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:05.746013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485660b-54c4-4357-a268-ec82daabea56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:05.810697 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1485660b-54c4-4357-a268-ec82daabea56 None None] MFA Rules not processed for user `30b6406c9904428284345736fa549292`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:05.811894 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1485660b-54c4-4357-a268-ec82daabea56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:05.863533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:05.906508 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 660/1316] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:26:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:26:05.946221 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb14896-d864-4ade-a555-cb67e822355e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:26:05.947847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2fb14896-d864-4ade-a555-cb67e822355e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:05.958285 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:06.053101 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb14896-d864-4ade-a555-cb67e822355e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:26:06.127038 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f78555-bf1d-4449-83a6-6b80a4d17716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:26:06.127676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f78555-bf1d-4449-83a6-6b80a4d17716 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:06.127952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f78555-bf1d-4449-83a6-6b80a4d17716 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:06.128220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f78555-bf1d-4449-83a6-6b80a4d17716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:06.129864 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b8f78555-bf1d-4449-83a6-6b80a4d17716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:06.191710 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:06.237971 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f78555-bf1d-4449-83a6-6b80a4d17716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:26:06.239439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f78555-bf1d-4449-83a6-6b80a4d17716 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:26:06.258106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 657/1317] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:26:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:26:09.229589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd174d-1cba-44f0-915c-1c9b71fd611e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:09.230120 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd174d-1cba-44f0-915c-1c9b71fd611e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:09.230120 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd174d-1cba-44f0-915c-1c9b71fd611e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:09.231484 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 661/1318] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:09.236566 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a655ae8-6fff-4ef7-b262-03a8043e9443 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:09.236979 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a655ae8-6fff-4ef7-b262-03a8043e9443 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:09.237122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a655ae8-6fff-4ef7-b262-03a8043e9443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:09.300455 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6a655ae8-6fff-4ef7-b262-03a8043e9443 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:09.301603 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6a655ae8-6fff-4ef7-b262-03a8043e9443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:09.395820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 658/1319] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:26:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:26:09.435311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd174d-1cba-44f0-915c-1c9b71fd611e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:26:09.436848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2cdd174d-1cba-44f0-915c-1c9b71fd611e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:09.539194 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd174d-1cba-44f0-915c-1c9b71fd611e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:26:09.610784 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c8bf4-ebe1-4dec-b284-5048e8fe8321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:26:09.611432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c8bf4-ebe1-4dec-b284-5048e8fe8321 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:09.611714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c8bf4-ebe1-4dec-b284-5048e8fe8321 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:09.611983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c8bf4-ebe1-4dec-b284-5048e8fe8321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:09.616040 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-734c8bf4-ebe1-4dec-b284-5048e8fe8321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:09.622116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:09.726049 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c8bf4-ebe1-4dec-b284-5048e8fe8321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:26:09.727495 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c8bf4-ebe1-4dec-b284-5048e8fe8321 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:26:09.746421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 662/1320] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:26:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:26:12.961263 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d82474-d482-454c-8652-f9ebc80709b0 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:12.961838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d82474-d482-454c-8652-f9ebc80709b0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:12.961838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d82474-d482-454c-8652-f9ebc80709b0 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:12.963928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 659/1321] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:12.969381 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42227330-21ec-4119-85ff-3f07cd0b8f2d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:12.969776 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42227330-21ec-4119-85ff-3f07cd0b8f2d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:12.969948 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42227330-21ec-4119-85ff-3f07cd0b8f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:13.038369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-42227330-21ec-4119-85ff-3f07cd0b8f2d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:13.039615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-42227330-21ec-4119-85ff-3f07cd0b8f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:13.104749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:13.147164 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 663/1322] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:26:13.185020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d82474-d482-454c-8652-f9ebc80709b0 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:26:13.186964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-86d82474-d482-454c-8652-f9ebc80709b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:13.207177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:13.294019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d82474-d482-454c-8652-f9ebc80709b0 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:26:13.365557 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e376dd7-e51d-4fc0-b815-c7492a972bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:26:13.366210 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376dd7-e51d-4fc0-b815-c7492a972bbf service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:13.366504 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376dd7-e51d-4fc0-b815-c7492a972bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:13.366770 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376dd7-e51d-4fc0-b815-c7492a972bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:13.368405 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6e376dd7-e51d-4fc0-b815-c7492a972bbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:13.442800 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:13.481841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e376dd7-e51d-4fc0-b815-c7492a972bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:26:13.483295 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e376dd7-e51d-4fc0-b815-c7492a972bbf service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:26:13.501802 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 660/1323] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:26:15.730380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa3772-2d07-483b-a312-f57ef4b7aff2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:15.730952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa3772-2d07-483b-a312-f57ef4b7aff2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:15.730952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa3772-2d07-483b-a312-f57ef4b7aff2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:15.732492 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 664/1324] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:15.737678 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c530c5-5431-4372-bb5a-64be3f79fcde None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:15.738165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c530c5-5431-4372-bb5a-64be3f79fcde None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:15.738271 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c530c5-5431-4372-bb5a-64be3f79fcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:15.802361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-04c530c5-5431-4372-bb5a-64be3f79fcde None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:15.803544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-04c530c5-5431-4372-bb5a-64be3f79fcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:15.901034 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 661/1325] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:26:15.937580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa3772-2d07-483b-a312-f57ef4b7aff2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:26:15.939102 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-38aa3772-2d07-483b-a312-f57ef4b7aff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:16.048811 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa3772-2d07-483b-a312-f57ef4b7aff2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:26:16.126153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0dfe5-6e7e-4099-8b7f-81fb5fbd3d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:26:16.126802 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0dfe5-6e7e-4099-8b7f-81fb5fbd3d00 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:16.127082 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0dfe5-6e7e-4099-8b7f-81fb5fbd3d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:16.127357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0dfe5-6e7e-4099-8b7f-81fb5fbd3d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:16.128993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-84b0dfe5-6e7e-4099-8b7f-81fb5fbd3d00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:16.146375 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:16.249624 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0dfe5-6e7e-4099-8b7f-81fb5fbd3d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:26:16.251099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0dfe5-6e7e-4099-8b7f-81fb5fbd3d00 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:26:16.269284 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 665/1326] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:26:18.507058 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607b369-effe-46c9-9446-c2513a31cbc4 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:18.507616 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607b369-effe-46c9-9446-c2513a31cbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:18.507616 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607b369-effe-46c9-9446-c2513a31cbc4 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:18.508992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 662/1327] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:18.514507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03eb01-a56b-4054-a3fa-55cf49ca0157 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:18.514928 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03eb01-a56b-4054-a3fa-55cf49ca0157 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:18.515180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03eb01-a56b-4054-a3fa-55cf49ca0157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:18.582113 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8e03eb01-a56b-4054-a3fa-55cf49ca0157 None None] MFA Rules not processed for user `30b6406c9904428284345736fa549292`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:18.583331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8e03eb01-a56b-4054-a3fa-55cf49ca0157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:18.648574 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:18.684993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 666/1328] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:26:18 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:26:18.723866 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607b369-effe-46c9-9446-c2513a31cbc4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:26:18.725406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c607b369-effe-46c9-9446-c2513a31cbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:18.773471 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:18.852892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607b369-effe-46c9-9446-c2513a31cbc4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:26:18.927760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed993982-ceb4-47a7-a980-cfbda481b7f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:26:18.928434 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed993982-ceb4-47a7-a980-cfbda481b7f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:18.928707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed993982-ceb4-47a7-a980-cfbda481b7f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:18.928976 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed993982-ceb4-47a7-a980-cfbda481b7f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:18.930643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ed993982-ceb4-47a7-a980-cfbda481b7f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:19.008415 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:19.039606 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed993982-ceb4-47a7-a980-cfbda481b7f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:26:19.041146 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed993982-ceb4-47a7-a980-cfbda481b7f1 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:26:19.063433 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 663/1329] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:26:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:26:21.665341 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201276e-0320-4b1c-b5c7-c72c5769e09d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:21.665925 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201276e-0320-4b1c-b5c7-c72c5769e09d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:21.665925 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201276e-0320-4b1c-b5c7-c72c5769e09d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:21.670219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 667/1330] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:21.672703 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606efc4-01e6-47a4-a450-1ad18116ccb0 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:21.676218 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606efc4-01e6-47a4-a450-1ad18116ccb0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:21.676218 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606efc4-01e6-47a4-a450-1ad18116ccb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:21.739224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d606efc4-01e6-47a4-a450-1ad18116ccb0 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:21.740419 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d606efc4-01e6-47a4-a450-1ad18116ccb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:21.836604 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 664/1331] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:26:21.872719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201276e-0320-4b1c-b5c7-c72c5769e09d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:26:21.874263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1201276e-0320-4b1c-b5c7-c72c5769e09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:21.982744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201276e-0320-4b1c-b5c7-c72c5769e09d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:26:22.060748 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e36e3-e8d3-4006-8514-9e7182c5c629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:26:22.061425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e36e3-e8d3-4006-8514-9e7182c5c629 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:22.061709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e36e3-e8d3-4006-8514-9e7182c5c629 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:22.061983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e36e3-e8d3-4006-8514-9e7182c5c629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:22.063597 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1c0e36e3-e8d3-4006-8514-9e7182c5c629 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:22.092751 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:22.180826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e36e3-e8d3-4006-8514-9e7182c5c629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:26:22.183324 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e36e3-e8d3-4006-8514-9e7182c5c629 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:26:22.201612 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 668/1332] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:26:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:26:24.345680 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0b207-ec1b-45e7-9925-feb934748a7f None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:24.346330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0b207-ec1b-45e7-9925-feb934748a7f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:24.346330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0b207-ec1b-45e7-9925-feb934748a7f None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:24.347593 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 665/1333] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:24.352690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01924960-ae62-4274-8eec-6cb73bcddd49 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:24.353088 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01924960-ae62-4274-8eec-6cb73bcddd49 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:24.353243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01924960-ae62-4274-8eec-6cb73bcddd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:24.419354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-01924960-ae62-4274-8eec-6cb73bcddd49 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:24.420565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-01924960-ae62-4274-8eec-6cb73bcddd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:24.493937 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:24.517118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 669/1334] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:26:24.556267 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0b207-ec1b-45e7-9925-feb934748a7f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:26:24.557956 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-46c0b207-ec1b-45e7-9925-feb934748a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:24.598200 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:24.662877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0b207-ec1b-45e7-9925-feb934748a7f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:26:24.736987 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b85b5-a11f-4f1a-ad28-c720e6936883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:26:24.737728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b85b5-a11f-4f1a-ad28-c720e6936883 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:24.738012 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b85b5-a11f-4f1a-ad28-c720e6936883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:24.738283 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b85b5-a11f-4f1a-ad28-c720e6936883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:24.739916 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b25b85b5-a11f-4f1a-ad28-c720e6936883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:24.823051 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:24.848851 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b85b5-a11f-4f1a-ad28-c720e6936883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:26:24.850294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b85b5-a11f-4f1a-ad28-c720e6936883 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:26:24.868975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 666/1335] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:26:27.592745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8c8b1-081c-49ff-bf08-abd4b9e771b8 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:27.593289 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8c8b1-081c-49ff-bf08-abd4b9e771b8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:27.593596 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8c8b1-081c-49ff-bf08-abd4b9e771b8 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:27.594963 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 670/1336] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:27.600174 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52fcaa-9347-4701-8782-31e87b5130ef None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:27.600582 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52fcaa-9347-4701-8782-31e87b5130ef None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:27.600730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52fcaa-9347-4701-8782-31e87b5130ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:27.667307 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-ad52fcaa-9347-4701-8782-31e87b5130ef None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:27.668526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ad52fcaa-9347-4701-8782-31e87b5130ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:27.764493 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 667/1337] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:26:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:26:27.815505 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00b873-de49-4585-af7d-880fc04b7fea None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:27.815790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00b873-de49-4585-af7d-880fc04b7fea None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:27.816068 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00b873-de49-4585-af7d-880fc04b7fea None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:27.817495 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 671/1338] 10.222.0.52 () {54 vars in 964 bytes} [Fri Jun 17 07:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:27.823426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e062e-3869-4246-a73f-2653912760b5 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:27.823711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e062e-3869-4246-a73f-2653912760b5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:27.823991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e062e-3869-4246-a73f-2653912760b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:27.876930 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:27.898397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-920e062e-3869-4246-a73f-2653912760b5 None None] MFA Rules not processed for user `ad436c2fecba4754875b7c7cb26852a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:27.899598 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-920e062e-3869-4246-a73f-2653912760b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:27.974928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 668/1339] 10.222.0.52 () {58 vars in 1061 bytes} [Fri Jun 17 07:26:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:26:27.984671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00b873-de49-4585-af7d-880fc04b7fea None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:26:27.986225 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-be00b873-de49-4585-af7d-880fc04b7fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:28.088807 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00b873-de49-4585-af7d-880fc04b7fea None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:26:28.162342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e6466-4a45-4e11-984b-9f042b5191d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:26:28.162918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e6466-4a45-4e11-984b-9f042b5191d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:28.163199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e6466-4a45-4e11-984b-9f042b5191d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:28.163471 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e6466-4a45-4e11-984b-9f042b5191d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:28.165102 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dd2e6466-4a45-4e11-984b-9f042b5191d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:28.201191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:28.274194 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e6466-4a45-4e11-984b-9f042b5191d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:26:28.275777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e6466-4a45-4e11-984b-9f042b5191d1 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:26:28.295879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 672/1340] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:26:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:26:33.158202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb8fbd-f58a-47d4-b157-2a1683bd477f None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:33.158727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb8fbd-f58a-47d4-b157-2a1683bd477f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:33.158822 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb8fbd-f58a-47d4-b157-2a1683bd477f None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:33.160315 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 669/1341] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:33.165471 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e628a-5a4a-46eb-8a61-3c13cba01991 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:33.165875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e628a-5a4a-46eb-8a61-3c13cba01991 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:33.166921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e628a-5a4a-46eb-8a61-3c13cba01991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:33.237765 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-672e628a-5a4a-46eb-8a61-3c13cba01991 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:33.238982 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-672e628a-5a4a-46eb-8a61-3c13cba01991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:33.331338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:33.344636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 673/1342] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:26:33.383861 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb8fbd-f58a-47d4-b157-2a1683bd477f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:26:33.386527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3beb8fbd-f58a-47d4-b157-2a1683bd477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:33.485950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb8fbd-f58a-47d4-b157-2a1683bd477f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:26:33.489683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e6020-d204-4e8d-b992-65116fb9a94d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:26:33.490448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e6020-d204-4e8d-b992-65116fb9a94d service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:33.490801 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e6020-d204-4e8d-b992-65116fb9a94d service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:33.491078 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e6020-d204-4e8d-b992-65116fb9a94d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:33.500383 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e6020-d204-4e8d-b992-65116fb9a94d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:26:33.501895 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e6020-d204-4e8d-b992-65116fb9a94d service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:26:33.512230 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 670/1343] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:26:36.644212 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca579-5075-444d-aa0e-aecb972ed3e1 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:36.644777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca579-5075-444d-aa0e-aecb972ed3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:36.644777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca579-5075-444d-aa0e-aecb972ed3e1 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:36.646171 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 674/1344] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:36.651657 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f9d0f-86ea-4348-813b-9b0a82562ef2 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:36.652098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f9d0f-86ea-4348-813b-9b0a82562ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:36.652210 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f9d0f-86ea-4348-813b-9b0a82562ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:36.680690 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d74f9d0f-86ea-4348-813b-9b0a82562ef2 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:36.683342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d74f9d0f-86ea-4348-813b-9b0a82562ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:36.710797 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:36.759590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 671/1345] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:26:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:26:36.796608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ca579-5075-444d-aa0e-aecb972ed3e1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:26:36.798320 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-687ca579-5075-444d-aa0e-aecb972ed3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:36.812008 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ca579-5075-444d-aa0e-aecb972ed3e1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:26:36.815441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54dc4b-59b8-4bb8-81ec-1f45957345c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:26:36.816136 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54dc4b-59b8-4bb8-81ec-1f45957345c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:36.816415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54dc4b-59b8-4bb8-81ec-1f45957345c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:36.816690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54dc4b-59b8-4bb8-81ec-1f45957345c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:36.825664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54dc4b-59b8-4bb8-81ec-1f45957345c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:26:36.827099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54dc4b-59b8-4bb8-81ec-1f45957345c1 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:26:36.836588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 675/1346] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:26:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:26:41.419697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e547b0b-49f9-429f-a927-f40058e4d31b None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:41.420200 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e547b0b-49f9-429f-a927-f40058e4d31b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:41.420300 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e547b0b-49f9-429f-a927-f40058e4d31b None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:41.421688 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 672/1347] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:41.427129 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee7873-b290-4ae4-82d3-d58143a3b186 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:41.427596 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee7873-b290-4ae4-82d3-d58143a3b186 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:41.427693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee7873-b290-4ae4-82d3-d58143a3b186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:41.450827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-21ee7873-b290-4ae4-82d3-d58143a3b186 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:41.452189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-21ee7873-b290-4ae4-82d3-d58143a3b186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:41.461358 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 676/1348] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:26:41.499060 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e547b0b-49f9-429f-a927-f40058e4d31b None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:26:41.510628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e547b0b-49f9-429f-a927-f40058e4d31b None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:26:41.514601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acf33c-9d4e-4850-a685-f024682a7726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:26:41.515596 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acf33c-9d4e-4850-a685-f024682a7726 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:41.515700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acf33c-9d4e-4850-a685-f024682a7726 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:41.515976 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acf33c-9d4e-4850-a685-f024682a7726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:41.525864 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acf33c-9d4e-4850-a685-f024682a7726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:26:41.527342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acf33c-9d4e-4850-a685-f024682a7726 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:26:41.538031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 673/1349] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:26:46.662000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a962f-0b8f-40ef-ac1b-9d5d3c2e2a69 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:46.663008 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a962f-0b8f-40ef-ac1b-9d5d3c2e2a69 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:46.663604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a962f-0b8f-40ef-ac1b-9d5d3c2e2a69 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:46.666766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 677/1350] 10.222.0.52 () {54 vars in 921 bytes} [Fri Jun 17 07:26:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:46.672520 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57296d-ce73-4894-98de-a73ce6353d24 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:46.673492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57296d-ce73-4894-98de-a73ce6353d24 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:46.674007 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57296d-ce73-4894-98de-a73ce6353d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:46.749366 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-1a57296d-ce73-4894-98de-a73ce6353d24 None None] MFA Rules not processed for user `71adc8b93e5c41929b928002e004df6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:46.750998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-1a57296d-ce73-4894-98de-a73ce6353d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:46.847323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 674/1351] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Jun 17 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:26:50.981053 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea9f0d-8d8b-4a52-9321-de6ee2e70e21 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:50.981710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea9f0d-8d8b-4a52-9321-de6ee2e70e21 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:50.981710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea9f0d-8d8b-4a52-9321-de6ee2e70e21 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:50.983151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 678/1352] 10.222.0.52 () {54 vars in 921 bytes} [Fri Jun 17 07:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:50.988129 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21332ece-358d-4f81-9c0b-5d61fcd894ed None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:50.988565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21332ece-358d-4f81-9c0b-5d61fcd894ed None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:50.988666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21332ece-358d-4f81-9c0b-5d61fcd894ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:51.008356 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-21332ece-358d-4f81-9c0b-5d61fcd894ed None None] MFA Rules not processed for user `71adc8b93e5c41929b928002e004df6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:51.009664 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-21332ece-358d-4f81-9c0b-5d61fcd894ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:51.018617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 675/1353] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Jun 17 07:26:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:26:51.444678 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=13 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:52.600397 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919b822-bc4c-491a-8c51-cc1b3814edae None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:52.601041 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919b822-bc4c-491a-8c51-cc1b3814edae None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:52.601041 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919b822-bc4c-491a-8c51-cc1b3814edae None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:52.602350 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 679/1354] 10.222.0.52 () {54 vars in 921 bytes} [Fri Jun 17 07:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:52.607855 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a0baa-b9b7-45f4-946e-25ed4f92f448 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:52.608286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a0baa-b9b7-45f4-946e-25ed4f92f448 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:52.608581 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a0baa-b9b7-45f4-946e-25ed4f92f448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:52.626953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-842a0baa-b9b7-45f4-946e-25ed4f92f448 None None] MFA Rules not processed for user `71adc8b93e5c41929b928002e004df6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:52.628230 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-842a0baa-b9b7-45f4-946e-25ed4f92f448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:52.637603 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 676/1355] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Jun 17 07:26:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:26:56.668758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393654e-8c90-40e0-8eb3-d0f9b0e93293 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:56.669630 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393654e-8c90-40e0-8eb3-d0f9b0e93293 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:56.670056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393654e-8c90-40e0-8eb3-d0f9b0e93293 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:56.673001 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 680/1356] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:26:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:56.676927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98ea3c-f1b1-4722-8ce1-77043d61735e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:56.677785 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98ea3c-f1b1-4722-8ce1-77043d61735e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:56.678223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98ea3c-f1b1-4722-8ce1-77043d61735e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:56.697872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4c98ea3c-f1b1-4722-8ce1-77043d61735e None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:56.699084 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4c98ea3c-f1b1-4722-8ce1-77043d61735e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:56.707687 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 677/1357] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:26:56.766713 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6dab5-a90d-42fb-ae79-2f8a30ee1e18 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:56.767251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6dab5-a90d-42fb-ae79-2f8a30ee1e18 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:56.767704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6dab5-a90d-42fb-ae79-2f8a30ee1e18 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:56.769569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 681/1358] 10.222.0.52 () {54 vars in 961 bytes} [Fri Jun 17 07:26:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:56.780356 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20cb4d-47e8-4ffb-aac8-99a89be4d342 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:56.785400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20cb4d-47e8-4ffb-aac8-99a89be4d342 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:56.785400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20cb4d-47e8-4ffb-aac8-99a89be4d342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:56.841425 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:56.850942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4b20cb4d-47e8-4ffb-aac8-99a89be4d342 None None] MFA Rules not processed for user `88e1572d22c048b09699a2fe50900f92`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:56.852969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4b20cb4d-47e8-4ffb-aac8-99a89be4d342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:56.943118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 678/1359] 10.222.0.52 () {58 vars in 1058 bytes} [Fri Jun 17 07:26:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:26:56.952781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6dab5-a90d-42fb-ae79-2f8a30ee1e18 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:26:56.968035 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6dab5-a90d-42fb-ae79-2f8a30ee1e18 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:26:56.973441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7840356-5a3f-48e6-bf62-9c57926a0b4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:26:56.974087 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7840356-5a3f-48e6-bf62-9c57926a0b4a service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:56.974380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7840356-5a3f-48e6-bf62-9c57926a0b4a service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:56.974639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7840356-5a3f-48e6-bf62-9c57926a0b4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:56.983797 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7840356-5a3f-48e6-bf62-9c57926a0b4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:26:56.993596 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7840356-5a3f-48e6-bf62-9c57926a0b4a service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:26:56.996061 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 682/1360] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:26:59.334597 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6479cc8-07e1-4753-b5ca-a02ff074bb53 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:59.335112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6479cc8-07e1-4753-b5ca-a02ff074bb53 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:59.335112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6479cc8-07e1-4753-b5ca-a02ff074bb53 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:59.336439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 679/1361] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:26:59.341839 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de63b1d-783a-4959-b415-221a5892de57 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:59.342313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de63b1d-783a-4959-b415-221a5892de57 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:59.342417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de63b1d-783a-4959-b415-221a5892de57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:59.360250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5de63b1d-783a-4959-b415-221a5892de57 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:26:59.361522 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5de63b1d-783a-4959-b415-221a5892de57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:26:59.370748 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 683/1362] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:26:59.416262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6479cc8-07e1-4753-b5ca-a02ff074bb53 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:26:59.434904 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6479cc8-07e1-4753-b5ca-a02ff074bb53 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:26:59.440824 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd42be-74fa-4a36-974b-faa1da010627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:26:59.441559 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd42be-74fa-4a36-974b-faa1da010627 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:26:59.441846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd42be-74fa-4a36-974b-faa1da010627 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:26:59.442125 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd42be-74fa-4a36-974b-faa1da010627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:26:59.452257 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd42be-74fa-4a36-974b-faa1da010627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:26:59.453920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd42be-74fa-4a36-974b-faa1da010627 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:26:59.465229 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 680/1363] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:26:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:02.078291 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540aff0-44de-4bfe-9d33-1ce266ba7e2a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:02.078802 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540aff0-44de-4bfe-9d33-1ce266ba7e2a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:02.078895 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540aff0-44de-4bfe-9d33-1ce266ba7e2a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:02.080238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 684/1364] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:02.085308 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e132d1-725e-4893-bdd0-1fdfa3669a71 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:02.085733 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e132d1-725e-4893-bdd0-1fdfa3669a71 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:02.085896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e132d1-725e-4893-bdd0-1fdfa3669a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:02.104664 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c6e132d1-725e-4893-bdd0-1fdfa3669a71 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:02.105889 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c6e132d1-725e-4893-bdd0-1fdfa3669a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:02.113748 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 681/1365] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:02.160651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4c4ed-0d01-4116-9834-f7bf2b6e6471 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:02.160831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4c4ed-0d01-4116-9834-f7bf2b6e6471 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:02.161112 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4c4ed-0d01-4116-9834-f7bf2b6e6471 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:02.162513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 685/1366] 10.222.0.52 () {54 vars in 961 bytes} [Fri Jun 17 07:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:02.167959 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5911e-2682-4ac5-b8d9-ddd90772a32c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:02.168245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5911e-2682-4ac5-b8d9-ddd90772a32c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:02.169753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5911e-2682-4ac5-b8d9-ddd90772a32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:02.188108 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-17e5911e-2682-4ac5-b8d9-ddd90772a32c None None] MFA Rules not processed for user `88e1572d22c048b09699a2fe50900f92`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:02.189283 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-17e5911e-2682-4ac5-b8d9-ddd90772a32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:02.199608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 682/1367] 10.222.0.52 () {58 vars in 1058 bytes} [Fri Jun 17 07:27:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:27:02.207448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4c4ed-0d01-4116-9834-f7bf2b6e6471 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:02.222694 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4c4ed-0d01-4116-9834-f7bf2b6e6471 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:02.228038 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0d49e-40e2-40f5-a723-ac655ee332e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:02.228680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0d49e-40e2-40f5-a723-ac655ee332e9 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:02.228965 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0d49e-40e2-40f5-a723-ac655ee332e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:02.229245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0d49e-40e2-40f5-a723-ac655ee332e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:02.237612 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0d49e-40e2-40f5-a723-ac655ee332e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:02.239189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0d49e-40e2-40f5-a723-ac655ee332e9 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:02.249153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 686/1368] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:05.031584 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454f37d-f27d-4bb1-bc4a-bc87177b92dc None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:05.032124 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454f37d-f27d-4bb1-bc4a-bc87177b92dc None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:05.032124 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454f37d-f27d-4bb1-bc4a-bc87177b92dc None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:05.033430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 683/1369] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:27:05.038639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed3653-7da8-4df4-a120-cd0de4d270a3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:05.039047 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed3653-7da8-4df4-a120-cd0de4d270a3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:05.039193 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed3653-7da8-4df4-a120-cd0de4d270a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:05.057281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-42ed3653-7da8-4df4-a120-cd0de4d270a3 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:05.058485 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-42ed3653-7da8-4df4-a120-cd0de4d270a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:05.066387 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 687/1370] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:05.307412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea794d6-bff2-4e22-92f1-7777714d87ab None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:05.307614 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea794d6-bff2-4e22-92f1-7777714d87ab None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:05.307870 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea794d6-bff2-4e22-92f1-7777714d87ab None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:05.309532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 684/1371] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:27:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:05.314921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d684d2-763d-4c19-8976-9f64e16dc17c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:05.315209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d684d2-763d-4c19-8976-9f64e16dc17c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:05.315479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d684d2-763d-4c19-8976-9f64e16dc17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:05.334313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-87d684d2-763d-4c19-8976-9f64e16dc17c None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:05.335491 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-87d684d2-763d-4c19-8976-9f64e16dc17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:05.343415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 688/1372] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:05.364937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5f5a1-e81a-4442-8432-88e7ecb9eec2 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:05.364937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5f5a1-e81a-4442-8432-88e7ecb9eec2 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:05.364937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5f5a1-e81a-4442-8432-88e7ecb9eec2 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:05.366929 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 685/1373] 10.222.0.52 () {54 vars in 963 bytes} [Fri Jun 17 07:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:05.371843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0a2ef-b626-45a2-8cdb-f4a15804b4c7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:05.372128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0a2ef-b626-45a2-8cdb-f4a15804b4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:05.372408 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0a2ef-b626-45a2-8cdb-f4a15804b4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:05.389368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5f5a1-e81a-4442-8432-88e7ecb9eec2 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:05.404548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5f5a1-e81a-4442-8432-88e7ecb9eec2 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:05.410471 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c6275-c74b-48f9-af79-3cc3994fcf78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:05.411316 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c6275-c74b-48f9-af79-3cc3994fcf78 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:05.411746 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c6275-c74b-48f9-af79-3cc3994fcf78 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:05.412172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c6275-c74b-48f9-af79-3cc3994fcf78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:05.421302 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c6275-c74b-48f9-af79-3cc3994fcf78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:05.423144 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c6275-c74b-48f9-af79-3cc3994fcf78 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:05.429012 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e1f0a2ef-b626-45a2-8cdb-f4a15804b4c7 None None] MFA Rules not processed for user `afefcf9ac054459c9585d8be3c604fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:05.430233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e1f0a2ef-b626-45a2-8cdb-f4a15804b4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:05.434314 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 686/1374] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:27:05.494937 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 689/1375] 10.222.0.52 () {58 vars in 1060 bytes} [Fri Jun 17 07:27:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:05.502478 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c6275-c74b-48f9-af79-3cc3994fcf78 service nova] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:05.512566 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c6275-c74b-48f9-af79-3cc3994fcf78 service nova] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:05.516281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b2cf3-372f-436e-8a24-3c33d19ea885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:05.516959 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b2cf3-372f-436e-8a24-3c33d19ea885 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:05.517280 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b2cf3-372f-436e-8a24-3c33d19ea885 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:05.517578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b2cf3-372f-436e-8a24-3c33d19ea885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:05.527611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b2cf3-372f-436e-8a24-3c33d19ea885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:05.528561 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b2cf3-372f-436e-8a24-3c33d19ea885 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:05.544051 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 687/1376] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:07.751076 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44695d-95f8-4eb6-8205-1578d3b49cd1 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:07.751543 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44695d-95f8-4eb6-8205-1578d3b49cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:07.751653 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44695d-95f8-4eb6-8205-1578d3b49cd1 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:07.752997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 690/1377] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:27:07.758462 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dcd41-b0d0-4b9f-9be3-bcb16b620f5b None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:07.758900 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dcd41-b0d0-4b9f-9be3-bcb16b620f5b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:07.759202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dcd41-b0d0-4b9f-9be3-bcb16b620f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:07.778457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-470dcd41-b0d0-4b9f-9be3-bcb16b620f5b None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:07.779636 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-470dcd41-b0d0-4b9f-9be3-bcb16b620f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:07.788166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 688/1378] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:07.832488 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44695d-95f8-4eb6-8205-1578d3b49cd1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:07.847792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44695d-95f8-4eb6-8205-1578d3b49cd1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:07.854023 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bf44d-3554-4cf0-8f86-7f20fc94f1f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:07.854670 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bf44d-3554-4cf0-8f86-7f20fc94f1f9 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:07.854974 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bf44d-3554-4cf0-8f86-7f20fc94f1f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:07.855243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bf44d-3554-4cf0-8f86-7f20fc94f1f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:07.864363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bf44d-3554-4cf0-8f86-7f20fc94f1f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:07.865855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bf44d-3554-4cf0-8f86-7f20fc94f1f9 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:07.875978 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 691/1379] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:10.216223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57c465-6c13-40a7-bdce-31e5f3b69db5 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:10.216913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57c465-6c13-40a7-bdce-31e5f3b69db5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:10.216913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57c465-6c13-40a7-bdce-31e5f3b69db5 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:10.218510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 689/1380] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:10.224338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6b76b-8d29-42cc-a916-dcd09f4d43ea None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:10.224761 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6b76b-8d29-42cc-a916-dcd09f4d43ea None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:10.225126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6b76b-8d29-42cc-a916-dcd09f4d43ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:10.246160 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a8f6b76b-8d29-42cc-a916-dcd09f4d43ea None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:10.247371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a8f6b76b-8d29-42cc-a916-dcd09f4d43ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:10.255626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 692/1381] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:10.299849 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57c465-6c13-40a7-bdce-31e5f3b69db5 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:10.316238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57c465-6c13-40a7-bdce-31e5f3b69db5 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:10.321744 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23cc45-ab23-4814-9f91-a724494b0688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:10.322481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23cc45-ab23-4814-9f91-a724494b0688 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:10.322946 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23cc45-ab23-4814-9f91-a724494b0688 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:10.323360 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23cc45-ab23-4814-9f91-a724494b0688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:10.332690 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23cc45-ab23-4814-9f91-a724494b0688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:10.334702 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23cc45-ab23-4814-9f91-a724494b0688 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:10.344768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 690/1382] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:12.718148 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ee993-8131-4947-a54d-0447947cb7a9 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:12.718740 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ee993-8131-4947-a54d-0447947cb7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:12.718740 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ee993-8131-4947-a54d-0447947cb7a9 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:12.720047 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 693/1383] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:12.725183 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090ab35-9f7e-4665-b6e1-35fedd0fd256 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:12.725646 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090ab35-9f7e-4665-b6e1-35fedd0fd256 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:12.725763 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090ab35-9f7e-4665-b6e1-35fedd0fd256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:12.744181 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6090ab35-9f7e-4665-b6e1-35fedd0fd256 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:12.745395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6090ab35-9f7e-4665-b6e1-35fedd0fd256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:12.753474 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 691/1384] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:12.796777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ee993-8131-4947-a54d-0447947cb7a9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:12.812561 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ee993-8131-4947-a54d-0447947cb7a9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:12.818288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa8c09-5dc2-4764-890e-81b059518272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:12.818925 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa8c09-5dc2-4764-890e-81b059518272 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:12.819204 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa8c09-5dc2-4764-890e-81b059518272 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:12.819476 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa8c09-5dc2-4764-890e-81b059518272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:12.828249 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa8c09-5dc2-4764-890e-81b059518272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:12.829874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa8c09-5dc2-4764-890e-81b059518272 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:12.840748 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 694/1385] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:27:15.209151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887675b7-f571-4db1-b682-8c91f7332e29 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:15.209737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887675b7-f571-4db1-b682-8c91f7332e29 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:15.209737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887675b7-f571-4db1-b682-8c91f7332e29 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:15.211090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 692/1386] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:15.216997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e23b3-e096-4777-b4ef-ae6f6a43d066 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:15.217609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e23b3-e096-4777-b4ef-ae6f6a43d066 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:15.217782 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e23b3-e096-4777-b4ef-ae6f6a43d066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:15.237005 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d24e23b3-e096-4777-b4ef-ae6f6a43d066 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:15.238316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d24e23b3-e096-4777-b4ef-ae6f6a43d066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:15.247174 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 695/1387] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:27:15.292025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887675b7-f571-4db1-b682-8c91f7332e29 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:15.306471 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887675b7-f571-4db1-b682-8c91f7332e29 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:15.311900 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da697d5-e9ff-4e24-965f-b62c80107f64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:15.312542 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da697d5-e9ff-4e24-965f-b62c80107f64 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:15.312831 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da697d5-e9ff-4e24-965f-b62c80107f64 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:15.313095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da697d5-e9ff-4e24-965f-b62c80107f64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:15.322307 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da697d5-e9ff-4e24-965f-b62c80107f64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:15.324416 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da697d5-e9ff-4e24-965f-b62c80107f64 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:15.338197 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 693/1388] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:18.050243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffa946-93ed-4b05-8b83-372b88a5e3b9 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:18.050912 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffa946-93ed-4b05-8b83-372b88a5e3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:18.050912 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffa946-93ed-4b05-8b83-372b88a5e3b9 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:18.052123 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 696/1389] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:18.058344 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5430c37-f917-4b68-b40a-2dbaebb79afb None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:18.058820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5430c37-f917-4b68-b40a-2dbaebb79afb None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:18.059033 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5430c37-f917-4b68-b40a-2dbaebb79afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:18.081990 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f5430c37-f917-4b68-b40a-2dbaebb79afb None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:18.083379 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f5430c37-f917-4b68-b40a-2dbaebb79afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:18.092117 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 694/1390] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:18.137661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffa946-93ed-4b05-8b83-372b88a5e3b9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:18.154349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffa946-93ed-4b05-8b83-372b88a5e3b9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:18.160334 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202aa2e-22c4-4596-8640-7321f2edb7c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:18.166909 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202aa2e-22c4-4596-8640-7321f2edb7c1 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:18.166909 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202aa2e-22c4-4596-8640-7321f2edb7c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:18.166909 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202aa2e-22c4-4596-8640-7321f2edb7c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:18.171430 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202aa2e-22c4-4596-8640-7321f2edb7c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:18.173084 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202aa2e-22c4-4596-8640-7321f2edb7c1 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:18.187108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 697/1391] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:20.513706 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2b8f9-7cfe-472f-8fc4-9b0702b8c810 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:20.514476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2b8f9-7cfe-472f-8fc4-9b0702b8c810 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:20.514476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2b8f9-7cfe-472f-8fc4-9b0702b8c810 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:20.515635 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 695/1392] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:20.521285 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b1eb0-c58e-472c-983e-f9baabb4718f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:20.521763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b1eb0-c58e-472c-983e-f9baabb4718f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:20.521866 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b1eb0-c58e-472c-983e-f9baabb4718f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:20.539813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-141b1eb0-c58e-472c-983e-f9baabb4718f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:20.541093 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-141b1eb0-c58e-472c-983e-f9baabb4718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:20.549097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 698/1393] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:20.594605 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2b8f9-7cfe-472f-8fc4-9b0702b8c810 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:20.608918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2b8f9-7cfe-472f-8fc4-9b0702b8c810 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:20.614281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367cf72-ab47-4a93-a5fc-e3b21e35bd67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:20.614915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367cf72-ab47-4a93-a5fc-e3b21e35bd67 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:20.615193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367cf72-ab47-4a93-a5fc-e3b21e35bd67 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:20.615466 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367cf72-ab47-4a93-a5fc-e3b21e35bd67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:20.624300 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367cf72-ab47-4a93-a5fc-e3b21e35bd67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:20.625924 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367cf72-ab47-4a93-a5fc-e3b21e35bd67 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:20.635968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 696/1394] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:21.531939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcb6a3-1114-418d-b559-5b1d37f6d015 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:21.532493 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcb6a3-1114-418d-b559-5b1d37f6d015 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:21.532493 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcb6a3-1114-418d-b559-5b1d37f6d015 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:21.533851 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 699/1395] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:21.539448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6e6fd-be75-4369-8517-eac906748ddb None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:21.539891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6e6fd-be75-4369-8517-eac906748ddb None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:21.540577 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6e6fd-be75-4369-8517-eac906748ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:21.558997 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c6d6e6fd-be75-4369-8517-eac906748ddb None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:21.560191 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c6d6e6fd-be75-4369-8517-eac906748ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:21.568669 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 697/1396] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:21.626806 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543abfc-8b23-4972-88d8-842623bda432 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:21.627097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543abfc-8b23-4972-88d8-842623bda432 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:21.627372 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543abfc-8b23-4972-88d8-842623bda432 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:21.628725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 700/1397] 10.222.0.52 () {54 vars in 962 bytes} [Fri Jun 17 07:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:21.633764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2bffc-234b-480a-a857-04425a3e6ee5 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:21.634199 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2bffc-234b-480a-a857-04425a3e6ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:21.634459 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2bffc-234b-480a-a857-04425a3e6ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:21.665721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:21.686731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e8c2bffc-234b-480a-a857-04425a3e6ee5 None None] MFA Rules not processed for user `bde4369f695745c199ce6c10d241b841`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:21.687921 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e8c2bffc-234b-480a-a857-04425a3e6ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:21.747400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 698/1398] 10.222.0.52 () {58 vars in 1059 bytes} [Fri Jun 17 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:21.755106 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543abfc-8b23-4972-88d8-842623bda432 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:21.760830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=87 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:21.766825 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543abfc-8b23-4972-88d8-842623bda432 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:21.772680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1c9d9-4876-4751-b276-ed9897915196 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde4369f695745c199ce6c10d241b841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:21.772680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1c9d9-4876-4751-b276-ed9897915196 service glance] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:21.772680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1c9d9-4876-4751-b276-ed9897915196 service glance] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:21.772680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1c9d9-4876-4751-b276-ed9897915196 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:21.782200 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1c9d9-4876-4751-b276-ed9897915196 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:21.783549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1c9d9-4876-4751-b276-ed9897915196 service glance] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:21.794153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 701/1399] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:22.713972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca526b-eef3-42c1-b2d0-97d049dfb99e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:22.714429 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca526b-eef3-42c1-b2d0-97d049dfb99e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:22.714536 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca526b-eef3-42c1-b2d0-97d049dfb99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:22.764278 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c1ca526b-eef3-42c1-b2d0-97d049dfb99e None None] MFA Rules not processed for user `9144d74a341b4e08ae353b384fe1186e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:22.765645 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c1ca526b-eef3-42c1-b2d0-97d049dfb99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:22.833736 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 699/1400] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Jun 17 07:27:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:22.878912 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bde8af-2f5d-4cc7-afb3-fa6b512b7725 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:22.879591 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bde8af-2f5d-4cc7-afb3-fa6b512b7725 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:22.879591 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bde8af-2f5d-4cc7-afb3-fa6b512b7725 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:22.881139 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 702/1401] 10.222.0.52 () {54 vars in 942 bytes} [Fri Jun 17 07:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:22.887874 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc6036-ac32-4321-b9a3-ddfb61dc2fef None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:22.888250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc6036-ac32-4321-b9a3-ddfb61dc2fef None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:22.888593 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc6036-ac32-4321-b9a3-ddfb61dc2fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:22.938422 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6ffc6036-ac32-4321-b9a3-ddfb61dc2fef None None] MFA Rules not processed for user `a18b07c033224d2085773936dad33eec`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:22.939636 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6ffc6036-ac32-4321-b9a3-ddfb61dc2fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:22.982372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:23.016052 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 700/1402] 10.222.0.52 () {58 vars in 1039 bytes} [Fri Jun 17 07:27:22 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:23.026130 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bde8af-2f5d-4cc7-afb3-fa6b512b7725 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:23.039561 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bde8af-2f5d-4cc7-afb3-fa6b512b7725 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:23.044823 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe4b32-cd4b-42c3-bc21-3248bf8ce0ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a18b07c033224d2085773936dad33eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:23.045514 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe4b32-cd4b-42c3-bc21-3248bf8ce0ba service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:23.045801 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe4b32-cd4b-42c3-bc21-3248bf8ce0ba service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:23.046080 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe4b32-cd4b-42c3-bc21-3248bf8ce0ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:23.054390 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe4b32-cd4b-42c3-bc21-3248bf8ce0ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:23.056195 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe4b32-cd4b-42c3-bc21-3248bf8ce0ba service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:23.064403 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 703/1403] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Jun 17 07:27:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:27:23.288308 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215ca7f-7a16-4088-9438-4d68cc8934bd None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:23.288592 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215ca7f-7a16-4088-9438-4d68cc8934bd None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:23.288869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215ca7f-7a16-4088-9438-4d68cc8934bd None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:23.290787 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 701/1404] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:23.296256 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d588fb-7840-44c8-b732-6c28ae2aa830 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:23.296544 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d588fb-7840-44c8-b732-6c28ae2aa830 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:23.296823 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d588fb-7840-44c8-b732-6c28ae2aa830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:23.315682 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-63d588fb-7840-44c8-b732-6c28ae2aa830 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:23.316885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-63d588fb-7840-44c8-b732-6c28ae2aa830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:23.324919 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 704/1405] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:23.369173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215ca7f-7a16-4088-9438-4d68cc8934bd None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:23.383639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215ca7f-7a16-4088-9438-4d68cc8934bd None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:23.389563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c7469-db17-412a-a101-07de23084adc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:23.390204 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c7469-db17-412a-a101-07de23084adc service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:23.390499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c7469-db17-412a-a101-07de23084adc service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:23.390757 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c7469-db17-412a-a101-07de23084adc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:23.399171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c7469-db17-412a-a101-07de23084adc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:23.401624 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c7469-db17-412a-a101-07de23084adc service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:23.411509 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 702/1406] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:25.717921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ec99f-41fa-4225-9588-aa026c3c2d71 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:25.718496 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ec99f-41fa-4225-9588-aa026c3c2d71 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:25.718496 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ec99f-41fa-4225-9588-aa026c3c2d71 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:25.720590 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 705/1407] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:25.725588 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1db922-2116-47ac-9ce8-687f5556e68d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:25.726079 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1db922-2116-47ac-9ce8-687f5556e68d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:25.726159 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1db922-2116-47ac-9ce8-687f5556e68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:25.744887 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-9a1db922-2116-47ac-9ce8-687f5556e68d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:25.746158 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9a1db922-2116-47ac-9ce8-687f5556e68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:25.754629 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 703/1408] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:25.803400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ec99f-41fa-4225-9588-aa026c3c2d71 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:25.820121 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ec99f-41fa-4225-9588-aa026c3c2d71 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:25.825768 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b826e5-eb36-4afe-b1a2-28424d465f89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:25.826419 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b826e5-eb36-4afe-b1a2-28424d465f89 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:25.826705 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b826e5-eb36-4afe-b1a2-28424d465f89 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:25.826983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b826e5-eb36-4afe-b1a2-28424d465f89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:25.836464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b826e5-eb36-4afe-b1a2-28424d465f89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:25.837623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b826e5-eb36-4afe-b1a2-28424d465f89 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:25.848029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 706/1409] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:35.739623 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=21 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:35.843457 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=20 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:46.958421 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3a43a-9605-4fc2-ab08-955868f3c61e None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:46.958948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3a43a-9605-4fc2-ab08-955868f3c61e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:46.958948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3a43a-9605-4fc2-ab08-955868f3c61e None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:46.960254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 704/1410] 10.222.0.52 () {54 vars in 918 bytes} [Fri Jun 17 07:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:46.966226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71403f-eb4a-4afe-b65e-856d59ac9af0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:46.966624 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71403f-eb4a-4afe-b65e-856d59ac9af0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:46.966789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71403f-eb4a-4afe-b65e-856d59ac9af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:46.984661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-aa71403f-eb4a-4afe-b65e-856d59ac9af0 None None] MFA Rules not processed for user `71adc8b93e5c41929b928002e004df6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:46.985879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-aa71403f-eb4a-4afe-b65e-856d59ac9af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:46.994566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 707/1411] 10.222.0.52 () {58 vars in 1015 bytes} [Fri Jun 17 07:27:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:47.008857 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1cb25-b09d-4468-853b-8705dc54bf03 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:47.009412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1cb25-b09d-4468-853b-8705dc54bf03 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:47.009709 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1cb25-b09d-4468-853b-8705dc54bf03 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:47.011340 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 705/1412] 10.222.0.52 () {54 vars in 918 bytes} [Fri Jun 17 07:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:47.015916 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e169f-0386-4aaf-8295-553afff190b7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:47.016203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e169f-0386-4aaf-8295-553afff190b7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:47.016483 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e169f-0386-4aaf-8295-553afff190b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:47.034891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a02e169f-0386-4aaf-8295-553afff190b7 None None] MFA Rules not processed for user `88e1572d22c048b09699a2fe50900f92`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:47.036080 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a02e169f-0386-4aaf-8295-553afff190b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:47.045971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 708/1413] 10.222.0.52 () {58 vars in 1015 bytes} [Fri Jun 17 07:27:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:49.662560 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d23573-a82c-479e-bbfe-01e56c903ee2 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:49.663101 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d23573-a82c-479e-bbfe-01e56c903ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:49.663101 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d23573-a82c-479e-bbfe-01e56c903ee2 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:49.665134 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 07:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:49.670327 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae73c6-b232-4c55-99e4-fe3314b2ed47 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:49.670788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae73c6-b232-4c55-99e4-fe3314b2ed47 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:49.670885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae73c6-b232-4c55-99e4-fe3314b2ed47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:49.689521 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-45ae73c6-b232-4c55-99e4-fe3314b2ed47 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:49.690713 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-45ae73c6-b232-4c55-99e4-fe3314b2ed47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:49.699082 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 07:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:49.742405 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d23573-a82c-479e-bbfe-01e56c903ee2 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:49.756723 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d23573-a82c-479e-bbfe-01e56c903ee2 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:49.762664 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be675e-5375-4ea6-b472-47fc8c5e819a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:49.763291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be675e-5375-4ea6-b472-47fc8c5e819a service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:49.763572 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be675e-5375-4ea6-b472-47fc8c5e819a service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:49.763845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be675e-5375-4ea6-b472-47fc8c5e819a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:49.772305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be675e-5375-4ea6-b472-47fc8c5e819a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:49.774520 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be675e-5375-4ea6-b472-47fc8c5e819a service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:49.784341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 707/1416] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:50.738708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbab79-c6dd-447c-a754-26d2579698af None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:50.739237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbab79-c6dd-447c-a754-26d2579698af None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:50.739237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbab79-c6dd-447c-a754-26d2579698af None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:50.740752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 07:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:50.745895 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50c472-367c-438e-956a-af47ab77274e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:50.746278 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50c472-367c-438e-956a-af47ab77274e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:50.746448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50c472-367c-438e-956a-af47ab77274e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:50.765894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3c50c472-367c-438e-956a-af47ab77274e None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:50.767090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3c50c472-367c-438e-956a-af47ab77274e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:50.775758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 07:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:50.925754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbab79-c6dd-447c-a754-26d2579698af None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:50.944883 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbab79-c6dd-447c-a754-26d2579698af None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:50.945432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2127dca-6d40-4908-b93f-b54ef62599c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:50.946705 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2127dca-6d40-4908-b93f-b54ef62599c6 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:50.946987 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2127dca-6d40-4908-b93f-b54ef62599c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:50.947265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2127dca-6d40-4908-b93f-b54ef62599c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:50.955479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2127dca-6d40-4908-b93f-b54ef62599c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:50.957096 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2127dca-6d40-4908-b93f-b54ef62599c6 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:50.967187 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 711/1419] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:51.889564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c862295-d67a-4bf1-b5f8-b53c2ed30805 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:51.890135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c862295-d67a-4bf1-b5f8-b53c2ed30805 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:51.890135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c862295-d67a-4bf1-b5f8-b53c2ed30805 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:51.891457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 07:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:51.896330 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0422ad5-aac2-45e3-b6d4-84be1b0486eb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:51.896713 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0422ad5-aac2-45e3-b6d4-84be1b0486eb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:51.896882 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0422ad5-aac2-45e3-b6d4-84be1b0486eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:51.914534 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b0422ad5-aac2-45e3-b6d4-84be1b0486eb None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:51.915725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b0422ad5-aac2-45e3-b6d4-84be1b0486eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:51.923437 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 07:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:52.078712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c862295-d67a-4bf1-b5f8-b53c2ed30805 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:52.093617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c862295-d67a-4bf1-b5f8-b53c2ed30805 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:52.098853 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cb3ff-a145-4519-a249-4641bcc9925e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:52.099480 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cb3ff-a145-4519-a249-4641bcc9925e service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:52.099757 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cb3ff-a145-4519-a249-4641bcc9925e service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:52.100026 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cb3ff-a145-4519-a249-4641bcc9925e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:52.109274 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cb3ff-a145-4519-a249-4641bcc9925e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:52.111108 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cb3ff-a145-4519-a249-4641bcc9925e service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:52.120662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 710/1422] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:53.032808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a0fa4-0fc2-49e3-af4c-f3a3f9e99c34 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:53.033453 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a0fa4-0fc2-49e3-af4c-f3a3f9e99c34 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:53.033453 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a0fa4-0fc2-49e3-af4c-f3a3f9e99c34 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:53.034662 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 07:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:53.040053 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9086e4-f939-4ead-8e4d-1e2f4a72b8f5 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:53.040574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9086e4-f939-4ead-8e4d-1e2f4a72b8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:53.040574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9086e4-f939-4ead-8e4d-1e2f4a72b8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:53.059171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-fa9086e4-f939-4ead-8e4d-1e2f4a72b8f5 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:53.060368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fa9086e4-f939-4ead-8e4d-1e2f4a72b8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:53.068310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 07:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:53.219347 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a0fa4-0fc2-49e3-af4c-f3a3f9e99c34 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:53.233506 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a0fa4-0fc2-49e3-af4c-f3a3f9e99c34 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:53.238755 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a240a-b5ac-4177-8647-ce76c7c29f12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:53.239386 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a240a-b5ac-4177-8647-ce76c7c29f12 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:53.239668 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a240a-b5ac-4177-8647-ce76c7c29f12 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:53.239943 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a240a-b5ac-4177-8647-ce76c7c29f12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:53.247938 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a240a-b5ac-4177-8647-ce76c7c29f12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:53.249544 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a240a-b5ac-4177-8647-ce76c7c29f12 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:53.259519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 714/1425] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:54.165476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285de84e-2d6a-42e6-9ef4-630c66cb1d39 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:54.166049 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285de84e-2d6a-42e6-9ef4-630c66cb1d39 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:54.166049 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285de84e-2d6a-42e6-9ef4-630c66cb1d39 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:54.167425 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 07:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:54.172269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb97f3-4c9c-49e4-b69a-990b728792be None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:54.172704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb97f3-4c9c-49e4-b69a-990b728792be None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:54.172862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb97f3-4c9c-49e4-b69a-990b728792be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:54.191283 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f6bb97f3-4c9c-49e4-b69a-990b728792be None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:54.192484 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f6bb97f3-4c9c-49e4-b69a-990b728792be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:54.200865 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 07:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:54.351226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285de84e-2d6a-42e6-9ef4-630c66cb1d39 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:54.365554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285de84e-2d6a-42e6-9ef4-630c66cb1d39 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:54.371842 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584ac58-7032-42a2-bbab-ba7b858e11e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:54.372479 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ac58-7032-42a2-bbab-ba7b858e11e9 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:54.372744 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ac58-7032-42a2-bbab-ba7b858e11e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:54.373016 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ac58-7032-42a2-bbab-ba7b858e11e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:54.381155 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584ac58-7032-42a2-bbab-ba7b858e11e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:54.382866 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584ac58-7032-42a2-bbab-ba7b858e11e9 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:54.393047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 713/1428] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:55.337978 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448934a-7ae4-4f9c-9112-0f87fdfe502f None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:55.338511 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448934a-7ae4-4f9c-9112-0f87fdfe502f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:55.338511 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448934a-7ae4-4f9c-9112-0f87fdfe502f None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:55.340292 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 07:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:55.345256 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec516fa-e9cb-4698-b07c-234977971879 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:55.345727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec516fa-e9cb-4698-b07c-234977971879 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:55.345904 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec516fa-e9cb-4698-b07c-234977971879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:55.364280 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-eec516fa-e9cb-4698-b07c-234977971879 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:55.365501 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-eec516fa-e9cb-4698-b07c-234977971879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:55.373729 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 07:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:55.528432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448934a-7ae4-4f9c-9112-0f87fdfe502f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:55.542932 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448934a-7ae4-4f9c-9112-0f87fdfe502f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:55.548254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01de2a-38dd-4780-ba52-0043fc962301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:55.548897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01de2a-38dd-4780-ba52-0043fc962301 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:55.549181 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01de2a-38dd-4780-ba52-0043fc962301 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:55.549497 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01de2a-38dd-4780-ba52-0043fc962301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:55.558965 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01de2a-38dd-4780-ba52-0043fc962301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:55.560561 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01de2a-38dd-4780-ba52-0043fc962301 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:55.571440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 717/1431] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:56.791104 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be830a5b-765f-43b9-bd99-bdddfa0c4336 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:56.791673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be830a5b-765f-43b9-bd99-bdddfa0c4336 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:56.791673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be830a5b-765f-43b9-bd99-bdddfa0c4336 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:56.793028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 07:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:56.797978 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aead9-2377-473f-b2f7-5c6dc2a00a1c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:56.798391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aead9-2377-473f-b2f7-5c6dc2a00a1c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:56.798535 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aead9-2377-473f-b2f7-5c6dc2a00a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:56.817200 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3d8aead9-2377-473f-b2f7-5c6dc2a00a1c None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:56.818427 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3d8aead9-2377-473f-b2f7-5c6dc2a00a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:56.826851 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 07:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:56.981358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be830a5b-765f-43b9-bd99-bdddfa0c4336 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:56.996688 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be830a5b-765f-43b9-bd99-bdddfa0c4336 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:57.002155 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317cfbc-4830-4f8e-873e-9d2aa09add80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:57.002788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317cfbc-4830-4f8e-873e-9d2aa09add80 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:57.003072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317cfbc-4830-4f8e-873e-9d2aa09add80 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:57.003349 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317cfbc-4830-4f8e-873e-9d2aa09add80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:57.012318 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317cfbc-4830-4f8e-873e-9d2aa09add80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:57.013948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317cfbc-4830-4f8e-873e-9d2aa09add80 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:57.023231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 716/1434] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:57.929214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688bee2-c8d1-45b0-81ef-033f67319267 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:57.929789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688bee2-c8d1-45b0-81ef-033f67319267 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:57.929902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688bee2-c8d1-45b0-81ef-033f67319267 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:57.931371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 07:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:57.936458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcac49-7813-4213-a19f-06cb075bc510 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:57.936862 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcac49-7813-4213-a19f-06cb075bc510 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:57.936983 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcac49-7813-4213-a19f-06cb075bc510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:57.955039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-fbdcac49-7813-4213-a19f-06cb075bc510 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:57.956230 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fbdcac49-7813-4213-a19f-06cb075bc510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:57.964779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 07:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:58.117822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688bee2-c8d1-45b0-81ef-033f67319267 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:58.131777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688bee2-c8d1-45b0-81ef-033f67319267 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:58.137422 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67e788-03c6-4131-9eeb-1b580d369be4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:58.138061 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67e788-03c6-4131-9eeb-1b580d369be4 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:58.138340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67e788-03c6-4131-9eeb-1b580d369be4 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:58.138638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67e788-03c6-4131-9eeb-1b580d369be4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:58.146656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67e788-03c6-4131-9eeb-1b580d369be4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:58.148241 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67e788-03c6-4131-9eeb-1b580d369be4 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:58.158477 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 720/1437] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:59.096318 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def7534-c4f9-430d-8feb-0f4b612ef27b None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:59.096875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def7534-c4f9-430d-8feb-0f4b612ef27b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:59.096875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def7534-c4f9-430d-8feb-0f4b612ef27b None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:59.098295 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 07:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:27:59.104355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a755a-95b8-4181-a9fd-28e654138b60 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:59.104751 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a755a-95b8-4181-a9fd-28e654138b60 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:59.104912 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a755a-95b8-4181-a9fd-28e654138b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:59.123526 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9f8a755a-95b8-4181-a9fd-28e654138b60 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:27:59.124732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9f8a755a-95b8-4181-a9fd-28e654138b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:27:59.132633 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 07:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:27:59.285916 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def7534-c4f9-430d-8feb-0f4b612ef27b None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:27:59.300395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def7534-c4f9-430d-8feb-0f4b612ef27b None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:27:59.306778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436d1d6-c6b4-47d8-9f9b-3d51c9fbd8cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:27:59.307417 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436d1d6-c6b4-47d8-9f9b-3d51c9fbd8cb service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:27:59.307701 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436d1d6-c6b4-47d8-9f9b-3d51c9fbd8cb service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:27:59.307978 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436d1d6-c6b4-47d8-9f9b-3d51c9fbd8cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:27:59.316320 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436d1d6-c6b4-47d8-9f9b-3d51c9fbd8cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:27:59.317946 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436d1d6-c6b4-47d8-9f9b-3d51c9fbd8cb service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:27:59.327955 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 719/1440] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:27:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:28:01.354115 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430a742-13cc-4c25-9a83-7818ae1dc567 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:01.354679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430a742-13cc-4c25-9a83-7818ae1dc567 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:01.354679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430a742-13cc-4c25-9a83-7818ae1dc567 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:01.356077 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 07:28:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:28:01.361601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5b1b7-6cf0-4496-84e5-163cf3db3812 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:01.362046 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5b1b7-6cf0-4496-84e5-163cf3db3812 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:01.362159 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5b1b7-6cf0-4496-84e5-163cf3db3812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:01.380492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c8e5b1b7-6cf0-4496-84e5-163cf3db3812 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:01.381728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c8e5b1b7-6cf0-4496-84e5-163cf3db3812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:01.390685 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 07:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:28:01.431641 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430a742-13cc-4c25-9a83-7818ae1dc567 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:28:01.442625 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430a742-13cc-4c25-9a83-7818ae1dc567 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:28:01.446831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfff04-d6a4-47d1-9602-a4fec8e5444d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:28:01.447468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfff04-d6a4-47d1-9602-a4fec8e5444d service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:01.447754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfff04-d6a4-47d1-9602-a4fec8e5444d service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:01.448034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfff04-d6a4-47d1-9602-a4fec8e5444d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:01.457429 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfff04-d6a4-47d1-9602-a4fec8e5444d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:28:01.462116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfff04-d6a4-47d1-9602-a4fec8e5444d service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:28:01.468972 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 723/1443] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:28:03.743268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d080f-2107-4c8a-aa82-a49e298f250b None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:03.743826 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d080f-2107-4c8a-aa82-a49e298f250b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:03.743826 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d080f-2107-4c8a-aa82-a49e298f250b None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:03.745173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 07:28:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:28:03.750415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea51a31-df63-4dc0-9a91-f149ba59d015 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:03.750843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea51a31-df63-4dc0-9a91-f149ba59d015 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:03.750966 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea51a31-df63-4dc0-9a91-f149ba59d015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:03.768604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-eea51a31-df63-4dc0-9a91-f149ba59d015 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:03.769823 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-eea51a31-df63-4dc0-9a91-f149ba59d015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:03.777834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 07:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:28:03.817468 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d080f-2107-4c8a-aa82-a49e298f250b None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:28:03.828265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d080f-2107-4c8a-aa82-a49e298f250b None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:28:03.831957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dabc01-7f1a-467a-bd8f-eb91c154d72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:28:03.832586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dabc01-7f1a-467a-bd8f-eb91c154d72d service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:03.832892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dabc01-7f1a-467a-bd8f-eb91c154d72d service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:03.833168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dabc01-7f1a-467a-bd8f-eb91c154d72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:03.842674 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dabc01-7f1a-467a-bd8f-eb91c154d72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:28:03.844111 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dabc01-7f1a-467a-bd8f-eb91c154d72d service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:28:03.854185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 722/1446] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:28:06.363584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a88a4b-01c6-4950-9436-ab0e652a99ba None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:06.364205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a88a4b-01c6-4950-9436-ab0e652a99ba None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:06.364205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a88a4b-01c6-4950-9436-ab0e652a99ba None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:06.365589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 07:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:28:06.371362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf57bd-42a6-4c81-b0b3-a30b6b1d3312 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:06.371815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf57bd-42a6-4c81-b0b3-a30b6b1d3312 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:06.371912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf57bd-42a6-4c81-b0b3-a30b6b1d3312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:06.390644 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0aaf57bd-42a6-4c81-b0b3-a30b6b1d3312 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:06.395585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0aaf57bd-42a6-4c81-b0b3-a30b6b1d3312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:06.399848 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 07:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:28:06.439530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a88a4b-01c6-4950-9436-ab0e652a99ba None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:28:06.450691 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a88a4b-01c6-4950-9436-ab0e652a99ba None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:28:06.454564 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e0ec1-8be4-44c4-8ab5-e1ace1dcbdd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:28:06.455200 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0ec1-8be4-44c4-8ab5-e1ace1dcbdd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:06.455482 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0ec1-8be4-44c4-8ab5-e1ace1dcbdd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:06.455757 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0ec1-8be4-44c4-8ab5-e1ace1dcbdd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:06.465196 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e0ec1-8be4-44c4-8ab5-e1ace1dcbdd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:28:06.466721 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e0ec1-8be4-44c4-8ab5-e1ace1dcbdd6 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:28:06.476143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 726/1449] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:28:08.740534 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e1a7f-1d9c-4f31-9077-c53161991d08 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:08.741098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e1a7f-1d9c-4f31-9077-c53161991d08 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:08.741098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e1a7f-1d9c-4f31-9077-c53161991d08 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:08.743331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 07:28:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:28:08.748750 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ec6ca-7e69-494f-96fc-2ae0a6687ac2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:08.749184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ec6ca-7e69-494f-96fc-2ae0a6687ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:08.749385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ec6ca-7e69-494f-96fc-2ae0a6687ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:08.767803 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a65ec6ca-7e69-494f-96fc-2ae0a6687ac2 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:08.769000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a65ec6ca-7e69-494f-96fc-2ae0a6687ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:08.776846 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 07:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:28:08.816368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e1a7f-1d9c-4f31-9077-c53161991d08 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:28:08.834821 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e1a7f-1d9c-4f31-9077-c53161991d08 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:28:08.840355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a23174-c81b-48e6-a215-ea9d21f1f566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:28:08.841131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a23174-c81b-48e6-a215-ea9d21f1f566 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:08.841441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a23174-c81b-48e6-a215-ea9d21f1f566 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:08.841719 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a23174-c81b-48e6-a215-ea9d21f1f566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:08.850836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a23174-c81b-48e6-a215-ea9d21f1f566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:28:08.852954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a23174-c81b-48e6-a215-ea9d21f1f566 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:28:08.862255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 725/1452] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:28:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:28:11.025270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b584f-dd49-43d8-aa0c-2d9efa32d001 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:11.025839 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b584f-dd49-43d8-aa0c-2d9efa32d001 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:11.025839 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b584f-dd49-43d8-aa0c-2d9efa32d001 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:11.027111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 07:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:28:11.032307 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6e6c0-a8ca-4b11-8153-f3d9de895e1a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:11.032734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6e6c0-a8ca-4b11-8153-f3d9de895e1a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:11.032852 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6e6c0-a8ca-4b11-8153-f3d9de895e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:11.050767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-bae6e6c0-a8ca-4b11-8153-f3d9de895e1a None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:11.051954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-bae6e6c0-a8ca-4b11-8153-f3d9de895e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:11.061922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 07:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:28:11.101094 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b584f-dd49-43d8-aa0c-2d9efa32d001 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:28:11.112505 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b584f-dd49-43d8-aa0c-2d9efa32d001 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:28:11.116235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7946175-b080-4df2-9a1e-5a846f697d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:28:11.116875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7946175-b080-4df2-9a1e-5a846f697d96 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:11.117191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7946175-b080-4df2-9a1e-5a846f697d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:11.117498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7946175-b080-4df2-9a1e-5a846f697d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:11.126364 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7946175-b080-4df2-9a1e-5a846f697d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:28:11.128081 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7946175-b080-4df2-9a1e-5a846f697d96 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:28:11.138181 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 729/1455] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:28:13.323757 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baaf758-7050-4af1-86b1-231e62564797 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:13.324326 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baaf758-7050-4af1-86b1-231e62564797 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:13.324326 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baaf758-7050-4af1-86b1-231e62564797 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:13.325712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 07:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:28:13.330838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60461eae-d5b8-4f1f-8f28-231953766561 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:13.331247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60461eae-d5b8-4f1f-8f28-231953766561 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:13.331390 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60461eae-d5b8-4f1f-8f28-231953766561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:13.349837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-60461eae-d5b8-4f1f-8f28-231953766561 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:13.351165 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-60461eae-d5b8-4f1f-8f28-231953766561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:13.359235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 07:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:28:13.397475 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baaf758-7050-4af1-86b1-231e62564797 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:28:13.408819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baaf758-7050-4af1-86b1-231e62564797 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:28:13.412243 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522096f-da22-4255-8c4c-84b5a4de5716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:28:13.412867 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522096f-da22-4255-8c4c-84b5a4de5716 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:13.413143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522096f-da22-4255-8c4c-84b5a4de5716 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:13.413490 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522096f-da22-4255-8c4c-84b5a4de5716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:13.422825 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522096f-da22-4255-8c4c-84b5a4de5716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:28:13.428517 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522096f-da22-4255-8c4c-84b5a4de5716 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:28:13.433560 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 728/1458] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:28:15.696997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3735a-c0c8-4a54-a6d4-3a1e255ddcc5 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:15.697471 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3735a-c0c8-4a54-a6d4-3a1e255ddcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:15.697567 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3735a-c0c8-4a54-a6d4-3a1e255ddcc5 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:15.698934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 07:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:28:15.704643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c56dd8-18bf-4c17-b3f1-6bd02225330a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:15.705082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c56dd8-18bf-4c17-b3f1-6bd02225330a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:15.705205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c56dd8-18bf-4c17-b3f1-6bd02225330a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:15.723533 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-76c56dd8-18bf-4c17-b3f1-6bd02225330a None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:15.724721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-76c56dd8-18bf-4c17-b3f1-6bd02225330a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:15.732826 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 07:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:28:15.770553 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3735a-c0c8-4a54-a6d4-3a1e255ddcc5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:28:15.782400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3735a-c0c8-4a54-a6d4-3a1e255ddcc5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:28:15.785856 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a246c6d-20ec-40a4-bcd4-0341902c0b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:28:15.786486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246c6d-20ec-40a4-bcd4-0341902c0b20 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:15.786762 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246c6d-20ec-40a4-bcd4-0341902c0b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:15.787032 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246c6d-20ec-40a4-bcd4-0341902c0b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:15.795945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a246c6d-20ec-40a4-bcd4-0341902c0b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:28:15.797374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a246c6d-20ec-40a4-bcd4-0341902c0b20 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:28:15.807145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 732/1461] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:28:18.006810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8bf9d-b193-4d19-bc8c-2d1dd3353243 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:18.007339 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8bf9d-b193-4d19-bc8c-2d1dd3353243 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:18.007339 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8bf9d-b193-4d19-bc8c-2d1dd3353243 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:18.009450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 07:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:28:18.014919 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447c0f-589e-458e-b910-bc72f3dc13c4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:18.015383 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447c0f-589e-458e-b910-bc72f3dc13c4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:18.015541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447c0f-589e-458e-b910-bc72f3dc13c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:18.021540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=79 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:28:18.034517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-fd447c0f-589e-458e-b910-bc72f3dc13c4 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:18.035698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fd447c0f-589e-458e-b910-bc72f3dc13c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:18.043788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 07:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:28:18.081842 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8bf9d-b193-4d19-bc8c-2d1dd3353243 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:28:18.087695 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=73 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:28:18.093311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8bf9d-b193-4d19-bc8c-2d1dd3353243 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:28:18.096836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babc9ec-2961-483d-bcee-2f70674d8302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:28:18.097501 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babc9ec-2961-483d-bcee-2f70674d8302 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:18.097778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babc9ec-2961-483d-bcee-2f70674d8302 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:18.098051 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babc9ec-2961-483d-bcee-2f70674d8302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:18.106996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babc9ec-2961-483d-bcee-2f70674d8302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:28:18.108987 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babc9ec-2961-483d-bcee-2f70674d8302 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:28:18.119291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 731/1464] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:28:20.287400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aac4fc-c7bf-4dbb-863e-c4f74cf84e19 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:20.287960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aac4fc-c7bf-4dbb-863e-c4f74cf84e19 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:20.287960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aac4fc-c7bf-4dbb-863e-c4f74cf84e19 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:20.290102 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 07:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:28:20.295159 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63a0e8-c13e-4268-bef9-1306f0aea7a7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:20.295586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63a0e8-c13e-4268-bef9-1306f0aea7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:20.295710 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63a0e8-c13e-4268-bef9-1306f0aea7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:20.312922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-5f63a0e8-c13e-4268-bef9-1306f0aea7a7 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:20.314129 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5f63a0e8-c13e-4268-bef9-1306f0aea7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:20.321827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 07:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:28:20.357205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aac4fc-c7bf-4dbb-863e-c4f74cf84e19 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:28:20.369443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aac4fc-c7bf-4dbb-863e-c4f74cf84e19 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:28:20.373052 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc0c0e-591b-4f85-803e-d0e0216768ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:28:20.373726 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc0c0e-591b-4f85-803e-d0e0216768ba service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:20.374012 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc0c0e-591b-4f85-803e-d0e0216768ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:20.374287 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc0c0e-591b-4f85-803e-d0e0216768ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:20.384094 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc0c0e-591b-4f85-803e-d0e0216768ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:28:20.385882 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc0c0e-591b-4f85-803e-d0e0216768ba service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:28:20.395361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 735/1467] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:28:22.545037 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f34362-ae37-4f25-8b77-3894a55ad54b None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:22.545650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f34362-ae37-4f25-8b77-3894a55ad54b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:22.545650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f34362-ae37-4f25-8b77-3894a55ad54b None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:22.549362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 07:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:28:22.552762 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb44c-bdb9-4280-8a56-522442352b40 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:22.559182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb44c-bdb9-4280-8a56-522442352b40 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:22.559182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb44c-bdb9-4280-8a56-522442352b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:22.571508 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-465fb44c-bdb9-4280-8a56-522442352b40 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:22.572693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-465fb44c-bdb9-4280-8a56-522442352b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:22.580816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 07:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:28:22.618391 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f34362-ae37-4f25-8b77-3894a55ad54b None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:28:22.629395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f34362-ae37-4f25-8b77-3894a55ad54b None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:28:22.633273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0de3c-4a03-4b7d-83d1-897eee2ad4d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:28:22.634381 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0de3c-4a03-4b7d-83d1-897eee2ad4d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:22.634675 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0de3c-4a03-4b7d-83d1-897eee2ad4d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:22.634951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0de3c-4a03-4b7d-83d1-897eee2ad4d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:22.644548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0de3c-4a03-4b7d-83d1-897eee2ad4d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:28:22.646041 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0de3c-4a03-4b7d-83d1-897eee2ad4d5 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:28:22.656247 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 734/1470] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:28:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:28:32.566226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=11 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:28:32.651786 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=14 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:28:42.815821 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f8917-23aa-4fda-94d0-4b590a318eee None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:42.816358 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f8917-23aa-4fda-94d0-4b590a318eee None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:42.816358 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f8917-23aa-4fda-94d0-4b590a318eee None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:42.817788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 737/1471] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:28:42.823117 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4fbcc-8a43-4f84-873c-7dcb537ad952 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:42.823545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4fbcc-8a43-4f84-873c-7dcb537ad952 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:42.823703 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4fbcc-8a43-4f84-873c-7dcb537ad952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:42.842046 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-33c4fbcc-8a43-4f84-873c-7dcb537ad952 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:42.843232 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-33c4fbcc-8a43-4f84-873c-7dcb537ad952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:42.852261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 735/1472] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:28:42.898628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038c826-7633-46bc-9e43-10ba69b298b9 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:42.898909 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038c826-7633-46bc-9e43-10ba69b298b9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:42.899182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038c826-7633-46bc-9e43-10ba69b298b9 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:42.900530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 738/1473] 10.222.0.52 () {54 vars in 962 bytes} [Fri Jun 17 07:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:28:42.905437 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d314b3-9582-4bb6-aee7-38e680fbdcf7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:42.905728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d314b3-9582-4bb6-aee7-38e680fbdcf7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:42.906008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d314b3-9582-4bb6-aee7-38e680fbdcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:42.924864 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-70d314b3-9582-4bb6-aee7-38e680fbdcf7 None None] MFA Rules not processed for user `bde4369f695745c199ce6c10d241b841`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:42.926097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-70d314b3-9582-4bb6-aee7-38e680fbdcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:42.932493 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 736/1474] 10.222.0.52 () {58 vars in 1059 bytes} [Fri Jun 17 07:28:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:28:42.939772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038c826-7633-46bc-9e43-10ba69b298b9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:28:42.950589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038c826-7633-46bc-9e43-10ba69b298b9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:28:42.954019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a611453-07b6-43d8-b5dd-2472d15bbaca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde4369f695745c199ce6c10d241b841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:28:42.954667 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a611453-07b6-43d8-b5dd-2472d15bbaca service glance] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:42.954948 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a611453-07b6-43d8-b5dd-2472d15bbaca service glance] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:42.955215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a611453-07b6-43d8-b5dd-2472d15bbaca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:42.964810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a611453-07b6-43d8-b5dd-2472d15bbaca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:28:42.966263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a611453-07b6-43d8-b5dd-2472d15bbaca service glance] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:28:42.975358 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 739/1475] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:28:45.233890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e831b0-8f8e-4570-86ec-10b7b7bf2021 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:45.234465 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e831b0-8f8e-4570-86ec-10b7b7bf2021 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:45.234465 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e831b0-8f8e-4570-86ec-10b7b7bf2021 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:45.235841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 737/1476] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:28:45.241061 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68346f-5ec3-40ff-b4b9-cdfc5ec630e7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:45.241589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68346f-5ec3-40ff-b4b9-cdfc5ec630e7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:45.241698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68346f-5ec3-40ff-b4b9-cdfc5ec630e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:45.259306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-da68346f-5ec3-40ff-b4b9-cdfc5ec630e7 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:45.260510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-da68346f-5ec3-40ff-b4b9-cdfc5ec630e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:45.268218 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 740/1477] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:28:45.292723 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e831b0-8f8e-4570-86ec-10b7b7bf2021 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:28:45.305688 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e831b0-8f8e-4570-86ec-10b7b7bf2021 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:28:45.310086 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bceb1-1315-4475-ba5c-c78f07cbc930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:28:45.310725 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bceb1-1315-4475-ba5c-c78f07cbc930 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:45.311004 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bceb1-1315-4475-ba5c-c78f07cbc930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:45.311274 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bceb1-1315-4475-ba5c-c78f07cbc930 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:45.311988 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9bceb1-1315-4475-ba5c-c78f07cbc930 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:28:45.313774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: WARNING py.warnings [None req-4a9bceb1-1315-4475-ba5c-c78f07cbc930 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:28:45.313774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: warnings.warn(msg) Jun 17 07:28:45.313774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: Jun 17 07:28:45.314919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9bceb1-1315-4475-ba5c-c78f07cbc930 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:28:45.333809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 738/1478] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Jun 17 07:28:45 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:28:47.472849 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b068647-e057-4b4e-bb39-bda8aed40eca None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:47.473400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b068647-e057-4b4e-bb39-bda8aed40eca None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:47.473400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b068647-e057-4b4e-bb39-bda8aed40eca None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:47.474758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 741/1479] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:28:47.481095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fb546-ad25-49b7-97a0-1a340c23c1f0 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:47.481559 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fb546-ad25-49b7-97a0-1a340c23c1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:47.481750 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fb546-ad25-49b7-97a0-1a340c23c1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:47.501157 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-611fb546-ad25-49b7-97a0-1a340c23c1f0 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:47.502407 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-611fb546-ad25-49b7-97a0-1a340c23c1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:47.510857 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 739/1480] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:28:47.554172 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b068647-e057-4b4e-bb39-bda8aed40eca None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:28:47.569078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b068647-e057-4b4e-bb39-bda8aed40eca None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:28:47.574813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899d7a8-2790-4276-b067-be2b02e0c4f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:28:47.575453 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899d7a8-2790-4276-b067-be2b02e0c4f9 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:47.575790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899d7a8-2790-4276-b067-be2b02e0c4f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:47.576063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899d7a8-2790-4276-b067-be2b02e0c4f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:47.584415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899d7a8-2790-4276-b067-be2b02e0c4f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:28:47.586582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899d7a8-2790-4276-b067-be2b02e0c4f9 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:28:47.596102 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 742/1481] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:28:49.898577 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9864f25-c357-4a64-af4e-648bfd2b00dd None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:49.899192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9864f25-c357-4a64-af4e-648bfd2b00dd None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:49.899192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9864f25-c357-4a64-af4e-648bfd2b00dd None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:49.900523 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 740/1482] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:28:49.905890 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcdc40-41b0-47c8-ab41-c45f72d1d590 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:49.906445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcdc40-41b0-47c8-ab41-c45f72d1d590 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:49.906550 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcdc40-41b0-47c8-ab41-c45f72d1d590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:49.924823 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-49dcdc40-41b0-47c8-ab41-c45f72d1d590 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:49.926093 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-49dcdc40-41b0-47c8-ab41-c45f72d1d590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:49.934026 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 743/1483] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:28:49.971661 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9864f25-c357-4a64-af4e-648bfd2b00dd None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:28:49.982521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9864f25-c357-4a64-af4e-648bfd2b00dd None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:28:49.986009 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad51db-96c9-4c7f-adf2-5a464ec93abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:28:49.986638 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad51db-96c9-4c7f-adf2-5a464ec93abc service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:49.987252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad51db-96c9-4c7f-adf2-5a464ec93abc service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:49.987534 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad51db-96c9-4c7f-adf2-5a464ec93abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:49.996522 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad51db-96c9-4c7f-adf2-5a464ec93abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:28:49.998002 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad51db-96c9-4c7f-adf2-5a464ec93abc service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:28:50.007909 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 741/1484] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:28:52.181438 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bb2f9-5b1b-4ca8-a1e2-23f533c196b3 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:52.182030 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bb2f9-5b1b-4ca8-a1e2-23f533c196b3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:52.182030 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bb2f9-5b1b-4ca8-a1e2-23f533c196b3 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:52.183406 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 744/1485] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:28:52.188533 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de217a-a4af-43dd-98e8-2edc8d0ec0f9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:52.188952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de217a-a4af-43dd-98e8-2edc8d0ec0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:52.189054 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de217a-a4af-43dd-98e8-2edc8d0ec0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:52.206347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-47de217a-a4af-43dd-98e8-2edc8d0ec0f9 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:52.207526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-47de217a-a4af-43dd-98e8-2edc8d0ec0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:52.215497 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 742/1486] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:28:52.254566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bb2f9-5b1b-4ca8-a1e2-23f533c196b3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:28:52.265821 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bb2f9-5b1b-4ca8-a1e2-23f533c196b3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:28:52.269422 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b35f55-b059-4832-990f-153b8f2ec44c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:28:52.270056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b35f55-b059-4832-990f-153b8f2ec44c service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:52.270337 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b35f55-b059-4832-990f-153b8f2ec44c service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:52.270611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b35f55-b059-4832-990f-153b8f2ec44c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:52.279582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b35f55-b059-4832-990f-153b8f2ec44c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:28:52.281030 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b35f55-b059-4832-990f-153b8f2ec44c service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:28:52.291029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 745/1487] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:28:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:28:54.573821 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ef7c3-6f73-4c34-ab28-2a5b62c903f7 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:54.574441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ef7c3-6f73-4c34-ab28-2a5b62c903f7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:54.574441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ef7c3-6f73-4c34-ab28-2a5b62c903f7 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:54.575879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 743/1488] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:28:54.581117 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a64e2a-17c8-4366-9291-31bede1bca0f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:54.581600 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a64e2a-17c8-4366-9291-31bede1bca0f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:54.581708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a64e2a-17c8-4366-9291-31bede1bca0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:54.600323 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-91a64e2a-17c8-4366-9291-31bede1bca0f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:54.601842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-91a64e2a-17c8-4366-9291-31bede1bca0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:54.609646 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 746/1489] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:28:54.650683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ef7c3-6f73-4c34-ab28-2a5b62c903f7 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:28:54.661294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ef7c3-6f73-4c34-ab28-2a5b62c903f7 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:28:54.665734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb13936-025f-4205-9084-670388242810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:28:54.666364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb13936-025f-4205-9084-670388242810 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:54.666644 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb13936-025f-4205-9084-670388242810 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:54.666917 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb13936-025f-4205-9084-670388242810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:54.676192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb13936-025f-4205-9084-670388242810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:28:54.677711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb13936-025f-4205-9084-670388242810 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:28:54.688464 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 744/1490] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:28:57.198123 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5d990-a4c9-49f5-9143-80707fbe79eb None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:57.198686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5d990-a4c9-49f5-9143-80707fbe79eb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:57.198686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5d990-a4c9-49f5-9143-80707fbe79eb None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:57.200098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 747/1491] 10.222.0.52 () {54 vars in 926 bytes} [Fri Jun 17 07:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:28:57.205711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983b151-e4a8-4656-a10d-86d141ef7b15 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:57.210027 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983b151-e4a8-4656-a10d-86d141ef7b15 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:57.210027 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983b151-e4a8-4656-a10d-86d141ef7b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:57.224121 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6983b151-e4a8-4656-a10d-86d141ef7b15 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:28:57.225342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6983b151-e4a8-4656-a10d-86d141ef7b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:28:57.233834 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 745/1492] 10.222.0.52 () {58 vars in 1023 bytes} [Fri Jun 17 07:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:28:57.273489 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5d990-a4c9-49f5-9143-80707fbe79eb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:28:57.284272 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5d990-a4c9-49f5-9143-80707fbe79eb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:28:57.287858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c28cc-d15f-43cf-ac95-1e150d01de62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:28:57.288723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c28cc-d15f-43cf-ac95-1e150d01de62 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:28:57.289008 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c28cc-d15f-43cf-ac95-1e150d01de62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:28:57.289286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c28cc-d15f-43cf-ac95-1e150d01de62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:28:57.298167 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c28cc-d15f-43cf-ac95-1e150d01de62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:28:57.299598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c28cc-d15f-43cf-ac95-1e150d01de62 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:28:57.309877 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 748/1493] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:29:07.219136 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=33 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:29:07.305460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=33 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:30:32.094769 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c5f88-da39-49c2-a549-8786ab7f0a40 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:30:32.095341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c5f88-da39-49c2-a549-8786ab7f0a40 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:30:32.095341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c5f88-da39-49c2-a549-8786ab7f0a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:30:32.114410 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3c0c5f88-da39-49c2-a549-8786ab7f0a40 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:30:32.115598 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3c0c5f88-da39-49c2-a549-8786ab7f0a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:30:32.123789 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 746/1494] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:30:32.133474 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3f450-1654-4ab6-8b0a-ddf14d1a4736 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:30:32.133990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3f450-1654-4ab6-8b0a-ddf14d1a4736 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:30:32.134093 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3f450-1654-4ab6-8b0a-ddf14d1a4736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:30:32.153203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4ee3f450-1654-4ab6-8b0a-ddf14d1a4736 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:30:32.154472 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4ee3f450-1654-4ab6-8b0a-ddf14d1a4736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:30:32.162756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 749/1495] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:30:32.167874 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c5f88-da39-49c2-a549-8786ab7f0a40 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:30:32.178102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c5f88-da39-49c2-a549-8786ab7f0a40 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:30:32.183527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7d3de-e795-4d88-aa37-2532fe3427ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:30:32.184314 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7d3de-e795-4d88-aa37-2532fe3427ac admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:30:32.184605 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7d3de-e795-4d88-aa37-2532fe3427ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:30:32.185046 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7d3de-e795-4d88-aa37-2532fe3427ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:30:32.185630 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7d3de-e795-4d88-aa37-2532fe3427ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:30:32.185938 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7d3de-e795-4d88-aa37-2532fe3427ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:30:32.186963 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: WARNING py.warnings [None req-55f7d3de-e795-4d88-aa37-2532fe3427ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:30:32.186963 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: warnings.warn(msg) Jun 17 07:30:32.186963 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: Jun 17 07:30:32.187856 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7d3de-e795-4d88-aa37-2532fe3427ac admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:30:32.204956 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 747/1496] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:30:32.209139 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3f450-1654-4ab6-8b0a-ddf14d1a4736 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:30:32.218953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3f450-1654-4ab6-8b0a-ddf14d1a4736 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:30:32.225003 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13811240-010c-43da-b0f5-9459fd709e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:30:32.225703 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811240-010c-43da-b0f5-9459fd709e2b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:30:32.225985 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811240-010c-43da-b0f5-9459fd709e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:30:32.226312 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811240-010c-43da-b0f5-9459fd709e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:30:32.227798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13811240-010c-43da-b0f5-9459fd709e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:30:32.229579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-13811240-010c-43da-b0f5-9459fd709e2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:30:32.229579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 17 07:30:32.229579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: Jun 17 07:30:32.230771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13811240-010c-43da-b0f5-9459fd709e2b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:30:32.329455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 750/1497] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:30:32 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:30:32.333838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7d3de-e795-4d88-aa37-2532fe3427ac admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:30:32.344334 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7d3de-e795-4d88-aa37-2532fe3427ac admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:30:32.403849 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34101d4-58c9-4516-9e51-ced83ffa7d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:30:32.404458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34101d4-58c9-4516-9e51-ced83ffa7d72 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:30:32.404741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34101d4-58c9-4516-9e51-ced83ffa7d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:30:32.405135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34101d4-58c9-4516-9e51-ced83ffa7d72 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:30:32.405924 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34101d4-58c9-4516-9e51-ced83ffa7d72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:30:32.406951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: WARNING py.warnings [None req-d34101d4-58c9-4516-9e51-ced83ffa7d72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:30:32.406951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: warnings.warn(msg) Jun 17 07:30:32.406951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: Jun 17 07:30:32.408213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34101d4-58c9-4516-9e51-ced83ffa7d72 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:30:32.486268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 748/1498] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:30:32 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:30:32.490678 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13811240-010c-43da-b0f5-9459fd709e2b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:30:32.502250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13811240-010c-43da-b0f5-9459fd709e2b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:30:32.507982 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf564ea-3c31-43db-bd29-0b01b9e2f4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:30:32.508710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf564ea-3c31-43db-bd29-0b01b9e2f4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:30:32.509004 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf564ea-3c31-43db-bd29-0b01b9e2f4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:30:32.509280 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf564ea-3c31-43db-bd29-0b01b9e2f4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:30:32.510100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf564ea-3c31-43db-bd29-0b01b9e2f4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:30:32.511129 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-5bf564ea-3c31-43db-bd29-0b01b9e2f4d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:30:32.511129 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 17 07:30:32.511129 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: Jun 17 07:30:32.512013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf564ea-3c31-43db-bd29-0b01b9e2f4d9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:30:32.526279 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 751/1499] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:30:32.530482 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34101d4-58c9-4516-9e51-ced83ffa7d72 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:30:32.542792 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34101d4-58c9-4516-9e51-ced83ffa7d72 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:30:32.549058 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b915a80-61d3-4f4c-aec4-8d66342a1312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:30:32.549864 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b915a80-61d3-4f4c-aec4-8d66342a1312 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:30:32.550148 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b915a80-61d3-4f4c-aec4-8d66342a1312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:30:32.550454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b915a80-61d3-4f4c-aec4-8d66342a1312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:30:32.551151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b915a80-61d3-4f4c-aec4-8d66342a1312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:30:32.552233 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: WARNING py.warnings [None req-5b915a80-61d3-4f4c-aec4-8d66342a1312 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:30:32.552233 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: warnings.warn(msg) Jun 17 07:30:32.552233 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: Jun 17 07:30:32.553156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b915a80-61d3-4f4c-aec4-8d66342a1312 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:30:32.567943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 749/1500] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:30:32.572577 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf564ea-3c31-43db-bd29-0b01b9e2f4d9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:30:32.583428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf564ea-3c31-43db-bd29-0b01b9e2f4d9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:30:32.589090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734a0f7-34ec-4cd2-a2e2-a4d0e391c8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:30:32.594706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734a0f7-34ec-4cd2-a2e2-a4d0e391c8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:30:32.594706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734a0f7-34ec-4cd2-a2e2-a4d0e391c8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:30:32.594706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734a0f7-34ec-4cd2-a2e2-a4d0e391c8f1 admin admin] PATH_INFO: `/v3/projects/7bfd3e297ff746e580c711ac29ceddbf/users/911bde75f77142d883bfead5acd69759/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:30:32.607668 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734a0f7-34ec-4cd2-a2e2-a4d0e391c8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfd3e297ff746e580c711ac29ceddbf, user_id=911bde75f77142d883bfead5acd69759, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:30:32.608728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-1734a0f7-34ec-4cd2-a2e2-a4d0e391c8f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:30:32.608728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 17 07:30:32.608728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: Jun 17 07:30:32.610739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734a0f7-34ec-4cd2-a2e2-a4d0e391c8f1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:30:32.737457 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 752/1501] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:30:32 2022] PUT /identity/v3/projects/7bfd3e297ff746e580c711ac29ceddbf/users/911bde75f77142d883bfead5acd69759/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:30:32.748601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a28037-0392-4041-8589-57712d2c3c3e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:30:32.748883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a28037-0392-4041-8589-57712d2c3c3e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:30:32.749159 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a28037-0392-4041-8589-57712d2c3c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:30:32.778875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f6a28037-0392-4041-8589-57712d2c3c3e None None] MFA Rules not processed for user `911bde75f77142d883bfead5acd69759`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:30:32.780236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f6a28037-0392-4041-8589-57712d2c3c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:30:32.846676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 750/1502] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:30:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:30:32.860417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261963f-f99e-4e21-9ba9-3bc38f3f5954 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:30:32.860709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261963f-f99e-4e21-9ba9-3bc38f3f5954 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:30:32.860988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261963f-f99e-4e21-9ba9-3bc38f3f5954 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:30:32.862384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 753/1503] 10.222.0.52 () {54 vars in 963 bytes} [Fri Jun 17 07:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:30:32.867763 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035f11d-60b5-4d2b-a1c7-c11ea8727850 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:30:32.868057 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035f11d-60b5-4d2b-a1c7-c11ea8727850 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:30:32.868335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035f11d-60b5-4d2b-a1c7-c11ea8727850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:30:32.887138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4035f11d-60b5-4d2b-a1c7-c11ea8727850 None None] MFA Rules not processed for user `afefcf9ac054459c9585d8be3c604fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:30:32.888336 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4035f11d-60b5-4d2b-a1c7-c11ea8727850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:30:32.933500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:30:32.940763 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 751/1504] 10.222.0.52 () {58 vars in 1060 bytes} [Fri Jun 17 07:30:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:30:32.948737 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261963f-f99e-4e21-9ba9-3bc38f3f5954 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:30:32.959790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261963f-f99e-4e21-9ba9-3bc38f3f5954 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:30:32.964152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debaca8f-160b-4561-b8e8-d80cf8284458 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:30:32.964800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaca8f-160b-4561-b8e8-d80cf8284458 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:30:32.965084 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaca8f-160b-4561-b8e8-d80cf8284458 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:30:32.965394 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaca8f-160b-4561-b8e8-d80cf8284458 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:30:32.975817 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debaca8f-160b-4561-b8e8-d80cf8284458 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:30:32.978173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debaca8f-160b-4561-b8e8-d80cf8284458 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:30:32.987791 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 754/1505] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:30:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:30:33.032402 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcfa8d-3872-4e0e-9767-c8dc8c91829e None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:30:33.032691 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcfa8d-3872-4e0e-9767-c8dc8c91829e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:30:33.032968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcfa8d-3872-4e0e-9767-c8dc8c91829e None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:30:33.034321 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 752/1506] 10.222.0.52 () {52 vars in 829 bytes} [Fri Jun 17 07:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:30:33.037999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debaca8f-160b-4561-b8e8-d80cf8284458 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:30:33.103837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debaca8f-160b-4561-b8e8-d80cf8284458 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:30:33.108420 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8512f84-c38b-4a80-9748-1e858ea86f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:30:33.109302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8512f84-c38b-4a80-9748-1e858ea86f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:30:33.109609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8512f84-c38b-4a80-9748-1e858ea86f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:30:33.109878 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8512f84-c38b-4a80-9748-1e858ea86f41 admin admin] PATH_INFO: `/v3/users/911bde75f77142d883bfead5acd69759` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:30:33.111084 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8512f84-c38b-4a80-9748-1e858ea86f41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=911bde75f77142d883bfead5acd69759)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:30:33.112125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-f8512f84-c38b-4a80-9748-1e858ea86f41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:30:33.112125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 17 07:30:33.112125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: Jun 17 07:30:33.113399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8512f84-c38b-4a80-9748-1e858ea86f41 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:30:33.337648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f8512f84-c38b-4a80-9748-1e858ea86f41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '911bde75f77142d883bfead5acd69759'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:30:33.357060 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f8512f84-c38b-4a80-9748-1e858ea86f41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '911bde75f77142d883bfead5acd69759'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:30:33.370183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f8512f84-c38b-4a80-9748-1e858ea86f41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '911bde75f77142d883bfead5acd69759'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:30:33.371041 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f8512f84-c38b-4a80-9748-1e858ea86f41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '911bde75f77142d883bfead5acd69759'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:30:33.371796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f8512f84-c38b-4a80-9748-1e858ea86f41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '911bde75f77142d883bfead5acd69759'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:30:33.376122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:30:33.492274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 755/1507] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:30:33 2022] DELETE /identity/v3/users/911bde75f77142d883bfead5acd69759 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:30:33.493273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4891628-781f-4f86-98bb-ac37c9f369c4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:30:33.493833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4891628-781f-4f86-98bb-ac37c9f369c4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:30:33.493937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4891628-781f-4f86-98bb-ac37c9f369c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:30:33.514061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b4891628-781f-4f86-98bb-ac37c9f369c4 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:30:33.515325 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b4891628-781f-4f86-98bb-ac37c9f369c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:30:33.576326 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 753/1508] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:30:33.586181 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8512f84-c38b-4a80-9748-1e858ea86f41 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:30:33.590766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f8512f84-c38b-4a80-9748-1e858ea86f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:30:33.650637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8512f84-c38b-4a80-9748-1e858ea86f41 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:30:33.654567 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac7777-8ff9-430a-b537-4ff12fe87320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:30:33.655231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac7777-8ff9-430a-b537-4ff12fe87320 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:30:33.655514 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac7777-8ff9-430a-b537-4ff12fe87320 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:30:33.655790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac7777-8ff9-430a-b537-4ff12fe87320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:30:33.672453 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac7777-8ff9-430a-b537-4ff12fe87320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:30:33.673949 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac7777-8ff9-430a-b537-4ff12fe87320 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:30:33.685316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 756/1509] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:30:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:30:34.298638 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4891628-781f-4f86-98bb-ac37c9f369c4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:30:34.300054 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b4891628-781f-4f86-98bb-ac37c9f369c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:30:34.314064 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4891628-781f-4f86-98bb-ac37c9f369c4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:30:34.319237 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f189d68-31ee-4ff5-9327-9c98ca13afd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:30:34.320148 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f189d68-31ee-4ff5-9327-9c98ca13afd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:30:34.320526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f189d68-31ee-4ff5-9327-9c98ca13afd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:30:34.320801 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f189d68-31ee-4ff5-9327-9c98ca13afd3 admin admin] PATH_INFO: `/v3/projects/7bfd3e297ff746e580c711ac29ceddbf` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:30:34.322348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f189d68-31ee-4ff5-9327-9c98ca13afd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bfd3e297ff746e580c711ac29ceddbf)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:30:34.323817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: WARNING py.warnings [None req-9f189d68-31ee-4ff5-9327-9c98ca13afd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:30:34.323817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: warnings.warn(msg) Jun 17 07:30:34.323817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: Jun 17 07:30:34.324676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f189d68-31ee-4ff5-9327-9c98ca13afd3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:30:34.455207 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9f189d68-31ee-4ff5-9327-9c98ca13afd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bfd3e297ff746e580c711ac29ceddbf', 'request_id': 'req-9f189d68-31ee-4ff5-9327-9c98ca13afd3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:30:34.470116 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9f189d68-31ee-4ff5-9327-9c98ca13afd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bfd3e297ff746e580c711ac29ceddbf', 'request_id': 'req-9f189d68-31ee-4ff5-9327-9c98ca13afd3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:30:34.560750 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9f189d68-31ee-4ff5-9327-9c98ca13afd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bfd3e297ff746e580c711ac29ceddbf', 'request_id': 'req-9f189d68-31ee-4ff5-9327-9c98ca13afd3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:30:34.568658 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9f189d68-31ee-4ff5-9327-9c98ca13afd3 admin admin] The token cache is being invalidate because project 7bfd3e297ff746e580c711ac29ceddbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:30:34.568941 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9f189d68-31ee-4ff5-9327-9c98ca13afd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:30:34.569616 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9f189d68-31ee-4ff5-9327-9c98ca13afd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:30:34.572039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 754/1510] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:30:34 2022] DELETE /identity/v3/projects/7bfd3e297ff746e580c711ac29ceddbf => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:30:43.680354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:30:44.565209 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:32:17.476853 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb7907-b822-4a93-ae98-d585e855235a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:17.477464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb7907-b822-4a93-ae98-d585e855235a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:17.477464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb7907-b822-4a93-ae98-d585e855235a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:17.478803 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 07:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:32:17.484421 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fb9a4-ed84-4086-a7ee-50a6fd62dbff None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:17.484872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fb9a4-ed84-4086-a7ee-50a6fd62dbff None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:17.484967 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fb9a4-ed84-4086-a7ee-50a6fd62dbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:17.505273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8b3fb9a4-ed84-4086-a7ee-50a6fd62dbff None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:32:17.506763 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8b3fb9a4-ed84-4086-a7ee-50a6fd62dbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:32:17.577489 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 07:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:32:17.752132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb7907-b822-4a93-ae98-d585e855235a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:32:17.754145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2afb7907-b822-4a93-ae98-d585e855235a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:32:17.828603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb7907-b822-4a93-ae98-d585e855235a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:32:17.834190 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfd08c-4739-4941-8304-91e6136f2a7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:32:17.834848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfd08c-4739-4941-8304-91e6136f2a7a service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:17.835130 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfd08c-4739-4941-8304-91e6136f2a7a service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:17.835435 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfd08c-4739-4941-8304-91e6136f2a7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:17.844686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfd08c-4739-4941-8304-91e6136f2a7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:32:17.846349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfd08c-4739-4941-8304-91e6136f2a7a service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:32:17.856920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 758/1513] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:32:18.760562 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a252f-d292-4e03-87a5-976e379bb28d None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:18.761694 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a252f-d292-4e03-87a5-976e379bb28d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:18.761694 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a252f-d292-4e03-87a5-976e379bb28d None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:18.763442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 07:32:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:32:18.768833 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a041867-4b79-4473-8bd1-435322c90b6f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:18.769518 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a041867-4b79-4473-8bd1-435322c90b6f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:18.769687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a041867-4b79-4473-8bd1-435322c90b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:18.789916 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3a041867-4b79-4473-8bd1-435322c90b6f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:32:18.791146 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3a041867-4b79-4473-8bd1-435322c90b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:32:18.799232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 07:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:32:18.967938 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a252f-d292-4e03-87a5-976e379bb28d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:32:18.986033 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a252f-d292-4e03-87a5-976e379bb28d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:32:18.992948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be7dbc-43fa-4d65-8a48-a7f048b6b255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:32:18.993869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be7dbc-43fa-4d65-8a48-a7f048b6b255 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:18.994213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be7dbc-43fa-4d65-8a48-a7f048b6b255 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:18.994569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be7dbc-43fa-4d65-8a48-a7f048b6b255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:19.005710 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be7dbc-43fa-4d65-8a48-a7f048b6b255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:32:19.007328 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be7dbc-43fa-4d65-8a48-a7f048b6b255 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:32:19.017494 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 757/1516] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:32:19.166785 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe053de1-988b-46dc-9fe0-01ced1f64ac2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:19.167091 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe053de1-988b-46dc-9fe0-01ced1f64ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:19.167370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe053de1-988b-46dc-9fe0-01ced1f64ac2 None None] PATH_INFO: `/v3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:19.169704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 760/1517] 10.222.0.55 () {54 vars in 925 bytes} [Fri Jun 17 07:32:19 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:32:19.176317 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f2283-50fc-4252-8140-dd0d3deb70cf None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:19.176664 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f2283-50fc-4252-8140-dd0d3deb70cf None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:19.176946 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f2283-50fc-4252-8140-dd0d3deb70cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:19.195965 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-fb5f2283-50fc-4252-8140-dd0d3deb70cf None None] MFA Rules not processed for user `71adc8b93e5c41929b928002e004df6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:32:19.197166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fb5f2283-50fc-4252-8140-dd0d3deb70cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:32:19.268281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 758/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Fri Jun 17 07:32:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:32:28.473073 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb01c7d-c4fe-472e-b550-a2c83b7e5858 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:28.473657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb01c7d-c4fe-472e-b550-a2c83b7e5858 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:28.473657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb01c7d-c4fe-472e-b550-a2c83b7e5858 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:28.474965 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 761/1519] 10.222.0.52 () {54 vars in 960 bytes} [Fri Jun 17 07:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:32:28.480622 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32724661-5631-4453-968b-4386ed7a2f1b None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:28.481076 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32724661-5631-4453-968b-4386ed7a2f1b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:28.481177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32724661-5631-4453-968b-4386ed7a2f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:28.499502 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-32724661-5631-4453-968b-4386ed7a2f1b None None] MFA Rules not processed for user `71adc8b93e5c41929b928002e004df6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:32:28.500702 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-32724661-5631-4453-968b-4386ed7a2f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:32:28.509521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 759/1520] 10.222.0.52 () {58 vars in 1057 bytes} [Fri Jun 17 07:32:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:32:28.518022 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb01c7d-c4fe-472e-b550-a2c83b7e5858 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:32:28.532033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb01c7d-c4fe-472e-b550-a2c83b7e5858 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:32:28.537372 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a3fc5-a0e1-4f1b-b315-cf04bb82031a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adc8b93e5c41929b928002e004df6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:32:28.538049 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a3fc5-a0e1-4f1b-b315-cf04bb82031a service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:28.538353 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a3fc5-a0e1-4f1b-b315-cf04bb82031a service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:28.538630 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a3fc5-a0e1-4f1b-b315-cf04bb82031a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:28.547533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a3fc5-a0e1-4f1b-b315-cf04bb82031a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:32:28.549125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a3fc5-a0e1-4f1b-b315-cf04bb82031a service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:32:28.558842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 762/1521] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:32:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:32:30.322101 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ddfcf-dec7-4087-be7f-bd6f0c3497e1 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:30.322708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ddfcf-dec7-4087-be7f-bd6f0c3497e1 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:30.322708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ddfcf-dec7-4087-be7f-bd6f0c3497e1 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:30.324997 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 07:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:32:30.330005 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57983e-1483-4df8-8181-73144be4b892 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:30.330721 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57983e-1483-4df8-8181-73144be4b892 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:30.330721 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57983e-1483-4df8-8181-73144be4b892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:30.348386 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8d57983e-1483-4df8-8181-73144be4b892 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:32:30.349600 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8d57983e-1483-4df8-8181-73144be4b892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:32:30.357311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 07:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:32:30.514998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ddfcf-dec7-4087-be7f-bd6f0c3497e1 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:32:30.530493 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ddfcf-dec7-4087-be7f-bd6f0c3497e1 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:32:30.539841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275db7c8-1dec-43ea-8d1b-1bf13f4d3229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:32:30.539841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275db7c8-1dec-43ea-8d1b-1bf13f4d3229 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:30.539841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275db7c8-1dec-43ea-8d1b-1bf13f4d3229 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:30.539841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275db7c8-1dec-43ea-8d1b-1bf13f4d3229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:30.546273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275db7c8-1dec-43ea-8d1b-1bf13f4d3229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:32:30.547887 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275db7c8-1dec-43ea-8d1b-1bf13f4d3229 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:32:30.557705 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 761/1524] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:32:31.455903 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c964f0-28cb-4e14-b076-7a782f80e983 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:31.456476 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c964f0-28cb-4e14-b076-7a782f80e983 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:31.456476 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c964f0-28cb-4e14-b076-7a782f80e983 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:31.457865 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 07:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:32:31.462814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aef3c0-22bb-47ea-937e-4d91002d559f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:31.463260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aef3c0-22bb-47ea-937e-4d91002d559f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:31.463388 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aef3c0-22bb-47ea-937e-4d91002d559f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:31.483293 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-21aef3c0-22bb-47ea-937e-4d91002d559f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:32:31.484687 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-21aef3c0-22bb-47ea-937e-4d91002d559f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:32:31.493138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 07:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:32:31.646396 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c964f0-28cb-4e14-b076-7a782f80e983 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:32:31.661241 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c964f0-28cb-4e14-b076-7a782f80e983 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:32:31.666714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cf2aa-fb01-47cc-818f-4cc15d2a2824 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:32:31.668637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cf2aa-fb01-47cc-818f-4cc15d2a2824 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:31.668637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cf2aa-fb01-47cc-818f-4cc15d2a2824 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:31.669480 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cf2aa-fb01-47cc-818f-4cc15d2a2824 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:31.677644 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cf2aa-fb01-47cc-818f-4cc15d2a2824 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:32:31.679263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cf2aa-fb01-47cc-818f-4cc15d2a2824 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:32:31.690397 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 765/1527] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:32:35.940943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba0a8d-b31f-4995-82e9-dfb47e6f460d None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:35.941580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba0a8d-b31f-4995-82e9-dfb47e6f460d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:35.941580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba0a8d-b31f-4995-82e9-dfb47e6f460d None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:35.942819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 07:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:32:35.948678 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26d31e-0640-4498-8381-355991b14fcc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:35.949143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26d31e-0640-4498-8381-355991b14fcc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:35.949299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26d31e-0640-4498-8381-355991b14fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:35.968489 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1d26d31e-0640-4498-8381-355991b14fcc None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:32:35.969779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1d26d31e-0640-4498-8381-355991b14fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:32:35.977707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 07:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:32:36.016117 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba0a8d-b31f-4995-82e9-dfb47e6f460d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:32:36.017831 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-65ba0a8d-b31f-4995-82e9-dfb47e6f460d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:32:36.078395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba0a8d-b31f-4995-82e9-dfb47e6f460d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:32:36.081926 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb2720-cd8a-494d-8c09-2eb47d884c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:32:36.082571 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb2720-cd8a-494d-8c09-2eb47d884c5b service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:36.082850 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb2720-cd8a-494d-8c09-2eb47d884c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:36.083121 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb2720-cd8a-494d-8c09-2eb47d884c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:36.092192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb2720-cd8a-494d-8c09-2eb47d884c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:32:36.093657 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb2720-cd8a-494d-8c09-2eb47d884c5b service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:32:36.098557 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:32:36.103459 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 764/1530] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:32:38.251429 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6242cd-5e3b-45d2-859b-eb879aa09589 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:38.252002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6242cd-5e3b-45d2-859b-eb879aa09589 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:38.252002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6242cd-5e3b-45d2-859b-eb879aa09589 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:38.253765 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 07:32:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:32:38.259082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30295a-b52c-4bd6-b4d8-b17a93ff14c0 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:38.259559 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30295a-b52c-4bd6-b4d8-b17a93ff14c0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:38.259707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30295a-b52c-4bd6-b4d8-b17a93ff14c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:38.278474 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0e30295a-b52c-4bd6-b4d8-b17a93ff14c0 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:32:38.279675 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0e30295a-b52c-4bd6-b4d8-b17a93ff14c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:32:38.287457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 07:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:32:38.325774 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6242cd-5e3b-45d2-859b-eb879aa09589 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:32:38.327517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8b6242cd-5e3b-45d2-859b-eb879aa09589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:32:38.342278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6242cd-5e3b-45d2-859b-eb879aa09589 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:32:38.345829 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240171c1-7151-45f3-a62b-92a14bebd7a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:32:38.346476 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240171c1-7151-45f3-a62b-92a14bebd7a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:38.346762 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240171c1-7151-45f3-a62b-92a14bebd7a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:38.347044 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240171c1-7151-45f3-a62b-92a14bebd7a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:38.356252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240171c1-7151-45f3-a62b-92a14bebd7a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:32:38.357831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240171c1-7151-45f3-a62b-92a14bebd7a8 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:32:38.367217 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 768/1533] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:32:42.564137 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda75b81-4102-4ab5-9a08-d6abf1192250 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:42.564685 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda75b81-4102-4ab5-9a08-d6abf1192250 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:42.564685 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda75b81-4102-4ab5-9a08-d6abf1192250 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:42.566114 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 07:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:32:42.571238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13b6af-0c13-4669-995f-8f670ac56c6e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:42.571644 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13b6af-0c13-4669-995f-8f670ac56c6e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:42.571798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13b6af-0c13-4669-995f-8f670ac56c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:42.590825 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2b13b6af-0c13-4669-995f-8f670ac56c6e None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:32:42.592035 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2b13b6af-0c13-4669-995f-8f670ac56c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:32:42.599979 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 07:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:32:42.865002 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda75b81-4102-4ab5-9a08-d6abf1192250 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:32:42.866674 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fda75b81-4102-4ab5-9a08-d6abf1192250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:32:42.925343 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda75b81-4102-4ab5-9a08-d6abf1192250 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:32:42.928929 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb938ea3-3547-4e16-9600-eb34720e10d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:32:42.929610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb938ea3-3547-4e16-9600-eb34720e10d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:42.929893 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb938ea3-3547-4e16-9600-eb34720e10d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:42.930166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb938ea3-3547-4e16-9600-eb34720e10d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:42.939318 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb938ea3-3547-4e16-9600-eb34720e10d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:32:42.940767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb938ea3-3547-4e16-9600-eb34720e10d8 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:32:42.951076 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 767/1536] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:32:45.118821 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059c93c-ecd5-49c3-946b-7e41dd1693f4 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:45.119401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059c93c-ecd5-49c3-946b-7e41dd1693f4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:45.119401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059c93c-ecd5-49c3-946b-7e41dd1693f4 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:45.120768 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 07:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:32:45.126231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176627c-b3dc-477e-b7f0-ff1fb1a24a5d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:45.126644 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176627c-b3dc-477e-b7f0-ff1fb1a24a5d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:45.126766 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176627c-b3dc-477e-b7f0-ff1fb1a24a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:45.147164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3176627c-b3dc-477e-b7f0-ff1fb1a24a5d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:32:45.148387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3176627c-b3dc-477e-b7f0-ff1fb1a24a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:32:45.156920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 07:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:32:45.423503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059c93c-ecd5-49c3-946b-7e41dd1693f4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:32:45.425214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4059c93c-ecd5-49c3-946b-7e41dd1693f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:32:45.433170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=65 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:32:45.438978 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059c93c-ecd5-49c3-946b-7e41dd1693f4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:32:45.442653 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11e276-fecb-4e1e-8c01-eb344f482f55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:32:45.443298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11e276-fecb-4e1e-8c01-eb344f482f55 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:32:45.443589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11e276-fecb-4e1e-8c01-eb344f482f55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:32:45.443863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11e276-fecb-4e1e-8c01-eb344f482f55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:32:45.453265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11e276-fecb-4e1e-8c01-eb344f482f55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:32:45.454851 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11e276-fecb-4e1e-8c01-eb344f482f55 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:32:45.464769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 771/1539] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:32:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:32:55.140210 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=32 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:32:55.482752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:18.506741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e75a-7532-4c8d-aeac-1c0df4bfeea2 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:18.507362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e75a-7532-4c8d-aeac-1c0df4bfeea2 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:18.507362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e75a-7532-4c8d-aeac-1c0df4bfeea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:18.543147 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-38e0e75a-7532-4c8d-aeac-1c0df4bfeea2 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:18.544442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-38e0e75a-7532-4c8d-aeac-1c0df4bfeea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:18.556554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 769/1540] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:18.568391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81113246-8727-4ac4-a5d5-957b71886ab0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:18.569028 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81113246-8727-4ac4-a5d5-957b71886ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:18.569028 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81113246-8727-4ac4-a5d5-957b71886ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:18.602041 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-81113246-8727-4ac4-a5d5-957b71886ab0 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:18.603257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-81113246-8727-4ac4-a5d5-957b71886ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:18.621235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 772/1541] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:34:18.626453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0e75a-7532-4c8d-aeac-1c0df4bfeea2 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:18.631379 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976c9a0-164e-4ae4-a80e-a10599372d3e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:18.631880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976c9a0-164e-4ae4-a80e-a10599372d3e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:18.632330 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976c9a0-164e-4ae4-a80e-a10599372d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:18.643208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0e75a-7532-4c8d-aeac-1c0df4bfeea2 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:18.651429 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcd3fe-28d0-4bc5-8df6-bde4b681d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:18.652428 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcd3fe-28d0-4bc5-8df6-bde4b681d319 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:18.652913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcd3fe-28d0-4bc5-8df6-bde4b681d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:18.653446 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcd3fe-28d0-4bc5-8df6-bde4b681d319 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:18.654370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bcd3fe-28d0-4bc5-8df6-bde4b681d319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:34:18.654856 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bcd3fe-28d0-4bc5-8df6-bde4b681d319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:18.656785 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bcd3fe-28d0-4bc5-8df6-bde4b681d319 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:18.667038 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5976c9a0-164e-4ae4-a80e-a10599372d3e None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:18.668270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5976c9a0-164e-4ae4-a80e-a10599372d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:18.692246 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 773/1542] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:34:18.693936 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf6cfb-786e-4a2b-af67-af905fb993df None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:18.694407 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf6cfb-786e-4a2b-af67-af905fb993df None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:18.694846 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf6cfb-786e-4a2b-af67-af905fb993df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:18.700404 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 770/1543] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:34:18.730561 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcd3fe-28d0-4bc5-8df6-bde4b681d319 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:18.742663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-74cf6cfb-786e-4a2b-af67-af905fb993df None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:18.744172 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-74cf6cfb-786e-4a2b-af67-af905fb993df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:18.748691 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcd3fe-28d0-4bc5-8df6-bde4b681d319 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:18.755900 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039ad9a-47ad-4ed3-9fad-cb0b78178f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:18.757171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039ad9a-47ad-4ed3-9fad-cb0b78178f33 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:18.761907 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039ad9a-47ad-4ed3-9fad-cb0b78178f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:18.762432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039ad9a-47ad-4ed3-9fad-cb0b78178f33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:18.763683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039ad9a-47ad-4ed3-9fad-cb0b78178f33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:18.765350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: WARNING py.warnings [None req-e039ad9a-47ad-4ed3-9fad-cb0b78178f33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:34:18.765350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: warnings.warn(msg) Jun 17 07:34:18.765350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: Jun 17 07:34:18.767292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039ad9a-47ad-4ed3-9fad-cb0b78178f33 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:18.772852 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 774/1544] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:18.773652 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3b228-e0d5-4db8-8abb-8109de0d6e5d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:18.773944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3b228-e0d5-4db8-8abb-8109de0d6e5d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:18.774220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3b228-e0d5-4db8-8abb-8109de0d6e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:18.911974 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 771/1545] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:18 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:34:18.918793 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae2894-909c-4c09-a5c7-fc7722d595cf None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:18.919467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae2894-909c-4c09-a5c7-fc7722d595cf None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:18.920018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae2894-909c-4c09-a5c7-fc7722d595cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:18.933459 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d6c3b228-e0d5-4db8-8abb-8109de0d6e5d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:18.935535 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d6c3b228-e0d5-4db8-8abb-8109de0d6e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:18.941558 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6fae2894-909c-4c09-a5c7-fc7722d595cf None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:18.942738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6fae2894-909c-4c09-a5c7-fc7722d595cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:18.998193 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 775/1546] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:18.999625 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17f570-136e-45a2-bda7-1e2b2471d2c0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:18.999914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17f570-136e-45a2-bda7-1e2b2471d2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.000447 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17f570-136e-45a2-bda7-1e2b2471d2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.003452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 772/1547] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:19.003452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd7fc8-79ba-4435-8644-bbdc4edf8700 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.003452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd7fc8-79ba-4435-8644-bbdc4edf8700 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.003452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd7fc8-79ba-4435-8644-bbdc4edf8700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.023049 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3c17f570-136e-45a2-bda7-1e2b2471d2c0 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:19.024179 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3c17f570-136e-45a2-bda7-1e2b2471d2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:19.024850 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-afbd7fc8-79ba-4435-8644-bbdc4edf8700 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:19.026570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-afbd7fc8-79ba-4435-8644-bbdc4edf8700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:19.032807 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 776/1548] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:19.034316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722438f-42e5-4f7e-bc8d-0b84f0d370d1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.034452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 773/1549] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:19.034634 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722438f-42e5-4f7e-bc8d-0b84f0d370d1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.034877 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722438f-42e5-4f7e-bc8d-0b84f0d370d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.035172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd7fc8-79ba-4435-8644-bbdc4edf8700 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.044608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd7fc8-79ba-4435-8644-bbdc4edf8700 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.049430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54848c42-fa28-4c48-8100-8151f56e9f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.050090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54848c42-fa28-4c48-8100-8151f56e9f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.050366 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54848c42-fa28-4c48-8100-8151f56e9f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.050639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54848c42-fa28-4c48-8100-8151f56e9f48 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.051319 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54848c42-fa28-4c48-8100-8151f56e9f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.053235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54848c42-fa28-4c48-8100-8151f56e9f48 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.056353 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7722438f-42e5-4f7e-bc8d-0b84f0d370d1 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:19.058239 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7722438f-42e5-4f7e-bc8d-0b84f0d370d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:19.066302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 777/1550] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:19.067523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8744812-8c0c-4bdd-9c6b-d8c00ef2034d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.067809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8744812-8c0c-4bdd-9c6b-d8c00ef2034d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.068086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8744812-8c0c-4bdd-9c6b-d8c00ef2034d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.086376 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b8744812-8c0c-4bdd-9c6b-d8c00ef2034d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:19.087565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b8744812-8c0c-4bdd-9c6b-d8c00ef2034d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:19.096019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 778/1551] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:19.097211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c254a9-1256-48de-92be-93611cb8d005 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.097528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c254a9-1256-48de-92be-93611cb8d005 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.097806 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c254a9-1256-48de-92be-93611cb8d005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.115187 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-54c254a9-1256-48de-92be-93611cb8d005 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:19.116473 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-54c254a9-1256-48de-92be-93611cb8d005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:19.125759 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 779/1552] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:19.126770 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c254a9-1256-48de-92be-93611cb8d005 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.136788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c254a9-1256-48de-92be-93611cb8d005 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.141284 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ede14-7a69-409d-99cf-a43e7d6de59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.141949 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ede14-7a69-409d-99cf-a43e7d6de59a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.142232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ede14-7a69-409d-99cf-a43e7d6de59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.142507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ede14-7a69-409d-99cf-a43e7d6de59a admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.143221 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ede14-7a69-409d-99cf-a43e7d6de59a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:34:19.143527 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ede14-7a69-409d-99cf-a43e7d6de59a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.144530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-720ede14-7a69-409d-99cf-a43e7d6de59a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:34:19.144530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 17 07:34:19.144530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: Jun 17 07:34:19.145424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ede14-7a69-409d-99cf-a43e7d6de59a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.157755 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 780/1553] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:34:19.158906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4b191-9de1-4dc6-a49c-33d3095540af None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.159199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4b191-9de1-4dc6-a49c-33d3095540af None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.159479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4b191-9de1-4dc6-a49c-33d3095540af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.172310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 774/1554] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:19.172310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54848c42-fa28-4c48-8100-8151f56e9f48 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.177242 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9af4b191-9de1-4dc6-a49c-33d3095540af None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:19.178484 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9af4b191-9de1-4dc6-a49c-33d3095540af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:19.181389 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54848c42-fa28-4c48-8100-8151f56e9f48 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.186457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c434d6c-87d6-4656-8b82-1ecb13c44d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.186889 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 781/1555] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:19.187103 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c434d6c-87d6-4656-8b82-1ecb13c44d98 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.187382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c434d6c-87d6-4656-8b82-1ecb13c44d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.187655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c434d6c-87d6-4656-8b82-1ecb13c44d98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.188093 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebf5d3-7188-45e3-9b8f-3e4cc45507de None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.188367 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c434d6c-87d6-4656-8b82-1ecb13c44d98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:34:19.188478 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebf5d3-7188-45e3-9b8f-3e4cc45507de None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.188637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebf5d3-7188-45e3-9b8f-3e4cc45507de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.188742 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c434d6c-87d6-4656-8b82-1ecb13c44d98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.190328 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c434d6c-87d6-4656-8b82-1ecb13c44d98 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.203870 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 775/1556] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:34:19.205122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca49bc1-3ce1-4abf-ab60-c35cceb696c4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.205437 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca49bc1-3ce1-4abf-ab60-c35cceb696c4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.205711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca49bc1-3ce1-4abf-ab60-c35cceb696c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.210759 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ffebf5d3-7188-45e3-9b8f-3e4cc45507de None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:19.211863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ffebf5d3-7188-45e3-9b8f-3e4cc45507de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:19.219947 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 782/1557] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:19.223680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dd264-7260-4a15-bb11-4981ee4f5d7a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.223680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dd264-7260-4a15-bb11-4981ee4f5d7a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.223680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dd264-7260-4a15-bb11-4981ee4f5d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.230307 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-5ca49bc1-3ce1-4abf-ab60-c35cceb696c4 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:19.231492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5ca49bc1-3ce1-4abf-ab60-c35cceb696c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:19.239246 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-775dd264-7260-4a15-bb11-4981ee4f5d7a None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:19.239800 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 776/1558] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:19.240406 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-775dd264-7260-4a15-bb11-4981ee4f5d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:19.241005 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad83ac5-c353-480d-99c2-f0a466468b13 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.241288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad83ac5-c353-480d-99c2-f0a466468b13 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.241594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad83ac5-c353-480d-99c2-f0a466468b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.248870 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 783/1559] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:19.249731 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dd264-7260-4a15-bb11-4981ee4f5d7a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.259218 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dd264-7260-4a15-bb11-4981ee4f5d7a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.261250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4ad83ac5-c353-480d-99c2-f0a466468b13 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:19.262543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4ad83ac5-c353-480d-99c2-f0a466468b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:19.264377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9194b-b439-4d15-9d57-e6ba2fac5075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.265018 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9194b-b439-4d15-9d57-e6ba2fac5075 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.265345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9194b-b439-4d15-9d57-e6ba2fac5075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.265625 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9194b-b439-4d15-9d57-e6ba2fac5075 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.266307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9194b-b439-4d15-9d57-e6ba2fac5075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.268194 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9194b-b439-4d15-9d57-e6ba2fac5075 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.270365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 777/1560] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:19.271115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad83ac5-c353-480d-99c2-f0a466468b13 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.280208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad83ac5-c353-480d-99c2-f0a466468b13 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.284616 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0a515-9b6e-480f-84fd-00b7de0e7a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.285263 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0a515-9b6e-480f-84fd-00b7de0e7a82 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.285567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0a515-9b6e-480f-84fd-00b7de0e7a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.285838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0a515-9b6e-480f-84fd-00b7de0e7a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.286541 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0a515-9b6e-480f-84fd-00b7de0e7a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.288113 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0a515-9b6e-480f-84fd-00b7de0e7a82 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.298882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 778/1561] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:19.299660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0a515-9b6e-480f-84fd-00b7de0e7a82 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.308758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0a515-9b6e-480f-84fd-00b7de0e7a82 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.313274 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87902e1f-2ee2-4d66-99a7-8849f98f3de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.313903 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902e1f-2ee2-4d66-99a7-8849f98f3de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.314181 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902e1f-2ee2-4d66-99a7-8849f98f3de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.314454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902e1f-2ee2-4d66-99a7-8849f98f3de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.315145 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87902e1f-2ee2-4d66-99a7-8849f98f3de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:34:19.315446 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87902e1f-2ee2-4d66-99a7-8849f98f3de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.317015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87902e1f-2ee2-4d66-99a7-8849f98f3de3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.329109 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 779/1562] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:34:19.329863 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87902e1f-2ee2-4d66-99a7-8849f98f3de3 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.341904 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87902e1f-2ee2-4d66-99a7-8849f98f3de3 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.346596 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e84873-fc94-45cc-8f10-626e85298424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.347250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e84873-fc94-45cc-8f10-626e85298424 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.347497 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e84873-fc94-45cc-8f10-626e85298424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.347792 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e84873-fc94-45cc-8f10-626e85298424 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.348429 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e84873-fc94-45cc-8f10-626e85298424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.350440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e84873-fc94-45cc-8f10-626e85298424 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.352894 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 784/1563] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/projects => generated 391 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:19.355745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9194b-b439-4d15-9d57-e6ba2fac5075 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.416920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9194b-b439-4d15-9d57-e6ba2fac5075 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.421764 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b78a4e-9ac0-449b-9873-c7e549e2c539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.422425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b78a4e-9ac0-449b-9873-c7e549e2c539 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.422702 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b78a4e-9ac0-449b-9873-c7e549e2c539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.422972 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b78a4e-9ac0-449b-9873-c7e549e2c539 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.423690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b78a4e-9ac0-449b-9873-c7e549e2c539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:34:19.423991 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b78a4e-9ac0-449b-9873-c7e549e2c539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.425666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b78a4e-9ac0-449b-9873-c7e549e2c539 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.427104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:19.437372 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 785/1564] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:34:19.438168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b78a4e-9ac0-449b-9873-c7e549e2c539 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.446651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 780/1565] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:19.446651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e84873-fc94-45cc-8f10-626e85298424 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.455571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b78a4e-9ac0-449b-9873-c7e549e2c539 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.474462 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:19.507802 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb816ef-9c09-4482-bd02-98f7e4ef1143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.510775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb816ef-9c09-4482-bd02-98f7e4ef1143 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.510775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb816ef-9c09-4482-bd02-98f7e4ef1143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.510775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb816ef-9c09-4482-bd02-98f7e4ef1143 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.510775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb816ef-9c09-4482-bd02-98f7e4ef1143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:34:19.511165 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb816ef-9c09-4482-bd02-98f7e4ef1143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.511742 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e84873-fc94-45cc-8f10-626e85298424 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.512632 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb816ef-9c09-4482-bd02-98f7e4ef1143 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.516511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecf6c8-ba69-4e0e-9d37-2153678d91af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.517166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecf6c8-ba69-4e0e-9d37-2153678d91af admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.517491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecf6c8-ba69-4e0e-9d37-2153678d91af admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.517762 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecf6c8-ba69-4e0e-9d37-2153678d91af admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.518477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cecf6c8-ba69-4e0e-9d37-2153678d91af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:34:19.518834 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cecf6c8-ba69-4e0e-9d37-2153678d91af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.520445 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cecf6c8-ba69-4e0e-9d37-2153678d91af admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.524108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 786/1566] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:34:19.525046 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb816ef-9c09-4482-bd02-98f7e4ef1143 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.536528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 781/1567] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:34:19.536528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecf6c8-ba69-4e0e-9d37-2153678d91af admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.545082 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb816ef-9c09-4482-bd02-98f7e4ef1143 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.545241 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecf6c8-ba69-4e0e-9d37-2153678d91af admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.549854 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b16b5-a20a-4bbc-9759-694bc233452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.550513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b16b5-a20a-4bbc-9759-694bc233452d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.550627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138bc17-e50b-44d6-b824-35a50d17a056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.550798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b16b5-a20a-4bbc-9759-694bc233452d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.551101 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b16b5-a20a-4bbc-9759-694bc233452d admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.551232 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138bc17-e50b-44d6-b824-35a50d17a056 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.551519 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138bc17-e50b-44d6-b824-35a50d17a056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.551794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138bc17-e50b-44d6-b824-35a50d17a056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.551949 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b16b5-a20a-4bbc-9759-694bc233452d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:34:19.552262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b16b5-a20a-4bbc-9759-694bc233452d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.552513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138bc17-e50b-44d6-b824-35a50d17a056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.554150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138bc17-e50b-44d6-b824-35a50d17a056 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.554684 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b16b5-a20a-4bbc-9759-694bc233452d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.564464 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 782/1568] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:19.565259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138bc17-e50b-44d6-b824-35a50d17a056 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.571100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 787/1569] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:34:19.572196 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b16b5-a20a-4bbc-9759-694bc233452d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.576196 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138bc17-e50b-44d6-b824-35a50d17a056 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.580906 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23329c1c-d49b-4acb-8351-48d3c908524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.581624 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23329c1c-d49b-4acb-8351-48d3c908524e admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.587006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23329c1c-d49b-4acb-8351-48d3c908524e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.587006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23329c1c-d49b-4acb-8351-48d3c908524e admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.587006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23329c1c-d49b-4acb-8351-48d3c908524e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.587442 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b16b5-a20a-4bbc-9759-694bc233452d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.587548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23329c1c-d49b-4acb-8351-48d3c908524e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.588891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4f97f-54ce-4f10-bcf4-5dac5a89fde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.589597 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4f97f-54ce-4f10-bcf4-5dac5a89fde6 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.589880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4f97f-54ce-4f10-bcf4-5dac5a89fde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.590149 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4f97f-54ce-4f10-bcf4-5dac5a89fde6 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.591136 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4f97f-54ce-4f10-bcf4-5dac5a89fde6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.591816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-16c4f97f-54ce-4f10-bcf4-5dac5a89fde6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:34:19.591816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 17 07:34:19.591816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: Jun 17 07:34:19.593051 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4f97f-54ce-4f10-bcf4-5dac5a89fde6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.688066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 783/1570] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:19.688878 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23329c1c-d49b-4acb-8351-48d3c908524e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.708809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 788/1571] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/users => generated 296 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:19.710021 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4f97f-54ce-4f10-bcf4-5dac5a89fde6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.720812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4f97f-54ce-4f10-bcf4-5dac5a89fde6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.754455 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23329c1c-d49b-4acb-8351-48d3c908524e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.760807 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83acda0-bfea-4a90-8466-5b8bf2042075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.761662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83acda0-bfea-4a90-8466-5b8bf2042075 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.761945 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83acda0-bfea-4a90-8466-5b8bf2042075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.762221 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83acda0-bfea-4a90-8466-5b8bf2042075 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.762913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83acda0-bfea-4a90-8466-5b8bf2042075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.764864 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83acda0-bfea-4a90-8466-5b8bf2042075 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.781950 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e60755-af42-4969-8a58-e4f4578d18a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.782613 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60755-af42-4969-8a58-e4f4578d18a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.782879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60755-af42-4969-8a58-e4f4578d18a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.783157 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60755-af42-4969-8a58-e4f4578d18a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.783847 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e60755-af42-4969-8a58-e4f4578d18a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.785814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e60755-af42-4969-8a58-e4f4578d18a7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.855889 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 784/1572] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:19.856706 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83acda0-bfea-4a90-8466-5b8bf2042075 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.867308 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 789/1573] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:19.868056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e60755-af42-4969-8a58-e4f4578d18a7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:19.878861 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e60755-af42-4969-8a58-e4f4578d18a7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.923151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83acda0-bfea-4a90-8466-5b8bf2042075 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:19.923693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:19.927909 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76270fb9-af53-4558-9203-a3bf01b0879a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.928568 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76270fb9-af53-4558-9203-a3bf01b0879a admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.928924 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76270fb9-af53-4558-9203-a3bf01b0879a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.929205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76270fb9-af53-4558-9203-a3bf01b0879a admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.929933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76270fb9-af53-4558-9203-a3bf01b0879a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.937066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76270fb9-af53-4558-9203-a3bf01b0879a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.937195 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6dedd-fc43-4cb6-b022-437366cfed82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:19.937523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6dedd-fc43-4cb6-b022-437366cfed82 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:19.937837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6dedd-fc43-4cb6-b022-437366cfed82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:19.938115 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6dedd-fc43-4cb6-b022-437366cfed82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:19.938802 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6dedd-fc43-4cb6-b022-437366cfed82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:19.940738 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6dedd-fc43-4cb6-b022-437366cfed82 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:19.945382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:20.013740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 785/1574] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/projects => generated 389 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:20.014653 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76270fb9-af53-4558-9203-a3bf01b0879a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.041977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 790/1575] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:19 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:20.042790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6dedd-fc43-4cb6-b022-437366cfed82 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.077456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76270fb9-af53-4558-9203-a3bf01b0879a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.104815 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6dedd-fc43-4cb6-b022-437366cfed82 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.110120 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45094-b4f6-49f3-b2ae-fddfa617cb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.110706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45094-b4f6-49f3-b2ae-fddfa617cb1e admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.110977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45094-b4f6-49f3-b2ae-fddfa617cb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.111251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45094-b4f6-49f3-b2ae-fddfa617cb1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.111939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f45094-b4f6-49f3-b2ae-fddfa617cb1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.113894 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f45094-b4f6-49f3-b2ae-fddfa617cb1e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.136766 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88078975-8cb6-4a24-b979-81ab65fde55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.141276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88078975-8cb6-4a24-b979-81ab65fde55a admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.141276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88078975-8cb6-4a24-b979-81ab65fde55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.141276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88078975-8cb6-4a24-b979-81ab65fde55a admin admin] PATH_INFO: `/v3/projects/1d57351560654accb09e975bbc8dcf17/users/3e7b9aa8532b47afafeb7481932bfce9/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.153613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88078975-8cb6-4a24-b979-81ab65fde55a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d57351560654accb09e975bbc8dcf17, user_id=3e7b9aa8532b47afafeb7481932bfce9, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.154652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: WARNING py.warnings [None req-88078975-8cb6-4a24-b979-81ab65fde55a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:34:20.154652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: warnings.warn(msg) Jun 17 07:34:20.154652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: Jun 17 07:34:20.156692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88078975-8cb6-4a24-b979-81ab65fde55a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.200184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 791/1576] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:20 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:20.201018 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45094-b4f6-49f3-b2ae-fddfa617cb1e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.237534 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 786/1577] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:20 2022] PUT /identity/v3/projects/1d57351560654accb09e975bbc8dcf17/users/3e7b9aa8532b47afafeb7481932bfce9/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:20.238482 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88078975-8cb6-4a24-b979-81ab65fde55a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.266504 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45094-b4f6-49f3-b2ae-fddfa617cb1e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.300905 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88078975-8cb6-4a24-b979-81ab65fde55a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.305580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcd744-4f19-4cde-96b3-cdf8c7a46c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.306533 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcd744-4f19-4cde-96b3-cdf8c7a46c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.306533 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcd744-4f19-4cde-96b3-cdf8c7a46c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.306808 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcd744-4f19-4cde-96b3-cdf8c7a46c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.308164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcd744-4f19-4cde-96b3-cdf8c7a46c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.309801 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcd744-4f19-4cde-96b3-cdf8c7a46c50 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.319752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 787/1578] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:20.320807 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcd744-4f19-4cde-96b3-cdf8c7a46c50 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.321931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4c241-e838-4afa-b33e-c67c8076a9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.323145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4c241-e838-4afa-b33e-c67c8076a9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.323706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4c241-e838-4afa-b33e-c67c8076a9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.324062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4c241-e838-4afa-b33e-c67c8076a9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.324751 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4c241-e838-4afa-b33e-c67c8076a9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.326682 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4c241-e838-4afa-b33e-c67c8076a9c9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.331562 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcd744-4f19-4cde-96b3-cdf8c7a46c50 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.335363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:20.336197 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e7d5b-c6e1-46d2-abbe-187efb5d2369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.336927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7d5b-c6e1-46d2-abbe-187efb5d2369 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.337127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7d5b-c6e1-46d2-abbe-187efb5d2369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.337441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7d5b-c6e1-46d2-abbe-187efb5d2369 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.338727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e7d5b-c6e1-46d2-abbe-187efb5d2369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.340630 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e7d5b-c6e1-46d2-abbe-187efb5d2369 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.434031 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 792/1579] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:20 2022] POST /identity/v3/users => generated 282 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:20.434235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 788/1580] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:20 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:20.434235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e7d5b-c6e1-46d2-abbe-187efb5d2369 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.434740 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4c241-e838-4afa-b33e-c67c8076a9c9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.438554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:20.443680 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e7d5b-c6e1-46d2-abbe-187efb5d2369 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.444328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4c241-e838-4afa-b33e-c67c8076a9c9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.449116 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c133c-cbaa-4b8e-adc5-9e2d648bb479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.449875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c133c-cbaa-4b8e-adc5-9e2d648bb479 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.450017 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356d9bf-33f4-479f-9de9-df536e5df51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.450180 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c133c-cbaa-4b8e-adc5-9e2d648bb479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.450421 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c133c-cbaa-4b8e-adc5-9e2d648bb479 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.450635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356d9bf-33f4-479f-9de9-df536e5df51c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.450926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356d9bf-33f4-479f-9de9-df536e5df51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.451095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c133c-cbaa-4b8e-adc5-9e2d648bb479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.451429 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356d9bf-33f4-479f-9de9-df536e5df51c admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.452366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356d9bf-33f4-479f-9de9-df536e5df51c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.453003 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c133c-cbaa-4b8e-adc5-9e2d648bb479 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.454240 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356d9bf-33f4-479f-9de9-df536e5df51c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.464565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 793/1581] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:20.465544 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356d9bf-33f4-479f-9de9-df536e5df51c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.475333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356d9bf-33f4-479f-9de9-df536e5df51c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.480403 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b9b89-5a0d-4a1c-af69-5a4e01fe929a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.481058 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b9b89-5a0d-4a1c-af69-5a4e01fe929a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.481361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b9b89-5a0d-4a1c-af69-5a4e01fe929a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.481641 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b9b89-5a0d-4a1c-af69-5a4e01fe929a admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.482330 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b9b89-5a0d-4a1c-af69-5a4e01fe929a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.484352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b9b89-5a0d-4a1c-af69-5a4e01fe929a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.532641 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 789/1582] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:20 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:20.533486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c133c-cbaa-4b8e-adc5-9e2d648bb479 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.543638 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c133c-cbaa-4b8e-adc5-9e2d648bb479 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.548307 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd1312-4fbf-4599-90f8-97d4f2c3de00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.548975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd1312-4fbf-4599-90f8-97d4f2c3de00 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.549263 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd1312-4fbf-4599-90f8-97d4f2c3de00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.549565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd1312-4fbf-4599-90f8-97d4f2c3de00 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.550257 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd1312-4fbf-4599-90f8-97d4f2c3de00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.552178 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd1312-4fbf-4599-90f8-97d4f2c3de00 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.560501 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 794/1583] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:20 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:20.562044 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef5c51-62aa-4dce-ac2e-e7971a52d76a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.562351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef5c51-62aa-4dce-ac2e-e7971a52d76a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.562664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef5c51-62aa-4dce-ac2e-e7971a52d76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.582470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-dbef5c51-62aa-4dce-ac2e-e7971a52d76a None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:20.584161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dbef5c51-62aa-4dce-ac2e-e7971a52d76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:20.591553 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 795/1584] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:20.592338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef5c51-62aa-4dce-ac2e-e7971a52d76a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.601837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef5c51-62aa-4dce-ac2e-e7971a52d76a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.606629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08deef-e79e-46de-bf63-7063a40c788e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.607317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08deef-e79e-46de-bf63-7063a40c788e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.607637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08deef-e79e-46de-bf63-7063a40c788e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.607908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08deef-e79e-46de-bf63-7063a40c788e admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.608652 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08deef-e79e-46de-bf63-7063a40c788e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.610267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08deef-e79e-46de-bf63-7063a40c788e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.620913 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 796/1585] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:20.621728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08deef-e79e-46de-bf63-7063a40c788e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.631101 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08deef-e79e-46de-bf63-7063a40c788e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.635860 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f00eee-f535-4476-aefd-13ca9ec9269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.636474 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f00eee-f535-4476-aefd-13ca9ec9269e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.636756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f00eee-f535-4476-aefd-13ca9ec9269e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.637027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f00eee-f535-4476-aefd-13ca9ec9269e admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.637745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f00eee-f535-4476-aefd-13ca9ec9269e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.639295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f00eee-f535-4476-aefd-13ca9ec9269e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.649468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 797/1586] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:20.650338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f00eee-f535-4476-aefd-13ca9ec9269e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.653487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 790/1587] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:20 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:20.653487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd1312-4fbf-4599-90f8-97d4f2c3de00 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.662666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f00eee-f535-4476-aefd-13ca9ec9269e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.663583 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd1312-4fbf-4599-90f8-97d4f2c3de00 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.667984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49d932-e378-45cf-8f2d-af9dd62d0304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.668647 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49d932-e378-45cf-8f2d-af9dd62d0304 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.668940 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49d932-e378-45cf-8f2d-af9dd62d0304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.669212 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49d932-e378-45cf-8f2d-af9dd62d0304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.669681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d0b5a-5f1e-4f56-8c94-bfde1ac1b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.669982 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49d932-e378-45cf-8f2d-af9dd62d0304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.670354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d0b5a-5f1e-4f56-8c94-bfde1ac1b30b admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.670995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d0b5a-5f1e-4f56-8c94-bfde1ac1b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.671284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d0b5a-5f1e-4f56-8c94-bfde1ac1b30b admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.671798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49d932-e378-45cf-8f2d-af9dd62d0304 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.672017 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d0b5a-5f1e-4f56-8c94-bfde1ac1b30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.673889 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d0b5a-5f1e-4f56-8c94-bfde1ac1b30b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.687356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 798/1588] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:20.687529 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 791/1589] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:20.687631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49d932-e378-45cf-8f2d-af9dd62d0304 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.687731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d0b5a-5f1e-4f56-8c94-bfde1ac1b30b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.695830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49d932-e378-45cf-8f2d-af9dd62d0304 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.697140 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d0b5a-5f1e-4f56-8c94-bfde1ac1b30b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.700723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e970bad-3979-43e0-846a-8bd1f79d1d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.701461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e970bad-3979-43e0-846a-8bd1f79d1d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.701748 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e970bad-3979-43e0-846a-8bd1f79d1d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.702024 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e970bad-3979-43e0-846a-8bd1f79d1d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.702349 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845a327-79d9-4f87-9d38-a1464eba9d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.702774 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e970bad-3979-43e0-846a-8bd1f79d1d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.703001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845a327-79d9-4f87-9d38-a1464eba9d92 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.703281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845a327-79d9-4f87-9d38-a1464eba9d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.703553 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845a327-79d9-4f87-9d38-a1464eba9d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.704351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845a327-79d9-4f87-9d38-a1464eba9d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.704464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e970bad-3979-43e0-846a-8bd1f79d1d93 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.706182 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845a327-79d9-4f87-9d38-a1464eba9d92 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.716622 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 799/1590] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:20.717444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e970bad-3979-43e0-846a-8bd1f79d1d93 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.724175 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 792/1591] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:20.724175 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845a327-79d9-4f87-9d38-a1464eba9d92 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.734180 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845a327-79d9-4f87-9d38-a1464eba9d92 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.738818 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e821ce-7624-4337-b7de-df28f21dc330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.739741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e821ce-7624-4337-b7de-df28f21dc330 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.740020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e821ce-7624-4337-b7de-df28f21dc330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.740294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e821ce-7624-4337-b7de-df28f21dc330 admin admin] PATH_INFO: `/v3/projects/94fc753fb51e41acb3037d2ca7cd1394/users/8b753148f55e4fb0897bf9639e8d4d70/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.756074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e821ce-7624-4337-b7de-df28f21dc330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94fc753fb51e41acb3037d2ca7cd1394, user_id=8b753148f55e4fb0897bf9639e8d4d70, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.758804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e821ce-7624-4337-b7de-df28f21dc330 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.775266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e970bad-3979-43e0-846a-8bd1f79d1d93 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.779639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4212d3-bce1-46df-83ea-1884bd65d6d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.780287 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4212d3-bce1-46df-83ea-1884bd65d6d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.780571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4212d3-bce1-46df-83ea-1884bd65d6d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.780846 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4212d3-bce1-46df-83ea-1884bd65d6d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.789995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4212d3-bce1-46df-83ea-1884bd65d6d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.792132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4212d3-bce1-46df-83ea-1884bd65d6d1 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.802369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 800/1592] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:20.802861 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4212d3-bce1-46df-83ea-1884bd65d6d1 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.815708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4212d3-bce1-46df-83ea-1884bd65d6d1 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.821005 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d213478-25b0-4b94-83b4-3919d7d80216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.821698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213478-25b0-4b94-83b4-3919d7d80216 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.821980 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213478-25b0-4b94-83b4-3919d7d80216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.822258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213478-25b0-4b94-83b4-3919d7d80216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.825073 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d213478-25b0-4b94-83b4-3919d7d80216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.825194 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d213478-25b0-4b94-83b4-3919d7d80216 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.828682 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 793/1593] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:20 2022] PUT /identity/v3/projects/94fc753fb51e41acb3037d2ca7cd1394/users/8b753148f55e4fb0897bf9639e8d4d70/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:20.832895 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e821ce-7624-4337-b7de-df28f21dc330 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.840208 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 801/1594] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:20.840208 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d213478-25b0-4b94-83b4-3919d7d80216 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.850091 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d213478-25b0-4b94-83b4-3919d7d80216 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.897638 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e821ce-7624-4337-b7de-df28f21dc330 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.903458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb28df-8dc7-40fc-887c-129c68b21c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.904128 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb28df-8dc7-40fc-887c-129c68b21c2f admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.904724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb28df-8dc7-40fc-887c-129c68b21c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.905006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb28df-8dc7-40fc-887c-129c68b21c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.905763 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb28df-8dc7-40fc-887c-129c68b21c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.907376 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb28df-8dc7-40fc-887c-129c68b21c2f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.907510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77635f6-0fef-4971-a6b5-dd4d5775190d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.908066 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77635f6-0fef-4971-a6b5-dd4d5775190d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.908352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77635f6-0fef-4971-a6b5-dd4d5775190d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.908638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77635f6-0fef-4971-a6b5-dd4d5775190d admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.909390 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77635f6-0fef-4971-a6b5-dd4d5775190d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.910990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77635f6-0fef-4971-a6b5-dd4d5775190d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.923059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 794/1595] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:20.923243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 802/1596] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:20.923328 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb28df-8dc7-40fc-887c-129c68b21c2f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.925367 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77635f6-0fef-4971-a6b5-dd4d5775190d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.930692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:20.934385 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb28df-8dc7-40fc-887c-129c68b21c2f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.939314 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4bc6c-36c9-4b1a-ac5e-42724c42be8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.939479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77635f6-0fef-4971-a6b5-dd4d5775190d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.940142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4bc6c-36c9-4b1a-ac5e-42724c42be8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.940445 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4bc6c-36c9-4b1a-ac5e-42724c42be8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.940701 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4bc6c-36c9-4b1a-ac5e-42724c42be8f admin admin] PATH_INFO: `/v3/projects/48a9b5852b69438eac339b063882d08c/users/99687792e2714e4b8db1b6e699901dfe/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.944703 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317bc6a-3d18-4353-9207-a0623ac9076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.945403 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317bc6a-3d18-4353-9207-a0623ac9076b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.945687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317bc6a-3d18-4353-9207-a0623ac9076b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.945959 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317bc6a-3d18-4353-9207-a0623ac9076b admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.946995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317bc6a-3d18-4353-9207-a0623ac9076b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.949195 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317bc6a-3d18-4353-9207-a0623ac9076b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.959567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4bc6c-36c9-4b1a-ac5e-42724c42be8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a9b5852b69438eac339b063882d08c, user_id=99687792e2714e4b8db1b6e699901dfe, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.959778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 803/1597] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:20.960434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317bc6a-3d18-4353-9207-a0623ac9076b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:20.966544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4bc6c-36c9-4b1a-ac5e-42724c42be8f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.971891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317bc6a-3d18-4353-9207-a0623ac9076b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:20.978122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ac044-0d74-42a9-821d-8cad4d168e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:20.983528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ac044-0d74-42a9-821d-8cad4d168e3f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.983528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ac044-0d74-42a9-821d-8cad4d168e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.983528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ac044-0d74-42a9-821d-8cad4d168e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:20.983528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ac044-0d74-42a9-821d-8cad4d168e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:20.983528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ac044-0d74-42a9-821d-8cad4d168e3f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:20.995892 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 804/1598] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:20.995892 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda90800-71bc-4607-b0a9-0920222fe47a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:20.995892 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda90800-71bc-4607-b0a9-0920222fe47a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:20.995892 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda90800-71bc-4607-b0a9-0920222fe47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:21.013670 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cda90800-71bc-4607-b0a9-0920222fe47a None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:21.014881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cda90800-71bc-4607-b0a9-0920222fe47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:21.022767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 805/1599] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:21.023675 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda90800-71bc-4607-b0a9-0920222fe47a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:21.034449 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda90800-71bc-4607-b0a9-0920222fe47a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:21.038939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e67a50-3c11-4bea-a88e-b9dc615b9f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:21.039833 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e67a50-3c11-4bea-a88e-b9dc615b9f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:21.040108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e67a50-3c11-4bea-a88e-b9dc615b9f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:21.040375 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e67a50-3c11-4bea-a88e-b9dc615b9f16 admin admin] PATH_INFO: `/v3/projects/1b8dbf8c649346188c219769309679d6/users/649130e099984798ad661159bb2aa2fb/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:21.054769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e67a50-3c11-4bea-a88e-b9dc615b9f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8dbf8c649346188c219769309679d6, user_id=649130e099984798ad661159bb2aa2fb, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:21.057490 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e67a50-3c11-4bea-a88e-b9dc615b9f16 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:21.060844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 795/1600] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:20 2022] PUT /identity/v3/projects/48a9b5852b69438eac339b063882d08c/users/99687792e2714e4b8db1b6e699901dfe/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:21.061700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4bc6c-36c9-4b1a-ac5e-42724c42be8f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:21.113901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:21.124238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4bc6c-36c9-4b1a-ac5e-42724c42be8f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:21.129444 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8aba8-b96f-46b7-b515-62b8367a199a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:21.139730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8aba8-b96f-46b7-b515-62b8367a199a admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:21.139730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8aba8-b96f-46b7-b515-62b8367a199a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:21.139730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8aba8-b96f-46b7-b515-62b8367a199a admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:21.139730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8aba8-b96f-46b7-b515-62b8367a199a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:21.139730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8aba8-b96f-46b7-b515-62b8367a199a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:21.143868 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 796/1601] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:21.144767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8aba8-b96f-46b7-b515-62b8367a199a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:21.162564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8aba8-b96f-46b7-b515-62b8367a199a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:21.164436 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 806/1602] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:21 2022] PUT /identity/v3/projects/1b8dbf8c649346188c219769309679d6/users/649130e099984798ad661159bb2aa2fb/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:21.175140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e67a50-3c11-4bea-a88e-b9dc615b9f16 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:21.231873 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942ab1-2d39-4fd4-a5c7-ab61f8b4d72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:21.232903 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942ab1-2d39-4fd4-a5c7-ab61f8b4d72e admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:21.233233 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942ab1-2d39-4fd4-a5c7-ab61f8b4d72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:21.233613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942ab1-2d39-4fd4-a5c7-ab61f8b4d72e admin admin] PATH_INFO: `/v3/projects/c8cc515016254032aa10156c7a3af9c2/users/e6f6d9eef0414e67bd86acbfd2772c2b/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:21.243542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e67a50-3c11-4bea-a88e-b9dc615b9f16 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:21.249197 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4dc2d-e1eb-4a0e-ab8a-5ced90583c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:21.250346 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f942ab1-2d39-4fd4-a5c7-ab61f8b4d72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8cc515016254032aa10156c7a3af9c2, user_id=e6f6d9eef0414e67bd86acbfd2772c2b, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:21.251563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4dc2d-e1eb-4a0e-ab8a-5ced90583c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:21.251563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4dc2d-e1eb-4a0e-ab8a-5ced90583c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:21.251563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4dc2d-e1eb-4a0e-ab8a-5ced90583c0d admin admin] PATH_INFO: `/v3/projects/8432e3c517624c449606ca1201f2be12/users/a3ea40ad7d7546449f60539341abc545/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:21.253061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f942ab1-2d39-4fd4-a5c7-ab61f8b4d72e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:21.266438 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4dc2d-e1eb-4a0e-ab8a-5ced90583c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8432e3c517624c449606ca1201f2be12, user_id=a3ea40ad7d7546449f60539341abc545, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:21.269159 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4dc2d-e1eb-4a0e-ab8a-5ced90583c0d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:21.327238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 797/1603] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:21 2022] PUT /identity/v3/projects/c8cc515016254032aa10156c7a3af9c2/users/e6f6d9eef0414e67bd86acbfd2772c2b/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:21.332832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942ab1-2d39-4fd4-a5c7-ab61f8b4d72e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:21.383022 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 807/1604] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:21 2022] PUT /identity/v3/projects/8432e3c517624c449606ca1201f2be12/users/a3ea40ad7d7546449f60539341abc545/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:21.384171 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4dc2d-e1eb-4a0e-ab8a-5ced90583c0d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:21.408246 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942ab1-2d39-4fd4-a5c7-ab61f8b4d72e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:21.456816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4dc2d-e1eb-4a0e-ab8a-5ced90583c0d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:21.460871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99f020-8855-4e92-a2dd-54141210a7b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:21.461279 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99f020-8855-4e92-a2dd-54141210a7b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:21.461593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99f020-8855-4e92-a2dd-54141210a7b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:21.461875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99f020-8855-4e92-a2dd-54141210a7b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:21.490962 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765591bf-6ff7-424a-965f-728a4669fb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:21.491960 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765591bf-6ff7-424a-965f-728a4669fb36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:21.492308 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765591bf-6ff7-424a-965f-728a4669fb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:21.492584 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765591bf-6ff7-424a-965f-728a4669fb36 admin admin] PATH_INFO: `/v3/projects/be14ecaa27b14457b8e0c29a65de7066/users/1b6726b31b0d4265bee3691bd9034980/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:21.509266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765591bf-6ff7-424a-965f-728a4669fb36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be14ecaa27b14457b8e0c29a65de7066, user_id=1b6726b31b0d4265bee3691bd9034980, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:21.512234 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765591bf-6ff7-424a-965f-728a4669fb36 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:21.513460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:21.529462 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99f020-8855-4e92-a2dd-54141210a7b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:21.531945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99f020-8855-4e92-a2dd-54141210a7b8 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:21.540429 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 808/1605] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:21.542493 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c82c6a-9523-47e3-822b-8a2aa9039bee None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:21.542786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c82c6a-9523-47e3-822b-8a2aa9039bee None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:21.543060 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c82c6a-9523-47e3-822b-8a2aa9039bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:21.571632 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-31c82c6a-9523-47e3-822b-8a2aa9039bee None None] MFA Rules not processed for user `99687792e2714e4b8db1b6e699901dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:21.573528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-31c82c6a-9523-47e3-822b-8a2aa9039bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:21.608542 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 798/1606] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:21 2022] PUT /identity/v3/projects/be14ecaa27b14457b8e0c29a65de7066/users/1b6726b31b0d4265bee3691bd9034980/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:21.608542 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765591bf-6ff7-424a-965f-728a4669fb36 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:21.612281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:21.641675 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 809/1607] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:21.642988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27cab-81ee-4fe3-b671-2690aa9659b0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:21.643283 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27cab-81ee-4fe3-b671-2690aa9659b0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:21.643560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27cab-81ee-4fe3-b671-2690aa9659b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:21.705031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765591bf-6ff7-424a-965f-728a4669fb36 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:21.706651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7bb27cab-81ee-4fe3-b671-2690aa9659b0 None None] MFA Rules not processed for user `649130e099984798ad661159bb2aa2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:21.707944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7bb27cab-81ee-4fe3-b671-2690aa9659b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:21.716303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bacc7-d3fd-490b-8af4-299307e19754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:21.721527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bacc7-d3fd-490b-8af4-299307e19754 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:21.721527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bacc7-d3fd-490b-8af4-299307e19754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:21.721527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bacc7-d3fd-490b-8af4-299307e19754 admin admin] PATH_INFO: `/v3/projects/8422515ec69540b7b3de5f08dfa77cd9/users/c2b13299b7624df6a80aa9895ed79165/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:21.737205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1bacc7-d3fd-490b-8af4-299307e19754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8422515ec69540b7b3de5f08dfa77cd9, user_id=c2b13299b7624df6a80aa9895ed79165, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:21.740464 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1bacc7-d3fd-490b-8af4-299307e19754 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:21.781402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 810/1608] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:21.782853 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04929e2f-ee2f-49e1-9530-5a2f4f7d03d1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:21.783169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04929e2f-ee2f-49e1-9530-5a2f4f7d03d1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:21.783428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04929e2f-ee2f-49e1-9530-5a2f4f7d03d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:21.810204 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-04929e2f-ee2f-49e1-9530-5a2f4f7d03d1 None None] MFA Rules not processed for user `e6f6d9eef0414e67bd86acbfd2772c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:21.811851 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-04929e2f-ee2f-49e1-9530-5a2f4f7d03d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:21.872299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 799/1609] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:21 2022] PUT /identity/v3/projects/8422515ec69540b7b3de5f08dfa77cd9/users/c2b13299b7624df6a80aa9895ed79165/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:21.879550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292e4c7-ca65-4312-b171-b460760f3c66 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:21.879717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:21.879816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292e4c7-ca65-4312-b171-b460760f3c66 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:21.879816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292e4c7-ca65-4312-b171-b460760f3c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:21.908871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 811/1610] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:21.910374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0548e-34ee-44b8-905a-68b02837512c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:21.910749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0548e-34ee-44b8-905a-68b02837512c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:21.911014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0548e-34ee-44b8-905a-68b02837512c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:21.942104 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4292e4c7-ca65-4312-b171-b460760f3c66 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:21.943673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4292e4c7-ca65-4312-b171-b460760f3c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:21.944547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ddb0548e-34ee-44b8-905a-68b02837512c None None] MFA Rules not processed for user `1b6726b31b0d4265bee3691bd9034980`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:21.945805 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ddb0548e-34ee-44b8-905a-68b02837512c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:22.011260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 800/1611] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:22.013918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da58dc-0d98-473a-ab34-e47d1f389611 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:22.013918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da58dc-0d98-473a-ab34-e47d1f389611 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:22.013918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da58dc-0d98-473a-ab34-e47d1f389611 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:22.014717 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 801/1612] 10.222.0.52 () {54 vars in 961 bytes} [Fri Jun 17 07:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:34:22.015401 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da58dc-0d98-473a-ab34-e47d1f389611 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:22.028719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 812/1613] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:22.028719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f387d7-7b63-4a0d-ab35-881151b5360e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:22.028719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f387d7-7b63-4a0d-ab35-881151b5360e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:22.028719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f387d7-7b63-4a0d-ab35-881151b5360e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:22.031470 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da58dc-0d98-473a-ab34-e47d1f389611 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:22.039394 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80403f5c-116d-4603-84bc-490c6d88b920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:22.041055 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80403f5c-116d-4603-84bc-490c6d88b920 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:22.042205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80403f5c-116d-4603-84bc-490c6d88b920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:22.042787 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80403f5c-116d-4603-84bc-490c6d88b920 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:22.043852 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80403f5c-116d-4603-84bc-490c6d88b920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:22.047073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80403f5c-116d-4603-84bc-490c6d88b920 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:22.064103 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f8f387d7-7b63-4a0d-ab35-881151b5360e None None] MFA Rules not processed for user `c2b13299b7624df6a80aa9895ed79165`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:22.068612 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f8f387d7-7b63-4a0d-ab35-881151b5360e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:22.145553 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 813/1614] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:22.145553 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f387d7-7b63-4a0d-ab35-881151b5360e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:22.155611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f387d7-7b63-4a0d-ab35-881151b5360e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:22.160677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25899e-ab60-47a3-9f39-2a41d4c053e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:22.161941 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25899e-ab60-47a3-9f39-2a41d4c053e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:22.161941 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25899e-ab60-47a3-9f39-2a41d4c053e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:22.162169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25899e-ab60-47a3-9f39-2a41d4c053e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:22.162776 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25899e-ab60-47a3-9f39-2a41d4c053e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:22.164862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25899e-ab60-47a3-9f39-2a41d4c053e4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:22.179323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 802/1615] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:22 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:22.180680 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4b83a-ed90-4142-9634-6aa3a4384c65 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:22.181588 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4b83a-ed90-4142-9634-6aa3a4384c65 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:22.182614 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4b83a-ed90-4142-9634-6aa3a4384c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:22.209873 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-2dc4b83a-ed90-4142-9634-6aa3a4384c65 None None] MFA Rules not processed for user `88e1572d22c048b09699a2fe50900f92`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:22.211107 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2dc4b83a-ed90-4142-9634-6aa3a4384c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:22.256848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 814/1616] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:22 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:22.265543 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25899e-ab60-47a3-9f39-2a41d4c053e4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:22.276626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:22.301136 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 803/1617] 10.222.0.52 () {58 vars in 1058 bytes} [Fri Jun 17 07:34:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:22.302646 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d81092-ba0f-443b-bb2e-f7f047196243 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:22.302939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d81092-ba0f-443b-bb2e-f7f047196243 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:22.303221 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d81092-ba0f-443b-bb2e-f7f047196243 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:22.304824 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 804/1618] 10.222.0.52 () {54 vars in 961 bytes} [Fri Jun 17 07:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:34:22.305786 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d81092-ba0f-443b-bb2e-f7f047196243 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:22.340664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:22.346534 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25899e-ab60-47a3-9f39-2a41d4c053e4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:22.353169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de021a-41be-4e1b-b1ea-52cf43133d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:22.354070 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de021a-41be-4e1b-b1ea-52cf43133d76 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:22.354359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de021a-41be-4e1b-b1ea-52cf43133d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:22.354691 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de021a-41be-4e1b-b1ea-52cf43133d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:22.394423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d81092-ba0f-443b-bb2e-f7f047196243 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:22.402948 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36421b-e4e6-4a49-8a9d-622be98aa268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:22.403730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36421b-e4e6-4a49-8a9d-622be98aa268 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:22.404174 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36421b-e4e6-4a49-8a9d-622be98aa268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:22.404638 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36421b-e4e6-4a49-8a9d-622be98aa268 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:22.405514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36421b-e4e6-4a49-8a9d-622be98aa268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:22.408805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36421b-e4e6-4a49-8a9d-622be98aa268 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:22.446033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de021a-41be-4e1b-b1ea-52cf43133d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:22.448594 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de021a-41be-4e1b-b1ea-52cf43133d76 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:22.461171 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 815/1619] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:22.461171 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de021a-41be-4e1b-b1ea-52cf43133d76 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:22.470691 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de021a-41be-4e1b-b1ea-52cf43133d76 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:22.475709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b41c35-344a-429f-937f-626d048c5bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:22.476719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b41c35-344a-429f-937f-626d048c5bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:22.476874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b41c35-344a-429f-937f-626d048c5bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:22.477257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b41c35-344a-429f-937f-626d048c5bf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:22.478073 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b41c35-344a-429f-937f-626d048c5bf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:22.487915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 805/1620] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:22 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:22.488849 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36421b-e4e6-4a49-8a9d-622be98aa268 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:22.490237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b41c35-344a-429f-937f-626d048c5bf4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:22.576862 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36421b-e4e6-4a49-8a9d-622be98aa268 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:22.584915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175247a-23eb-4699-a4c7-e44f5a0d4bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:22.585761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175247a-23eb-4699-a4c7-e44f5a0d4bea admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:22.586166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175247a-23eb-4699-a4c7-e44f5a0d4bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:22.591239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175247a-23eb-4699-a4c7-e44f5a0d4bea admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:22.591239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175247a-23eb-4699-a4c7-e44f5a0d4bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:22.591239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175247a-23eb-4699-a4c7-e44f5a0d4bea admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:22.595012 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 816/1621] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:22 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:22.596751 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec25045-d499-4e00-9c50-bf88b7e63987 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:22.597040 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec25045-d499-4e00-9c50-bf88b7e63987 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:22.597331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec25045-d499-4e00-9c50-bf88b7e63987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:22.624200 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2ec25045-d499-4e00-9c50-bf88b7e63987 None None] MFA Rules not processed for user `88e1572d22c048b09699a2fe50900f92`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:22.625722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2ec25045-d499-4e00-9c50-bf88b7e63987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:22.678934 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 806/1622] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:22 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:22.678934 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175247a-23eb-4699-a4c7-e44f5a0d4bea admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:22.723044 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 817/1623] 10.222.0.52 () {58 vars in 1058 bytes} [Fri Jun 17 07:34:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:22.724053 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec25045-d499-4e00-9c50-bf88b7e63987 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:22.746516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec25045-d499-4e00-9c50-bf88b7e63987 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:22.750814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05fd14-439e-42ad-a91c-e28dccffdcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:22.751819 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05fd14-439e-42ad-a91c-e28dccffdcae admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:22.752311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05fd14-439e-42ad-a91c-e28dccffdcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:22.752727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05fd14-439e-42ad-a91c-e28dccffdcae admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:22.753714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05fd14-439e-42ad-a91c-e28dccffdcae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:22.756426 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05fd14-439e-42ad-a91c-e28dccffdcae admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:22.780802 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175247a-23eb-4699-a4c7-e44f5a0d4bea admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:22.790802 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad082d78-cc8e-4e27-9ae5-52734878c16c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:22.791694 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad082d78-cc8e-4e27-9ae5-52734878c16c service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:22.792331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad082d78-cc8e-4e27-9ae5-52734878c16c service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:22.792331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad082d78-cc8e-4e27-9ae5-52734878c16c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:22.858516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 818/1624] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:22 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:22.859341 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05fd14-439e-42ad-a91c-e28dccffdcae admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:22.874015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05fd14-439e-42ad-a91c-e28dccffdcae admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:22.878423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad082d78-cc8e-4e27-9ae5-52734878c16c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:22.879859 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e9612-411b-4d44-b0d0-896e622c84dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:22.880688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e9612-411b-4d44-b0d0-896e622c84dc admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:22.881884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e9612-411b-4d44-b0d0-896e622c84dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:22.882182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e9612-411b-4d44-b0d0-896e622c84dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:22.882298 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad082d78-cc8e-4e27-9ae5-52734878c16c service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:22.883444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e9612-411b-4d44-b0d0-896e622c84dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:22.886105 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e9612-411b-4d44-b0d0-896e622c84dc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:22.897786 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 807/1625] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:22.898880 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad082d78-cc8e-4e27-9ae5-52734878c16c service nova] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:22.900644 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 819/1626] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:22.906461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e9612-411b-4d44-b0d0-896e622c84dc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:22.910667 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad082d78-cc8e-4e27-9ae5-52734878c16c service nova] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:22.915558 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83eca8-65f8-4e02-990b-6a9089f112c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:22.916415 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83eca8-65f8-4e02-990b-6a9089f112c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:22.917100 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83eca8-65f8-4e02-990b-6a9089f112c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:22.917472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83eca8-65f8-4e02-990b-6a9089f112c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:22.920262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83eca8-65f8-4e02-990b-6a9089f112c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:22.920262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83eca8-65f8-4e02-990b-6a9089f112c5 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:22.927811 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e9612-411b-4d44-b0d0-896e622c84dc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:22.933495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 808/1627] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:22.936001 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2e9eb-085c-4b9e-be4b-891919a3c56b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:22.936539 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83eca8-65f8-4e02-990b-6a9089f112c5 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:22.936717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2e9eb-085c-4b9e-be4b-891919a3c56b service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:22.937013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2e9eb-085c-4b9e-be4b-891919a3c56b service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:22.937292 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2e9eb-085c-4b9e-be4b-891919a3c56b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:22.945613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:22.951865 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83eca8-65f8-4e02-990b-6a9089f112c5 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:22.958223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dd2db-44ad-4ddd-8a6d-7b4fb8ac28b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:22.958892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dd2db-44ad-4ddd-8a6d-7b4fb8ac28b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:22.959182 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dd2db-44ad-4ddd-8a6d-7b4fb8ac28b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:22.959461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dd2db-44ad-4ddd-8a6d-7b4fb8ac28b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:22.960190 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56dd2db-44ad-4ddd-8a6d-7b4fb8ac28b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:22.961848 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56dd2db-44ad-4ddd-8a6d-7b4fb8ac28b9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:22.981951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 809/1628] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:22.983362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dd2db-44ad-4ddd-8a6d-7b4fb8ac28b9 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:22.999275 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dd2db-44ad-4ddd-8a6d-7b4fb8ac28b9 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:23.006870 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77376459-d4cd-474b-847c-4e8b473ff77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:23.007577 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77376459-d4cd-474b-847c-4e8b473ff77c admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:23.008086 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77376459-d4cd-474b-847c-4e8b473ff77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:23.008697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77376459-d4cd-474b-847c-4e8b473ff77c admin admin] PATH_INFO: `/v3/projects/b5952fd770fe42c7933be1b13b134cc5/users/cfa6c65151ca448a90cf37e38491a3d8/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:23.012934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2e9eb-085c-4b9e-be4b-891919a3c56b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:23.015791 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2e9eb-085c-4b9e-be4b-891919a3c56b service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:23.027735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 820/1629] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:23.028680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2e9eb-085c-4b9e-be4b-891919a3c56b service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:23.031817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77376459-d4cd-474b-847c-4e8b473ff77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5952fd770fe42c7933be1b13b134cc5, user_id=cfa6c65151ca448a90cf37e38491a3d8, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:23.035042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77376459-d4cd-474b-847c-4e8b473ff77c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:23.042647 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2e9eb-085c-4b9e-be4b-891919a3c56b service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:23.049718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acc29a-15cc-413b-acf0-bce3cdc3d39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:23.050826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acc29a-15cc-413b-acf0-bce3cdc3d39e admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:23.051178 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acc29a-15cc-413b-acf0-bce3cdc3d39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:23.051523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acc29a-15cc-413b-acf0-bce3cdc3d39e admin admin] PATH_INFO: `/v3/projects/ea2872bf79ad47b9a64b358ed1a10ee4/users/d1b68a1ac9dc41afbb6a21e9d6b1a8a4/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:23.071900 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:23.074651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acc29a-15cc-413b-acf0-bce3cdc3d39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2872bf79ad47b9a64b358ed1a10ee4, user_id=d1b68a1ac9dc41afbb6a21e9d6b1a8a4, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:23.078232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acc29a-15cc-413b-acf0-bce3cdc3d39e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:23.124721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 810/1630] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:22 2022] PUT /identity/v3/projects/b5952fd770fe42c7933be1b13b134cc5/users/cfa6c65151ca448a90cf37e38491a3d8/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:23.124721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77376459-d4cd-474b-847c-4e8b473ff77c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:23.202429 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 821/1631] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:23 2022] PUT /identity/v3/projects/ea2872bf79ad47b9a64b358ed1a10ee4/users/d1b68a1ac9dc41afbb6a21e9d6b1a8a4/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:23.203588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acc29a-15cc-413b-acf0-bce3cdc3d39e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:23.259074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77376459-d4cd-474b-847c-4e8b473ff77c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:23.348589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acc29a-15cc-413b-acf0-bce3cdc3d39e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:23.368828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c38b9-6bf2-4299-bbcc-6d7a26edac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:23.377007 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c38b9-6bf2-4299-bbcc-6d7a26edac53 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:23.377007 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c38b9-6bf2-4299-bbcc-6d7a26edac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:23.377007 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c38b9-6bf2-4299-bbcc-6d7a26edac53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:23.377007 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c38b9-6bf2-4299-bbcc-6d7a26edac53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:23.378266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c38b9-6bf2-4299-bbcc-6d7a26edac53 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:23.385746 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6f13f-1af3-4ec5-94df-ccaa8e5ec894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:23.387108 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6f13f-1af3-4ec5-94df-ccaa8e5ec894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:23.387651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6f13f-1af3-4ec5-94df-ccaa8e5ec894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:23.388148 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6f13f-1af3-4ec5-94df-ccaa8e5ec894 admin admin] PATH_INFO: `/v3/projects/03fc1ecd76ad4978a70eb68df7baa0e1/users/5466cbd4909942a4b52c78f157330355/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:23.496003 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 822/1632] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:23.496003 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c38b9-6bf2-4299-bbcc-6d7a26edac53 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:23.505085 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6f13f-1af3-4ec5-94df-ccaa8e5ec894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03fc1ecd76ad4978a70eb68df7baa0e1, user_id=5466cbd4909942a4b52c78f157330355, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:23.505085 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6f13f-1af3-4ec5-94df-ccaa8e5ec894 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:23.507149 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c38b9-6bf2-4299-bbcc-6d7a26edac53 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:23.507149 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a86fd-33e9-40fd-a132-56dc2905f5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:23.507149 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a86fd-33e9-40fd-a132-56dc2905f5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:23.507149 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a86fd-33e9-40fd-a132-56dc2905f5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:23.509619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a86fd-33e9-40fd-a132-56dc2905f5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:23.509619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a86fd-33e9-40fd-a132-56dc2905f5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:23.509619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a86fd-33e9-40fd-a132-56dc2905f5e9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:23.509619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 823/1633] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:23.509619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9891fe-731e-4f3a-9d5e-2968a6de9a41 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:23.509619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9891fe-731e-4f3a-9d5e-2968a6de9a41 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:23.511862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9891fe-731e-4f3a-9d5e-2968a6de9a41 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:23.511862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 824/1634] 10.222.0.52 () {54 vars in 912 bytes} [Fri Jun 17 07:34:23 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:34:23.511862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9891fe-731e-4f3a-9d5e-2968a6de9a41 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:23.551195 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 811/1635] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:23 2022] PUT /identity/v3/projects/03fc1ecd76ad4978a70eb68df7baa0e1/users/5466cbd4909942a4b52c78f157330355/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:23.552536 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6f13f-1af3-4ec5-94df-ccaa8e5ec894 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:23.562170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9891fe-731e-4f3a-9d5e-2968a6de9a41 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:23.635578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6f13f-1af3-4ec5-94df-ccaa8e5ec894 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:23.641747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143deda1-c3f9-47e6-829a-e77a24707659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:23.643503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143deda1-c3f9-47e6-829a-e77a24707659 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:23.644025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143deda1-c3f9-47e6-829a-e77a24707659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:23.644517 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143deda1-c3f9-47e6-829a-e77a24707659 admin admin] PATH_INFO: `/v3/projects/ea2872bf79ad47b9a64b358ed1a10ee4/users/d1b68a1ac9dc41afbb6a21e9d6b1a8a4/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:23.648114 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143deda1-c3f9-47e6-829a-e77a24707659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2872bf79ad47b9a64b358ed1a10ee4, user_id=d1b68a1ac9dc41afbb6a21e9d6b1a8a4, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:23.651147 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:23.654580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143deda1-c3f9-47e6-829a-e77a24707659 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:23.669564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 812/1636] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:23 2022] PUT /identity/v3/projects/ea2872bf79ad47b9a64b358ed1a10ee4/users/d1b68a1ac9dc41afbb6a21e9d6b1a8a4/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:23.671295 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e87b9-86f5-478e-a98f-9a43ea8f0cfd None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:23.671799 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e87b9-86f5-478e-a98f-9a43ea8f0cfd None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:23.672324 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e87b9-86f5-478e-a98f-9a43ea8f0cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:23.715870 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-579e87b9-86f5-478e-a98f-9a43ea8f0cfd None None] MFA Rules not processed for user `88e1572d22c048b09699a2fe50900f92`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:23.717810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-579e87b9-86f5-478e-a98f-9a43ea8f0cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:23.719211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f745d9-ca7b-4fb6-93d9-aed80240f249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:23.720142 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f745d9-ca7b-4fb6-93d9-aed80240f249 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:23.720437 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f745d9-ca7b-4fb6-93d9-aed80240f249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:23.720764 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f745d9-ca7b-4fb6-93d9-aed80240f249 admin admin] PATH_INFO: `/v3/projects/b5952fd770fe42c7933be1b13b134cc5/users/cfa6c65151ca448a90cf37e38491a3d8/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:23.725244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f745d9-ca7b-4fb6-93d9-aed80240f249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5952fd770fe42c7933be1b13b134cc5, user_id=cfa6c65151ca448a90cf37e38491a3d8, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:23.730709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f745d9-ca7b-4fb6-93d9-aed80240f249 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:23.745668 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 825/1637] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:23 2022] PUT /identity/v3/projects/b5952fd770fe42c7933be1b13b134cc5/users/cfa6c65151ca448a90cf37e38491a3d8/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:23.750584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f745d9-ca7b-4fb6-93d9-aed80240f249 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:23.848449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 813/1638] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Jun 17 07:34:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:23.850469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531105bb-75f4-4e95-95e6-92cf9cb0c747 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:23.852980 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531105bb-75f4-4e95-95e6-92cf9cb0c747 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:23.852980 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531105bb-75f4-4e95-95e6-92cf9cb0c747 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:23.865156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 814/1639] 10.222.0.52 () {54 vars in 912 bytes} [Fri Jun 17 07:34:23 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:34:23.868957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead18e0-fdaa-4e85-afcc-a6a152042c27 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:23.868957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead18e0-fdaa-4e85-afcc-a6a152042c27 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:23.870139 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead18e0-fdaa-4e85-afcc-a6a152042c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:23.890439 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:23.925235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f745d9-ca7b-4fb6-93d9-aed80240f249 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:23.940562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0a9d6-a73f-413e-b767-d50dabfe45a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:23.941356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0a9d6-a73f-413e-b767-d50dabfe45a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:23.941715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0a9d6-a73f-413e-b767-d50dabfe45a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:23.942056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0a9d6-a73f-413e-b767-d50dabfe45a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:23.942861 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0a9d6-a73f-413e-b767-d50dabfe45a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:23.946344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0a9d6-a73f-413e-b767-d50dabfe45a5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:23.951044 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-2ead18e0-fdaa-4e85-afcc-a6a152042c27 None None] MFA Rules not processed for user `d1b68a1ac9dc41afbb6a21e9d6b1a8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:23.954977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2ead18e0-fdaa-4e85-afcc-a6a152042c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:23.974904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 826/1640] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:23.978055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037cf8-49ce-45ec-a342-8f0eb191e85a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:23.978811 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037cf8-49ce-45ec-a342-8f0eb191e85a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:23.980215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037cf8-49ce-45ec-a342-8f0eb191e85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:24.047447 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7c037cf8-49ce-45ec-a342-8f0eb191e85a None None] MFA Rules not processed for user `cfa6c65151ca448a90cf37e38491a3d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:24.050872 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7c037cf8-49ce-45ec-a342-8f0eb191e85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:24.151793 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 815/1641] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:24.152874 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead18e0-fdaa-4e85-afcc-a6a152042c27 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:24.256842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 827/1642] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:24.258276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe7372-a5d0-4fa7-8e5a-9d3654c33f6a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:24.258985 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe7372-a5d0-4fa7-8e5a-9d3654c33f6a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:24.258985 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe7372-a5d0-4fa7-8e5a-9d3654c33f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:24.299260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead18e0-fdaa-4e85-afcc-a6a152042c27 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:24.302665 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbd35e-4e61-443b-8b06-c65269b45f94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:24.303523 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbd35e-4e61-443b-8b06-c65269b45f94 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:24.303971 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbd35e-4e61-443b-8b06-c65269b45f94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:24.304504 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbd35e-4e61-443b-8b06-c65269b45f94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:24.325734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1cbe7372-a5d0-4fa7-8e5a-9d3654c33f6a None None] MFA Rules not processed for user `88e1572d22c048b09699a2fe50900f92`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:24.332509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1cbe7372-a5d0-4fa7-8e5a-9d3654c33f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:24.384606 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:24.470921 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbd35e-4e61-443b-8b06-c65269b45f94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:24.472402 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbd35e-4e61-443b-8b06-c65269b45f94 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:24.485266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 828/1643] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Jun 17 07:34:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:24.486388 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe7372-a5d0-4fa7-8e5a-9d3654c33f6a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:24.491146 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 816/1644] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:24.492093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbd35e-4e61-443b-8b06-c65269b45f94 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:24.502547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe7372-a5d0-4fa7-8e5a-9d3654c33f6a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:24.505257 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbd35e-4e61-443b-8b06-c65269b45f94 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:24.508058 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918599ef-1a28-49ff-a333-b792e2e29e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:24.509173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918599ef-1a28-49ff-a333-b792e2e29e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:24.509577 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918599ef-1a28-49ff-a333-b792e2e29e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:24.510655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918599ef-1a28-49ff-a333-b792e2e29e48 admin admin] PATH_INFO: `/v3/projects/03fc1ecd76ad4978a70eb68df7baa0e1/users/5466cbd4909942a4b52c78f157330355/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:24.512252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4804414-d0aa-4c13-a83f-68c9203d684c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:24.512979 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4804414-d0aa-4c13-a83f-68c9203d684c service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:24.513270 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4804414-d0aa-4c13-a83f-68c9203d684c service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:24.515271 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918599ef-1a28-49ff-a333-b792e2e29e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03fc1ecd76ad4978a70eb68df7baa0e1, user_id=5466cbd4909942a4b52c78f157330355, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:24.516502 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918599ef-1a28-49ff-a333-b792e2e29e48 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:24.519918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4804414-d0aa-4c13-a83f-68c9203d684c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:24.533661 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4804414-d0aa-4c13-a83f-68c9203d684c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:24.535141 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4804414-d0aa-4c13-a83f-68c9203d684c service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:24.555467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 829/1645] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:24 2022] PUT /identity/v3/projects/03fc1ecd76ad4978a70eb68df7baa0e1/users/5466cbd4909942a4b52c78f157330355/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:24.555467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489c57f-5c54-4300-a1f2-09b6139396a8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:24.555467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489c57f-5c54-4300-a1f2-09b6139396a8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:24.555467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489c57f-5c54-4300-a1f2-09b6139396a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:24.561391 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 817/1646] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:24.633163 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f489c57f-5c54-4300-a1f2-09b6139396a8 None None] MFA Rules not processed for user `5466cbd4909942a4b52c78f157330355`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:24.637074 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f489c57f-5c54-4300-a1f2-09b6139396a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:24.710065 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:24.779495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4804414-d0aa-4c13-a83f-68c9203d684c service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:24.788526 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 830/1647] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:24.790162 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4804414-d0aa-4c13-a83f-68c9203d684c service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:24.930909 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9b274-10b9-4746-9d30-94e1b1a19e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:24.932104 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9b274-10b9-4746-9d30-94e1b1a19e0f service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:24.932685 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9b274-10b9-4746-9d30-94e1b1a19e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:24.933306 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9b274-10b9-4746-9d30-94e1b1a19e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:25.071801 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9b274-10b9-4746-9d30-94e1b1a19e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:25.073225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9b274-10b9-4746-9d30-94e1b1a19e0f service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:25.081290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:25.091223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 818/1648] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:34:26.024148 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489c57f-5c54-4300-a1f2-09b6139396a8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:26.042254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489c57f-5c54-4300-a1f2-09b6139396a8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:26.047022 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd159fad-dbe4-4922-a936-9e857dcb9a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:26.047880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd159fad-dbe4-4922-a936-9e857dcb9a80 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:26.053018 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd159fad-dbe4-4922-a936-9e857dcb9a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:26.053018 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd159fad-dbe4-4922-a936-9e857dcb9a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:26.178330 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd159fad-dbe4-4922-a936-9e857dcb9a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:26.180151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd159fad-dbe4-4922-a936-9e857dcb9a80 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:26.208209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 831/1649] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:26.359512 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9b274-10b9-4746-9d30-94e1b1a19e0f service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:26.389907 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9b274-10b9-4746-9d30-94e1b1a19e0f service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:26.402592 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a303841-d084-4459-adb0-a721c4ad3f6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:26.404594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303841-d084-4459-adb0-a721c4ad3f6d service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:26.404911 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303841-d084-4459-adb0-a721c4ad3f6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:26.405190 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303841-d084-4459-adb0-a721c4ad3f6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:26.430942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a303841-d084-4459-adb0-a721c4ad3f6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:26.440894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a303841-d084-4459-adb0-a721c4ad3f6d service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:26.460675 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 819/1650] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:27.301798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd159fad-dbe4-4922-a936-9e857dcb9a80 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:27.309873 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a303841-d084-4459-adb0-a721c4ad3f6d service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:27.320456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a303841-d084-4459-adb0-a721c4ad3f6d service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:27.324626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b04ea-129e-41c0-926d-977cec4aeeca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:27.325452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b04ea-129e-41c0-926d-977cec4aeeca service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:27.325819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b04ea-129e-41c0-926d-977cec4aeeca service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:27.326176 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b04ea-129e-41c0-926d-977cec4aeeca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:27.439523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd159fad-dbe4-4922-a936-9e857dcb9a80 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:27.451723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe5cd5-e01b-4f45-9ff9-4fd9ec4d92c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:27.454722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe5cd5-e01b-4f45-9ff9-4fd9ec4d92c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:27.455401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe5cd5-e01b-4f45-9ff9-4fd9ec4d92c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:27.456004 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe5cd5-e01b-4f45-9ff9-4fd9ec4d92c2 admin admin] PATH_INFO: `/v3/users/1b6726b31b0d4265bee3691bd9034980` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:27.459570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe5cd5-e01b-4f45-9ff9-4fd9ec4d92c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b6726b31b0d4265bee3691bd9034980)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:27.467504 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe5cd5-e01b-4f45-9ff9-4fd9ec4d92c2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:27.520048 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b04ea-129e-41c0-926d-977cec4aeeca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:27.526215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b04ea-129e-41c0-926d-977cec4aeeca service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:27.554338 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 820/1651] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:34:27.780704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f6fe5cd5-e01b-4f45-9ff9-4fd9ec4d92c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b6726b31b0d4265bee3691bd9034980'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:27.782856 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:27.800498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f6fe5cd5-e01b-4f45-9ff9-4fd9ec4d92c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b6726b31b0d4265bee3691bd9034980'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:27.814164 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f6fe5cd5-e01b-4f45-9ff9-4fd9ec4d92c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b6726b31b0d4265bee3691bd9034980'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:27.815722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f6fe5cd5-e01b-4f45-9ff9-4fd9ec4d92c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b6726b31b0d4265bee3691bd9034980'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:27.816667 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f6fe5cd5-e01b-4f45-9ff9-4fd9ec4d92c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b6726b31b0d4265bee3691bd9034980'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:27.956681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 832/1652] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:34:27 2022] DELETE /identity/v3/users/1b6726b31b0d4265bee3691bd9034980 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:27.960610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcab85-05c6-4b95-a253-f1f2f5c66ac4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:27.960899 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcab85-05c6-4b95-a253-f1f2f5c66ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:27.961370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcab85-05c6-4b95-a253-f1f2f5c66ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:27.997568 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4abcab85-05c6-4b95-a253-f1f2f5c66ac4 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:27.998916 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4abcab85-05c6-4b95-a253-f1f2f5c66ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:28.093472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 821/1653] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:28.117688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe5cd5-e01b-4f45-9ff9-4fd9ec4d92c2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:28.121428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f6fe5cd5-e01b-4f45-9ff9-4fd9ec4d92c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:28.292823 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcab85-05c6-4b95-a253-f1f2f5c66ac4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:28.293481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe5cd5-e01b-4f45-9ff9-4fd9ec4d92c2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:28.295046 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4abcab85-05c6-4b95-a253-f1f2f5c66ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:28.307636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90715a78-1990-436a-8849-a3755ec4516b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:28.309257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90715a78-1990-436a-8849-a3755ec4516b service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:28.310242 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90715a78-1990-436a-8849-a3755ec4516b service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:28.310731 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90715a78-1990-436a-8849-a3755ec4516b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:28.316753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcab85-05c6-4b95-a253-f1f2f5c66ac4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:28.332431 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52310e-ec96-4aec-9843-01747aecdb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:28.332431 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52310e-ec96-4aec-9843-01747aecdb07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:28.332431 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52310e-ec96-4aec-9843-01747aecdb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:28.332431 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52310e-ec96-4aec-9843-01747aecdb07 admin admin] PATH_INFO: `/v3/users/e6f6d9eef0414e67bd86acbfd2772c2b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:28.334669 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52310e-ec96-4aec-9843-01747aecdb07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6f6d9eef0414e67bd86acbfd2772c2b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:28.339840 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: WARNING py.warnings [None req-db52310e-ec96-4aec-9843-01747aecdb07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:34:28.339840 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: warnings.warn(msg) Jun 17 07:34:28.339840 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: Jun 17 07:34:28.344719 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52310e-ec96-4aec-9843-01747aecdb07 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:28.348551 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90715a78-1990-436a-8849-a3755ec4516b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:28.351496 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90715a78-1990-436a-8849-a3755ec4516b service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:28.379179 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 833/1654] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:28.720702 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-db52310e-ec96-4aec-9843-01747aecdb07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6f6d9eef0414e67bd86acbfd2772c2b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:28.780006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-db52310e-ec96-4aec-9843-01747aecdb07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6f6d9eef0414e67bd86acbfd2772c2b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:28.784196 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-db52310e-ec96-4aec-9843-01747aecdb07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6f6d9eef0414e67bd86acbfd2772c2b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:28.785355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-db52310e-ec96-4aec-9843-01747aecdb07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6f6d9eef0414e67bd86acbfd2772c2b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:28.795211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:28.811726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-db52310e-ec96-4aec-9843-01747aecdb07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6f6d9eef0414e67bd86acbfd2772c2b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:28.897082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 822/1655] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:34:28 2022] DELETE /identity/v3/users/e6f6d9eef0414e67bd86acbfd2772c2b => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:34:28.904455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800023fb-6ce7-4430-80cc-14cb2f168b1c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:28.905103 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800023fb-6ce7-4430-80cc-14cb2f168b1c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:28.905579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800023fb-6ce7-4430-80cc-14cb2f168b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:28.966944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-800023fb-6ce7-4430-80cc-14cb2f168b1c None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:28.968679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-800023fb-6ce7-4430-80cc-14cb2f168b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:29.129299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 834/1656] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:29.146433 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52310e-ec96-4aec-9843-01747aecdb07 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:29.149473 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-db52310e-ec96-4aec-9843-01747aecdb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:29.236082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52310e-ec96-4aec-9843-01747aecdb07 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:29.241111 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dea42-d066-4b46-ac5b-f62f4fb63b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:29.249447 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dea42-d066-4b46-ac5b-f62f4fb63b64 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:29.249447 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dea42-d066-4b46-ac5b-f62f4fb63b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:29.249447 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dea42-d066-4b46-ac5b-f62f4fb63b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:29.255426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dea42-d066-4b46-ac5b-f62f4fb63b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:29.256994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dea42-d066-4b46-ac5b-f62f4fb63b64 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:29.271458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 823/1657] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:30.160244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800023fb-6ce7-4430-80cc-14cb2f168b1c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:30.162903 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-800023fb-6ce7-4430-80cc-14cb2f168b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:30.194269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800023fb-6ce7-4430-80cc-14cb2f168b1c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:30.210730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ce354-5522-49af-8f29-379a0b8a96c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:30.211927 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ce354-5522-49af-8f29-379a0b8a96c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:30.212372 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ce354-5522-49af-8f29-379a0b8a96c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:30.215279 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ce354-5522-49af-8f29-379a0b8a96c4 admin admin] PATH_INFO: `/v3/projects/be14ecaa27b14457b8e0c29a65de7066` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:30.232194 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ce354-5522-49af-8f29-379a0b8a96c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be14ecaa27b14457b8e0c29a65de7066)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:30.233670 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-bd3ce354-5522-49af-8f29-379a0b8a96c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:34:30.233670 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 17 07:34:30.233670 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: Jun 17 07:34:30.238357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ce354-5522-49af-8f29-379a0b8a96c4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:30.536043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bd3ce354-5522-49af-8f29-379a0b8a96c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be14ecaa27b14457b8e0c29a65de7066', 'request_id': 'req-bd3ce354-5522-49af-8f29-379a0b8a96c4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:30.614937 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bd3ce354-5522-49af-8f29-379a0b8a96c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be14ecaa27b14457b8e0c29a65de7066', 'request_id': 'req-bd3ce354-5522-49af-8f29-379a0b8a96c4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:30.637545 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bd3ce354-5522-49af-8f29-379a0b8a96c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be14ecaa27b14457b8e0c29a65de7066', 'request_id': 'req-bd3ce354-5522-49af-8f29-379a0b8a96c4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:30.652873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:30.686563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bd3ce354-5522-49af-8f29-379a0b8a96c4 admin admin] The token cache is being invalidate because project be14ecaa27b14457b8e0c29a65de7066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:34:30.686956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bd3ce354-5522-49af-8f29-379a0b8a96c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:30.689832 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bd3ce354-5522-49af-8f29-379a0b8a96c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:30.695191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 835/1658] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:34:30 2022] DELETE /identity/v3/projects/be14ecaa27b14457b8e0c29a65de7066 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:30.704670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee108d8-6682-4075-87a8-0468cef5edfd None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:30.705637 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee108d8-6682-4075-87a8-0468cef5edfd None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:30.706374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee108d8-6682-4075-87a8-0468cef5edfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:30.748992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-dee108d8-6682-4075-87a8-0468cef5edfd None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:30.753144 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dee108d8-6682-4075-87a8-0468cef5edfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:30.829905 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ce354-5522-49af-8f29-379a0b8a96c4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:30.831599 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bd3ce354-5522-49af-8f29-379a0b8a96c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:30.909211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 824/1659] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:30.918853 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b239a-a927-4d9d-bd2e-68a86ef58edb None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:30.922378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b239a-a927-4d9d-bd2e-68a86ef58edb None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:30.922378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b239a-a927-4d9d-bd2e-68a86ef58edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:30.964606 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-7c0b239a-a927-4d9d-bd2e-68a86ef58edb None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:30.965958 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7c0b239a-a927-4d9d-bd2e-68a86ef58edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:30.990496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 825/1660] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:30.991280 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ce354-5522-49af-8f29-379a0b8a96c4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:30.994909 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b239a-a927-4d9d-bd2e-68a86ef58edb None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:31.002467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe798bc-1287-4fb4-a2ce-c739e1739670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:31.003594 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe798bc-1287-4fb4-a2ce-c739e1739670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:31.003981 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe798bc-1287-4fb4-a2ce-c739e1739670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:31.004368 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe798bc-1287-4fb4-a2ce-c739e1739670 admin admin] PATH_INFO: `/v3/projects/c8cc515016254032aa10156c7a3af9c2` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:31.007089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe798bc-1287-4fb4-a2ce-c739e1739670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8cc515016254032aa10156c7a3af9c2)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:31.014630 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b239a-a927-4d9d-bd2e-68a86ef58edb None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:31.014879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe798bc-1287-4fb4-a2ce-c739e1739670 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:31.037651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdb32f-d8c2-4622-8ccb-43d23ea86736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:31.037651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdb32f-d8c2-4622-8ccb-43d23ea86736 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:31.037651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdb32f-d8c2-4622-8ccb-43d23ea86736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:31.037964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdb32f-d8c2-4622-8ccb-43d23ea86736 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:31.038480 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbdb32f-d8c2-4622-8ccb-43d23ea86736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:34:31.038791 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbdb32f-d8c2-4622-8ccb-43d23ea86736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:31.040482 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbdb32f-d8c2-4622-8ccb-43d23ea86736 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:31.078104 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 826/1661] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:34:31.083269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdb32f-d8c2-4622-8ccb-43d23ea86736 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:31.102148 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdb32f-d8c2-4622-8ccb-43d23ea86736 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:31.109199 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ef2f8-7846-4509-8dfa-cd936766550f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:31.110283 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ef2f8-7846-4509-8dfa-cd936766550f admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:31.111191 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ef2f8-7846-4509-8dfa-cd936766550f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:31.111493 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ef2f8-7846-4509-8dfa-cd936766550f admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:31.112954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ef2f8-7846-4509-8dfa-cd936766550f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:31.114989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ef2f8-7846-4509-8dfa-cd936766550f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:31.217419 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7fe798bc-1287-4fb4-a2ce-c739e1739670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8cc515016254032aa10156c7a3af9c2', 'request_id': 'req-7fe798bc-1287-4fb4-a2ce-c739e1739670'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:31.249011 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 827/1662] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:31 2022] POST /identity/v3/projects => generated 405 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:31.253393 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ef2f8-7846-4509-8dfa-cd936766550f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:31.325628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7fe798bc-1287-4fb4-a2ce-c739e1739670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8cc515016254032aa10156c7a3af9c2', 'request_id': 'req-7fe798bc-1287-4fb4-a2ce-c739e1739670'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:31.334700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7fe798bc-1287-4fb4-a2ce-c739e1739670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8cc515016254032aa10156c7a3af9c2', 'request_id': 'req-7fe798bc-1287-4fb4-a2ce-c739e1739670'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:31.361452 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7fe798bc-1287-4fb4-a2ce-c739e1739670 admin admin] The token cache is being invalidate because project c8cc515016254032aa10156c7a3af9c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:34:31.361705 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7fe798bc-1287-4fb4-a2ce-c739e1739670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:31.364638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7fe798bc-1287-4fb4-a2ce-c739e1739670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:31.367756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 836/1663] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:34:30 2022] DELETE /identity/v3/projects/c8cc515016254032aa10156c7a3af9c2 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:31.371727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe798bc-1287-4fb4-a2ce-c739e1739670 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:31.371911 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:31.373211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7fe798bc-1287-4fb4-a2ce-c739e1739670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:31.423864 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ef2f8-7846-4509-8dfa-cd936766550f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:31.451475 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4539284-78d6-4dca-bcb2-43eff357f2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:31.452411 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4539284-78d6-4dca-bcb2-43eff357f2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:31.463899 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4539284-78d6-4dca-bcb2-43eff357f2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:31.463899 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4539284-78d6-4dca-bcb2-43eff357f2a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:31.463899 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4539284-78d6-4dca-bcb2-43eff357f2a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:31.463899 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4539284-78d6-4dca-bcb2-43eff357f2a2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:31.525169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe798bc-1287-4fb4-a2ce-c739e1739670 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:31.532138 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f197135-5941-43e8-afd2-93c5d8ca6f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:31.533062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197135-5941-43e8-afd2-93c5d8ca6f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:31.533844 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197135-5941-43e8-afd2-93c5d8ca6f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:31.533844 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197135-5941-43e8-afd2-93c5d8ca6f1d admin admin] PATH_INFO: `/v3/users/d1b68a1ac9dc41afbb6a21e9d6b1a8a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:31.535632 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f197135-5941-43e8-afd2-93c5d8ca6f1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1b68a1ac9dc41afbb6a21e9d6b1a8a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:31.538057 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f197135-5941-43e8-afd2-93c5d8ca6f1d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:31.578460 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 828/1664] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:31 2022] POST /identity/v3/users => generated 303 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:31.582168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4539284-78d6-4dca-bcb2-43eff357f2a2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:31.584215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e4539284-78d6-4dca-bcb2-43eff357f2a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:31.612868 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4539284-78d6-4dca-bcb2-43eff357f2a2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:31.628875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225b06c-1e1c-4993-9fd6-a234b7c6ca83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:31.633612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225b06c-1e1c-4993-9fd6-a234b7c6ca83 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:31.633612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225b06c-1e1c-4993-9fd6-a234b7c6ca83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:31.633612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225b06c-1e1c-4993-9fd6-a234b7c6ca83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:31.633612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225b06c-1e1c-4993-9fd6-a234b7c6ca83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:31.633612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225b06c-1e1c-4993-9fd6-a234b7c6ca83 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:31.682673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 829/1665] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:34:31.683421 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225b06c-1e1c-4993-9fd6-a234b7c6ca83 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:31.706880 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225b06c-1e1c-4993-9fd6-a234b7c6ca83 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:31.731388 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16567000-24c8-4577-a607-e71d5e662f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:31.731956 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16567000-24c8-4577-a607-e71d5e662f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:31.732237 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16567000-24c8-4577-a607-e71d5e662f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:31.732526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16567000-24c8-4577-a607-e71d5e662f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:31.733283 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16567000-24c8-4577-a607-e71d5e662f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:31.755367 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16567000-24c8-4577-a607-e71d5e662f4b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:31.781706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3f197135-5941-43e8-afd2-93c5d8ca6f1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1b68a1ac9dc41afbb6a21e9d6b1a8a4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:31.786761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 830/1666] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:31.788672 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914b820-f805-4591-adde-344adc9f37b7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:31.789041 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914b820-f805-4591-adde-344adc9f37b7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:31.789342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914b820-f805-4591-adde-344adc9f37b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:31.832059 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3f197135-5941-43e8-afd2-93c5d8ca6f1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1b68a1ac9dc41afbb6a21e9d6b1a8a4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:31.849867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3f197135-5941-43e8-afd2-93c5d8ca6f1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1b68a1ac9dc41afbb6a21e9d6b1a8a4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:31.850735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3f197135-5941-43e8-afd2-93c5d8ca6f1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1b68a1ac9dc41afbb6a21e9d6b1a8a4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:31.851824 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3f197135-5941-43e8-afd2-93c5d8ca6f1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1b68a1ac9dc41afbb6a21e9d6b1a8a4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:31.854877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-9914b820-f805-4591-adde-344adc9f37b7 None None] MFA Rules not processed for user `8b753148f55e4fb0897bf9639e8d4d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:31.856104 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9914b820-f805-4591-adde-344adc9f37b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:31.957011 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 837/1667] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:34:31 2022] DELETE /identity/v3/users/d1b68a1ac9dc41afbb6a21e9d6b1a8a4 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:31.958051 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f197135-5941-43e8-afd2-93c5d8ca6f1d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:31.959680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3f197135-5941-43e8-afd2-93c5d8ca6f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:32.036849 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 831/1668] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:32.076005 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be5e2e-12f1-4322-b7f1-3878fb1631d1 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:32.076309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be5e2e-12f1-4322-b7f1-3878fb1631d1 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:32.076572 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be5e2e-12f1-4322-b7f1-3878fb1631d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:32.136793 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-27be5e2e-12f1-4322-b7f1-3878fb1631d1 None None] MFA Rules not processed for user `8b753148f55e4fb0897bf9639e8d4d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:32.138475 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-27be5e2e-12f1-4322-b7f1-3878fb1631d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:32.221651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f197135-5941-43e8-afd2-93c5d8ca6f1d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:32.227643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 832/1669] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:32.236014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf8fa2-4b13-46e9-a668-32bc2b51a28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:32.236922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf8fa2-4b13-46e9-a668-32bc2b51a28c admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:32.237204 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf8fa2-4b13-46e9-a668-32bc2b51a28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:32.237636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf8fa2-4b13-46e9-a668-32bc2b51a28c admin admin] PATH_INFO: `/v3/projects/add6af2bac2e46059305d6de6e1c379f/users/4078362ea48346cea1892dac5473e2e9/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:32.241256 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be5e2e-12f1-4322-b7f1-3878fb1631d1 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:32.247773 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-27be5e2e-12f1-4322-b7f1-3878fb1631d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:32.278918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf8fa2-4b13-46e9-a668-32bc2b51a28c admin admin] RBAC: Authorizing `identity:create_grant(project_id=add6af2bac2e46059305d6de6e1c379f, user_id=4078362ea48346cea1892dac5473e2e9, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:32.302062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf8fa2-4b13-46e9-a668-32bc2b51a28c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:32.410614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 838/1670] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:31 2022] PUT /identity/v3/projects/add6af2bac2e46059305d6de6e1c379f/users/4078362ea48346cea1892dac5473e2e9/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:32.412604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b754d05-1810-4dd2-85c4-bb6f19cb10ff None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:32.417678 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b754d05-1810-4dd2-85c4-bb6f19cb10ff None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:32.418166 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b754d05-1810-4dd2-85c4-bb6f19cb10ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:32.439643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be5e2e-12f1-4322-b7f1-3878fb1631d1 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:32.467967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6b754d05-1810-4dd2-85c4-bb6f19cb10ff None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:32.469508 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6b754d05-1810-4dd2-85c4-bb6f19cb10ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:32.577834 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308caedb-9005-49f0-b3e6-b1696f570df4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:32.578508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308caedb-9005-49f0-b3e6-b1696f570df4 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:32.578813 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308caedb-9005-49f0-b3e6-b1696f570df4 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:32.579092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308caedb-9005-49f0-b3e6-b1696f570df4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:32.616205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 839/1671] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:32.617589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57931cf7-d60c-4933-b3e3-91fd3e1eb769 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:32.620724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57931cf7-d60c-4933-b3e3-91fd3e1eb769 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:32.620724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57931cf7-d60c-4933-b3e3-91fd3e1eb769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:32.718263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-57931cf7-d60c-4933-b3e3-91fd3e1eb769 None None] MFA Rules not processed for user `3e7b9aa8532b47afafeb7481932bfce9`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:32.719528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-57931cf7-d60c-4933-b3e3-91fd3e1eb769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:32.773263 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308caedb-9005-49f0-b3e6-b1696f570df4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:32.776464 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308caedb-9005-49f0-b3e6-b1696f570df4 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:32.802496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 833/1672] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:32.803744 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308caedb-9005-49f0-b3e6-b1696f570df4 service nova] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:32.806513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-308caedb-9005-49f0-b3e6-b1696f570df4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:32.856520 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:32.876954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 840/1673] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:32.889376 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08800fce-7c46-44cc-a23d-1aef1c4d7380 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:32.889987 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08800fce-7c46-44cc-a23d-1aef1c4d7380 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:32.890299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08800fce-7c46-44cc-a23d-1aef1c4d7380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:32.929065 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-08800fce-7c46-44cc-a23d-1aef1c4d7380 None None] MFA Rules not processed for user `3e7b9aa8532b47afafeb7481932bfce9`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:32.935773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-08800fce-7c46-44cc-a23d-1aef1c4d7380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:32.936150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308caedb-9005-49f0-b3e6-b1696f570df4 service nova] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:32.937248 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5c177-81c2-433e-805c-ceeda4487257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:32.937997 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5c177-81c2-433e-805c-ceeda4487257 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:32.938330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5c177-81c2-433e-805c-ceeda4487257 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:32.938721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5c177-81c2-433e-805c-ceeda4487257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:32.950849 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 841/1674] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:34:32.995549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08800fce-7c46-44cc-a23d-1aef1c4d7380 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:33.000059 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-08800fce-7c46-44cc-a23d-1aef1c4d7380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:33.007833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5c177-81c2-433e-805c-ceeda4487257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:33.009316 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5c177-81c2-433e-805c-ceeda4487257 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:33.045227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 834/1675] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:33.092679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08800fce-7c46-44cc-a23d-1aef1c4d7380 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:33.106242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:33.121223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47743760-acb3-4499-9a46-e7e25b3f4c16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:33.122159 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47743760-acb3-4499-9a46-e7e25b3f4c16 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:33.122446 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47743760-acb3-4499-9a46-e7e25b3f4c16 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:33.122716 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47743760-acb3-4499-9a46-e7e25b3f4c16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:33.149548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47743760-acb3-4499-9a46-e7e25b3f4c16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:33.168327 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47743760-acb3-4499-9a46-e7e25b3f4c16 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:33.172368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5c177-81c2-433e-805c-ceeda4487257 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:33.172368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b7a5c177-81c2-433e-805c-ceeda4487257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:33.205051 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 842/1676] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:33.205184 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5c177-81c2-433e-805c-ceeda4487257 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:33.221005 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2097cf-7f04-4485-a5eb-932c81be8d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:33.221947 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2097cf-7f04-4485-a5eb-932c81be8d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:33.222237 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2097cf-7f04-4485-a5eb-932c81be8d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:33.223630 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2097cf-7f04-4485-a5eb-932c81be8d6c admin admin] PATH_INFO: `/v3/projects/ea2872bf79ad47b9a64b358ed1a10ee4` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:33.226597 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2097cf-7f04-4485-a5eb-932c81be8d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea2872bf79ad47b9a64b358ed1a10ee4)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:33.233627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2097cf-7f04-4485-a5eb-932c81be8d6c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:33.427614 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5c2097cf-7f04-4485-a5eb-932c81be8d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea2872bf79ad47b9a64b358ed1a10ee4', 'request_id': 'req-5c2097cf-7f04-4485-a5eb-932c81be8d6c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:33.436454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5c2097cf-7f04-4485-a5eb-932c81be8d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea2872bf79ad47b9a64b358ed1a10ee4', 'request_id': 'req-5c2097cf-7f04-4485-a5eb-932c81be8d6c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:33.596657 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5c2097cf-7f04-4485-a5eb-932c81be8d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea2872bf79ad47b9a64b358ed1a10ee4', 'request_id': 'req-5c2097cf-7f04-4485-a5eb-932c81be8d6c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:33.618035 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5c2097cf-7f04-4485-a5eb-932c81be8d6c admin admin] The token cache is being invalidate because project ea2872bf79ad47b9a64b358ed1a10ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:34:33.618702 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5c2097cf-7f04-4485-a5eb-932c81be8d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:33.621110 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5c2097cf-7f04-4485-a5eb-932c81be8d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:33.634262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 835/1677] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:34:33 2022] DELETE /identity/v3/projects/ea2872bf79ad47b9a64b358ed1a10ee4 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:34:33.639787 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc624515-f0d9-4558-9f3c-378cf88ae013 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:33.641062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc624515-f0d9-4558-9f3c-378cf88ae013 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:33.641388 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc624515-f0d9-4558-9f3c-378cf88ae013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:33.717829 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-dc624515-f0d9-4558-9f3c-378cf88ae013 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:33.722255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dc624515-f0d9-4558-9f3c-378cf88ae013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:33.820511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585adb7e-a5d1-45c1-8c48-1b9ec55d0e73 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:33.821008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585adb7e-a5d1-45c1-8c48-1b9ec55d0e73 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:33.821086 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585adb7e-a5d1-45c1-8c48-1b9ec55d0e73 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:33.823746 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 836/1678] 10.222.0.52 () {54 vars in 912 bytes} [Fri Jun 17 07:34:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:34:33.830951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dd930-a648-4b7a-a3c5-214de8c3fc16 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:33.831073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dd930-a648-4b7a-a3c5-214de8c3fc16 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:33.831363 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dd930-a648-4b7a-a3c5-214de8c3fc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:33.919114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 843/1679] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:33.926714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a824009-215a-4aa4-a360-f8adab529a02 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:33.927412 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a824009-215a-4aa4-a360-f8adab529a02 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:33.927889 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a824009-215a-4aa4-a360-f8adab529a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:33.950674 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-bc2dd930-a648-4b7a-a3c5-214de8c3fc16 None None] MFA Rules not processed for user `ad436c2fecba4754875b7c7cb26852a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:33.951907 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-bc2dd930-a648-4b7a-a3c5-214de8c3fc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:33.982117 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5a824009-215a-4aa4-a360-f8adab529a02 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:33.983703 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5a824009-215a-4aa4-a360-f8adab529a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:34.032674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 844/1680] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:34:34.043312 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a824009-215a-4aa4-a360-f8adab529a02 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:34.053412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 837/1681] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Jun 17 07:34:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:34.060804 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a824009-215a-4aa4-a360-f8adab529a02 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:34.066257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c3ebc-4e5f-4e84-a7a2-bfe22918dffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:34.067375 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c3ebc-4e5f-4e84-a7a2-bfe22918dffb admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:34.067735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c3ebc-4e5f-4e84-a7a2-bfe22918dffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:34.068127 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c3ebc-4e5f-4e84-a7a2-bfe22918dffb admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:34.068975 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c3ebc-4e5f-4e84-a7a2-bfe22918dffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:34:34.069411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c3ebc-4e5f-4e84-a7a2-bfe22918dffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:34.071736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c3ebc-4e5f-4e84-a7a2-bfe22918dffb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:34.090336 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dd930-a648-4b7a-a3c5-214de8c3fc16 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:34.094282 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-bc2dd930-a648-4b7a-a3c5-214de8c3fc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:34.111139 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 845/1682] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:34:34.116613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dd930-a648-4b7a-a3c5-214de8c3fc16 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:34.116784 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c3ebc-4e5f-4e84-a7a2-bfe22918dffb admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:34.130942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec2169-ec53-43b7-bdfb-4a4315559028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:34.132002 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec2169-ec53-43b7-bdfb-4a4315559028 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:34.132426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec2169-ec53-43b7-bdfb-4a4315559028 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:34.132626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c3ebc-4e5f-4e84-a7a2-bfe22918dffb admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:34.133017 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec2169-ec53-43b7-bdfb-4a4315559028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:34.142060 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e21e6-8465-4dee-be24-d6b1dc800183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:34.142852 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e21e6-8465-4dee-be24-d6b1dc800183 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:34.143388 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e21e6-8465-4dee-be24-d6b1dc800183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:34.144311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e21e6-8465-4dee-be24-d6b1dc800183 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:34.145105 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e21e6-8465-4dee-be24-d6b1dc800183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:34.147713 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e21e6-8465-4dee-be24-d6b1dc800183 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:34.159094 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec2169-ec53-43b7-bdfb-4a4315559028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:34.164937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec2169-ec53-43b7-bdfb-4a4315559028 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:34.188180 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 838/1683] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:34.299829 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 846/1684] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:34 2022] POST /identity/v3/projects => generated 355 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:34.304084 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec2169-ec53-43b7-bdfb-4a4315559028 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:34.321073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec2169-ec53-43b7-bdfb-4a4315559028 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:34.335732 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:34.388473 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:34.478995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522577df-7371-40ea-9f5d-3ea0b3dccf9e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:34.479284 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522577df-7371-40ea-9f5d-3ea0b3dccf9e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:34.479646 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522577df-7371-40ea-9f5d-3ea0b3dccf9e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:34.481265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 847/1685] 10.222.0.52 () {54 vars in 912 bytes} [Fri Jun 17 07:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:34:34.486090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f1d46-d29e-4ff0-aa3c-597b64e47882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:34.486255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f1d46-d29e-4ff0-aa3c-597b64e47882 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:34.486625 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f1d46-d29e-4ff0-aa3c-597b64e47882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:34.487058 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f1d46-d29e-4ff0-aa3c-597b64e47882 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:34.489450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f1d46-d29e-4ff0-aa3c-597b64e47882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:34.490804 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caf859-ad92-404f-b1a9-12d109f4b1bf None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:34.491097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caf859-ad92-404f-b1a9-12d109f4b1bf None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:34.491376 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caf859-ad92-404f-b1a9-12d109f4b1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:34.496901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f1d46-d29e-4ff0-aa3c-597b64e47882 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:34.540111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-03caf859-ad92-404f-b1a9-12d109f4b1bf None None] MFA Rules not processed for user `ad436c2fecba4754875b7c7cb26852a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:34.544026 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-03caf859-ad92-404f-b1a9-12d109f4b1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:34.645015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 848/1686] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Jun 17 07:34:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:34:34.661450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 839/1687] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:34 2022] POST /identity/v3/users => generated 278 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:34.665785 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03caf859-ad92-404f-b1a9-12d109f4b1bf None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:34.685029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03caf859-ad92-404f-b1a9-12d109f4b1bf None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:34.690940 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f1d46-d29e-4ff0-aa3c-597b64e47882 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:34.693873 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-214f1d46-d29e-4ff0-aa3c-597b64e47882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:34.710931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3670a-0693-4a57-a57e-fc0ab8155870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:34.714728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3670a-0693-4a57-a57e-fc0ab8155870 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:34.716371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3670a-0693-4a57-a57e-fc0ab8155870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:34.717000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3670a-0693-4a57-a57e-fc0ab8155870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:34.719630 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3670a-0693-4a57-a57e-fc0ab8155870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:34.722352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f1d46-d29e-4ff0-aa3c-597b64e47882 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:34.727863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3670a-0693-4a57-a57e-fc0ab8155870 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:34.739113 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae46f74-8bb1-4c2d-b16d-44fb4e6424cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:34.741443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae46f74-8bb1-4c2d-b16d-44fb4e6424cf service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:34.742267 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae46f74-8bb1-4c2d-b16d-44fb4e6424cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:34.749117 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae46f74-8bb1-4c2d-b16d-44fb4e6424cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:34.786460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 849/1688] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:34.788283 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae46f74-8bb1-4c2d-b16d-44fb4e6424cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:34.790388 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3670a-0693-4a57-a57e-fc0ab8155870 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:34.803449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae46f74-8bb1-4c2d-b16d-44fb4e6424cf service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:34.859522 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3670a-0693-4a57-a57e-fc0ab8155870 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:34.859758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 840/1689] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:34.873860 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ad222-a4b1-4fa9-912a-a28ad98a2991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:34.875831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ad222-a4b1-4fa9-912a-a28ad98a2991 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:34.879192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ad222-a4b1-4fa9-912a-a28ad98a2991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:34.879192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ad222-a4b1-4fa9-912a-a28ad98a2991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:34.880951 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ad222-a4b1-4fa9-912a-a28ad98a2991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:34.885207 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ad222-a4b1-4fa9-912a-a28ad98a2991 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:34.919300 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 850/1690] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:34.921400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae46f74-8bb1-4c2d-b16d-44fb4e6424cf service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:34.949730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae46f74-8bb1-4c2d-b16d-44fb4e6424cf service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:34.970077 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd5230-d1cb-4b13-802f-22b742c8d918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:34.970996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd5230-d1cb-4b13-802f-22b742c8d918 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:34.971281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd5230-d1cb-4b13-802f-22b742c8d918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:34.971559 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd5230-d1cb-4b13-802f-22b742c8d918 admin admin] PATH_INFO: `/v3/projects/3a322a806a1242778840c9301a77ad79/users/c3817f338c1d4d9788e08519c0b4f748/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:34.977072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:35.005228 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd5230-d1cb-4b13-802f-22b742c8d918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a322a806a1242778840c9301a77ad79, user_id=c3817f338c1d4d9788e08519c0b4f748, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:35.008187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd5230-d1cb-4b13-802f-22b742c8d918 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:35.125203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 841/1691] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:34 2022] PUT /identity/v3/projects/3a322a806a1242778840c9301a77ad79/users/c3817f338c1d4d9788e08519c0b4f748/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:35.138129 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdf702-c738-465c-a1c3-573f83f510cb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:35.144343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdf702-c738-465c-a1c3-573f83f510cb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:35.144343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdf702-c738-465c-a1c3-573f83f510cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:35.220891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-55bdf702-c738-465c-a1c3-573f83f510cb None None] MFA Rules not processed for user `c3817f338c1d4d9788e08519c0b4f748`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:35.222414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-55bdf702-c738-465c-a1c3-573f83f510cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:35.295622 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd49e68-cf2b-4c5d-940c-627590188255 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:35.295986 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd49e68-cf2b-4c5d-940c-627590188255 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:35.296334 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd49e68-cf2b-4c5d-940c-627590188255 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:35.298741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 842/1692] 10.222.0.52 () {54 vars in 960 bytes} [Fri Jun 17 07:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:34:35.312253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6747e0-733f-4e2d-9ad3-5d83d49e2c2c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:35.312253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6747e0-733f-4e2d-9ad3-5d83d49e2c2c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:35.312253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6747e0-733f-4e2d-9ad3-5d83d49e2c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:35.363871 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-7a6747e0-733f-4e2d-9ad3-5d83d49e2c2c None None] MFA Rules not processed for user `71adc8b93e5c41929b928002e004df6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:35.367065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7a6747e0-733f-4e2d-9ad3-5d83d49e2c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:35.407752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 851/1693] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:35 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:35.412426 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdf702-c738-465c-a1c3-573f83f510cb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:35.607180 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 843/1694] 10.222.0.52 () {58 vars in 1057 bytes} [Fri Jun 17 07:34:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:34:35.615544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d67e45-d110-47a9-a911-20ee7362651c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:35.617372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d67e45-d110-47a9-a911-20ee7362651c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:35.618049 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d67e45-d110-47a9-a911-20ee7362651c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:35.639159 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdf702-c738-465c-a1c3-573f83f510cb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:35.652899 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cef9c8-1942-4ca3-9caf-2da55a8152cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:35.653795 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cef9c8-1942-4ca3-9caf-2da55a8152cc admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:35.654086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cef9c8-1942-4ca3-9caf-2da55a8152cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:35.654370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cef9c8-1942-4ca3-9caf-2da55a8152cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:35.655262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cef9c8-1942-4ca3-9caf-2da55a8152cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:35.657774 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cef9c8-1942-4ca3-9caf-2da55a8152cc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:35.687862 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b5d67e45-d110-47a9-a911-20ee7362651c None None] MFA Rules not processed for user `8b753148f55e4fb0897bf9639e8d4d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:35.690018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b5d67e45-d110-47a9-a911-20ee7362651c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:35.780141 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 852/1695] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:35 2022] POST /identity/v3/projects => generated 357 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:34:35.782348 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cef9c8-1942-4ca3-9caf-2da55a8152cc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:35.803037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:35.818442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 844/1696] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:35.820588 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d67e45-d110-47a9-a911-20ee7362651c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:35.877242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d67e45-d110-47a9-a911-20ee7362651c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:36.023031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c6853-7bdf-4c8b-98a4-ab8cb01fa228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:36.024300 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c6853-7bdf-4c8b-98a4-ab8cb01fa228 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:36.026906 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c6853-7bdf-4c8b-98a4-ab8cb01fa228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:36.028164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c6853-7bdf-4c8b-98a4-ab8cb01fa228 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:36.029306 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c6853-7bdf-4c8b-98a4-ab8cb01fa228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:36.036637 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c6853-7bdf-4c8b-98a4-ab8cb01fa228 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:36.040160 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cef9c8-1942-4ca3-9caf-2da55a8152cc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:36.046989 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c46fb-65fc-4160-9e39-53136eeb38b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adc8b93e5c41929b928002e004df6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:36.047877 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c46fb-65fc-4160-9e39-53136eeb38b4 service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:36.048470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c46fb-65fc-4160-9e39-53136eeb38b4 service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:36.049047 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c46fb-65fc-4160-9e39-53136eeb38b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:36.052118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ae5c46fb-65fc-4160-9e39-53136eeb38b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:36.082142 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c46fb-65fc-4160-9e39-53136eeb38b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:36.083784 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c46fb-65fc-4160-9e39-53136eeb38b4 service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:36.111423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 853/1697] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:36.112834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6256-9dd1-449c-8cb6-e38cb2d7b603 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:36.113165 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6256-9dd1-449c-8cb6-e38cb2d7b603 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:36.113486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6256-9dd1-449c-8cb6-e38cb2d7b603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:36.167589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-eedf6256-9dd1-449c-8cb6-e38cb2d7b603 None None] MFA Rules not processed for user `4078362ea48346cea1892dac5473e2e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:36.168935 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-eedf6256-9dd1-449c-8cb6-e38cb2d7b603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:36.176289 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 845/1698] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:35 2022] POST /identity/v3/users => generated 285 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:36.179093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c6853-7bdf-4c8b-98a4-ab8cb01fa228 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:36.206385 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c6853-7bdf-4c8b-98a4-ab8cb01fa228 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:36.223822 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6cb28-014c-4d66-86ff-bd03049b3e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:36.229048 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6cb28-014c-4d66-86ff-bd03049b3e4f admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:36.231507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6cb28-014c-4d66-86ff-bd03049b3e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:36.234973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6cb28-014c-4d66-86ff-bd03049b3e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:36.236925 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6cb28-014c-4d66-86ff-bd03049b3e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:36.242614 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6cb28-014c-4d66-86ff-bd03049b3e4f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:36.260589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 846/1699] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:36.266734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6cb28-014c-4d66-86ff-bd03049b3e4f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:36.293670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6cb28-014c-4d66-86ff-bd03049b3e4f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:36.309607 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7faa4e4-b121-40f6-8000-af109241b851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:36.312006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faa4e4-b121-40f6-8000-af109241b851 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:36.312286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faa4e4-b121-40f6-8000-af109241b851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:36.312569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faa4e4-b121-40f6-8000-af109241b851 admin admin] PATH_INFO: `/v3/projects/21948635eb8e451daccd579ea0a119e0/users/fe17cf51afe34d0f85e8bae64ca23bab/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:36.352498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7faa4e4-b121-40f6-8000-af109241b851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21948635eb8e451daccd579ea0a119e0, user_id=fe17cf51afe34d0f85e8bae64ca23bab, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:36.362585 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 854/1700] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:36.374158 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf6256-9dd1-449c-8cb6-e38cb2d7b603 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:36.376783 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7faa4e4-b121-40f6-8000-af109241b851 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:36.386595 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-eedf6256-9dd1-449c-8cb6-e38cb2d7b603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:36.388715 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:36.429953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf6256-9dd1-449c-8cb6-e38cb2d7b603 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:36.447995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471481e-563d-480a-90ac-540f1261aa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:36.448686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471481e-563d-480a-90ac-540f1261aa1b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:36.449125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471481e-563d-480a-90ac-540f1261aa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:36.449479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471481e-563d-480a-90ac-540f1261aa1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:36.450354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471481e-563d-480a-90ac-540f1261aa1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:36.452322 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471481e-563d-480a-90ac-540f1261aa1b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:36.475931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 847/1701] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:36 2022] PUT /identity/v3/projects/21948635eb8e451daccd579ea0a119e0/users/fe17cf51afe34d0f85e8bae64ca23bab/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:36.482167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7faa4e4-b121-40f6-8000-af109241b851 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:36.567578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 855/1702] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:36 2022] POST /identity/v3/projects => generated 403 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:36.575210 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471481e-563d-480a-90ac-540f1261aa1b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:36.695747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:36.770844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7faa4e4-b121-40f6-8000-af109241b851 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:36.823094 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471481e-563d-480a-90ac-540f1261aa1b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:36.840306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a5de6-f511-4160-81a7-590a4ad6383d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:36.856033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a5de6-f511-4160-81a7-590a4ad6383d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:36.856319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a5de6-f511-4160-81a7-590a4ad6383d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:36.856594 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a5de6-f511-4160-81a7-590a4ad6383d admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:36.857400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a5de6-f511-4160-81a7-590a4ad6383d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:36.864375 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a5de6-f511-4160-81a7-590a4ad6383d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:36.955413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40925274-e171-491a-8f2a-bcf2c820866e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:36.961449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40925274-e171-491a-8f2a-bcf2c820866e admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:36.961449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40925274-e171-491a-8f2a-bcf2c820866e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:36.961449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40925274-e171-491a-8f2a-bcf2c820866e admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:36.961449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40925274-e171-491a-8f2a-bcf2c820866e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:36.970795 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40925274-e171-491a-8f2a-bcf2c820866e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:36.992484 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 856/1703] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:36 2022] POST /identity/v3/users => generated 308 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:34:36.998941 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a5de6-f511-4160-81a7-590a4ad6383d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:37.006717 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 848/1704] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:37.015679 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40925274-e171-491a-8f2a-bcf2c820866e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:37.017599 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a5de6-f511-4160-81a7-590a4ad6383d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:37.031286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce5e4b-1b6d-4a17-a3de-c78f8b3258c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:37.033429 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce5e4b-1b6d-4a17-a3de-c78f8b3258c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:37.033880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce5e4b-1b6d-4a17-a3de-c78f8b3258c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:37.034315 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce5e4b-1b6d-4a17-a3de-c78f8b3258c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:37.038413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce5e4b-1b6d-4a17-a3de-c78f8b3258c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:37.038413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce5e4b-1b6d-4a17-a3de-c78f8b3258c8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:37.046525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40925274-e171-491a-8f2a-bcf2c820866e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:37.067975 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 857/1705] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:34:37.068179 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3d299-a888-48c8-bd79-5ee07d06a7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:37.069098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce5e4b-1b6d-4a17-a3de-c78f8b3258c8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:37.077991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3d299-a888-48c8-bd79-5ee07d06a7e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:37.077991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3d299-a888-48c8-bd79-5ee07d06a7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:37.077991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3d299-a888-48c8-bd79-5ee07d06a7e1 admin admin] PATH_INFO: `/v3/projects/21948635eb8e451daccd579ea0a119e0/users/fe17cf51afe34d0f85e8bae64ca23bab/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:37.078676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3d299-a888-48c8-bd79-5ee07d06a7e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21948635eb8e451daccd579ea0a119e0, user_id=fe17cf51afe34d0f85e8bae64ca23bab, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:37.082501 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3d299-a888-48c8-bd79-5ee07d06a7e1 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:37.088709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce5e4b-1b6d-4a17-a3de-c78f8b3258c8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:37.104297 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44b269-c396-4f2c-8a36-a631de39c6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:37.105417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44b269-c396-4f2c-8a36-a631de39c6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:37.105781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44b269-c396-4f2c-8a36-a631de39c6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:37.106128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44b269-c396-4f2c-8a36-a631de39c6fd admin admin] PATH_INFO: `/v3/projects/037995adc3bf40ff81f75d7686cd2c07/users/7f884cdbb39b473099df8e30dbc68c47/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:37.110201 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 849/1706] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:37 2022] PUT /identity/v3/projects/21948635eb8e451daccd579ea0a119e0/users/fe17cf51afe34d0f85e8bae64ca23bab/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:37.124017 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3af3e-4295-4f30-b1d7-29570820b94f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:37.125347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3af3e-4295-4f30-b1d7-29570820b94f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:37.125744 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3af3e-4295-4f30-b1d7-29570820b94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:37.144544 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44b269-c396-4f2c-8a36-a631de39c6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=037995adc3bf40ff81f75d7686cd2c07, user_id=7f884cdbb39b473099df8e30dbc68c47, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:37.147406 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44b269-c396-4f2c-8a36-a631de39c6fd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:37.203098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3ca3af3e-4295-4f30-b1d7-29570820b94f None None] MFA Rules not processed for user `fe17cf51afe34d0f85e8bae64ca23bab`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:37.204813 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3ca3af3e-4295-4f30-b1d7-29570820b94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:37.274389 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 858/1707] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:37 2022] PUT /identity/v3/projects/037995adc3bf40ff81f75d7686cd2c07/users/7f884cdbb39b473099df8e30dbc68c47/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:37.278570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44b269-c396-4f2c-8a36-a631de39c6fd admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:37.444135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 850/1708] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:37 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:34:37.465567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3af3e-4295-4f30-b1d7-29570820b94f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:37.467442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3ca3af3e-4295-4f30-b1d7-29570820b94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:37.510621 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44b269-c396-4f2c-8a36-a631de39c6fd admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:37.527837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937ffa6-e9f1-4a35-82cd-0fea5b67ac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:37.530108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937ffa6-e9f1-4a35-82cd-0fea5b67ac7c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:37.531569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937ffa6-e9f1-4a35-82cd-0fea5b67ac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:37.531864 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937ffa6-e9f1-4a35-82cd-0fea5b67ac7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:37.558325 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937ffa6-e9f1-4a35-82cd-0fea5b67ac7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:37.570524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937ffa6-e9f1-4a35-82cd-0fea5b67ac7c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:37.577960 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:37.624032 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 859/1709] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:34:37.629083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937ffa6-e9f1-4a35-82cd-0fea5b67ac7c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:37.668403 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937ffa6-e9f1-4a35-82cd-0fea5b67ac7c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:37.695629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad2903-f791-4331-858a-a6176463a101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:37.696270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad2903-f791-4331-858a-a6176463a101 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:37.696960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad2903-f791-4331-858a-a6176463a101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:37.696960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad2903-f791-4331-858a-a6176463a101 admin admin] PATH_INFO: `/v3/projects/037995adc3bf40ff81f75d7686cd2c07/users/7f884cdbb39b473099df8e30dbc68c47/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:37.705233 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3af3e-4295-4f30-b1d7-29570820b94f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:37.713022 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad2903-f791-4331-858a-a6176463a101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=037995adc3bf40ff81f75d7686cd2c07, user_id=7f884cdbb39b473099df8e30dbc68c47, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:37.723573 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad2903-f791-4331-858a-a6176463a101 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:37.776118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 860/1710] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:37 2022] PUT /identity/v3/projects/037995adc3bf40ff81f75d7686cd2c07/users/7f884cdbb39b473099df8e30dbc68c47/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:37.858915 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3d7ac-beb7-497d-a1b0-40af18b6ba18 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:37.859388 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3d7ac-beb7-497d-a1b0-40af18b6ba18 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:37.859839 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3d7ac-beb7-497d-a1b0-40af18b6ba18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:37.873925 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa352e1-9027-4567-b6f5-3915039009bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:37.873925 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa352e1-9027-4567-b6f5-3915039009bc service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:37.873925 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa352e1-9027-4567-b6f5-3915039009bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:37.873925 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa352e1-9027-4567-b6f5-3915039009bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:37.905238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8ac3d7ac-beb7-497d-a1b0-40af18b6ba18 None None] MFA Rules not processed for user `a3ea40ad7d7546449f60539341abc545`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:37.907223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8ac3d7ac-beb7-497d-a1b0-40af18b6ba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:38.045824 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa352e1-9027-4567-b6f5-3915039009bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:38.050478 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa352e1-9027-4567-b6f5-3915039009bc service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:38.147523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:38.149933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 851/1711] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:37 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:38.256345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 861/1712] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:38.283975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa352e1-9027-4567-b6f5-3915039009bc service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:38.285701 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-bfa352e1-9027-4567-b6f5-3915039009bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:38.413366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3d7ac-beb7-497d-a1b0-40af18b6ba18 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:38.603412 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3d7ac-beb7-497d-a1b0-40af18b6ba18 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:38.607783 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa352e1-9027-4567-b6f5-3915039009bc service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:38.614353 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e4532-84b9-4dea-bf7a-0e3df88ec5d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:38.615032 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e4532-84b9-4dea-bf7a-0e3df88ec5d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:38.615315 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e4532-84b9-4dea-bf7a-0e3df88ec5d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:38.615592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e4532-84b9-4dea-bf7a-0e3df88ec5d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:38.709453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:38.793003 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e4532-84b9-4dea-bf7a-0e3df88ec5d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:38.795810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e4532-84b9-4dea-bf7a-0e3df88ec5d3 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:38.809988 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ae588-e81c-4fb6-a0cb-df4e3a5e642d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:38.810673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ae588-e81c-4fb6-a0cb-df4e3a5e642d service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:38.810940 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ae588-e81c-4fb6-a0cb-df4e3a5e642d service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:38.811214 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ae588-e81c-4fb6-a0cb-df4e3a5e642d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:38.848482 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 862/1713] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:38 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:34:38.860679 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ae588-e81c-4fb6-a0cb-df4e3a5e642d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:38.862706 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ae588-e81c-4fb6-a0cb-df4e3a5e642d service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:38.895310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 852/1714] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:39.055529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:40.252946 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3044f63-40dd-4143-a0f0-2a534d1a9e7a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:40.253689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3044f63-40dd-4143-a0f0-2a534d1a9e7a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:40.253689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3044f63-40dd-4143-a0f0-2a534d1a9e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:40.312839 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a3044f63-40dd-4143-a0f0-2a534d1a9e7a None None] MFA Rules not processed for user `7f884cdbb39b473099df8e30dbc68c47`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:40.314081 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a3044f63-40dd-4143-a0f0-2a534d1a9e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:40.418300 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 863/1715] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:41.365860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ae588-e81c-4fb6-a0cb-df4e3a5e642d service nova] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:41.376505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ae588-e81c-4fb6-a0cb-df4e3a5e642d service nova] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:41.381019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7ff48-0adc-4e94-aa52-a725838b485f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:41.382004 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7ff48-0adc-4e94-aa52-a725838b485f service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:41.382597 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7ff48-0adc-4e94-aa52-a725838b485f service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:41.383092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7ff48-0adc-4e94-aa52-a725838b485f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:41.386184 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-05b7ff48-0adc-4e94-aa52-a725838b485f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:41.551649 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7ff48-0adc-4e94-aa52-a725838b485f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:41.565289 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7ff48-0adc-4e94-aa52-a725838b485f service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:41.601460 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 853/1716] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:42.095341 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48f591-453f-440c-b5f2-c3f90f601b26 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:42.095993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48f591-453f-440c-b5f2-c3f90f601b26 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:42.095993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48f591-453f-440c-b5f2-c3f90f601b26 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:42.097309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 864/1717] 10.222.0.52 () {54 vars in 921 bytes} [Fri Jun 17 07:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:34:42.119073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dad5b9-e1f3-4d75-b8cb-7b5702f607bb None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:42.119893 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dad5b9-e1f3-4d75-b8cb-7b5702f607bb None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:42.120173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dad5b9-e1f3-4d75-b8cb-7b5702f607bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:42.157538 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-29dad5b9-e1f3-4d75-b8cb-7b5702f607bb None None] MFA Rules not processed for user `71adc8b93e5c41929b928002e004df6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:42.158932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-29dad5b9-e1f3-4d75-b8cb-7b5702f607bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:42.338053 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 854/1718] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Jun 17 07:34:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:42.365618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48f591-453f-440c-b5f2-c3f90f601b26 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:42.367733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3e48f591-453f-440c-b5f2-c3f90f601b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:42.415155 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48f591-453f-440c-b5f2-c3f90f601b26 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:42.421243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fc8c6-b669-4aee-94f2-11d0f1711e32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adc8b93e5c41929b928002e004df6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:42.421951 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fc8c6-b669-4aee-94f2-11d0f1711e32 service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:42.422379 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fc8c6-b669-4aee-94f2-11d0f1711e32 service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:42.422659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fc8c6-b669-4aee-94f2-11d0f1711e32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:42.444259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48fc8c6-b669-4aee-94f2-11d0f1711e32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:42.446411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48fc8c6-b669-4aee-94f2-11d0f1711e32 service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:42.469043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 865/1719] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:43.758192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dad5b9-e1f3-4d75-b8cb-7b5702f607bb None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:43.778287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:43.937970 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dad5b9-e1f3-4d75-b8cb-7b5702f607bb None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:43.945153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d71782-30cd-473a-b15c-6a84a4a3fa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:43.948505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d71782-30cd-473a-b15c-6a84a4a3fa69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:43.949001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d71782-30cd-473a-b15c-6a84a4a3fa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:43.949938 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d71782-30cd-473a-b15c-6a84a4a3fa69 admin admin] PATH_INFO: `/v3/users/4078362ea48346cea1892dac5473e2e9` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:43.951734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d71782-30cd-473a-b15c-6a84a4a3fa69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4078362ea48346cea1892dac5473e2e9)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:43.954249 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d71782-30cd-473a-b15c-6a84a4a3fa69 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:43.967345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fc8c6-b669-4aee-94f2-11d0f1711e32 service placement] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:43.969543 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f48fc8c6-b669-4aee-94f2-11d0f1711e32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:43.998319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fc8c6-b669-4aee-94f2-11d0f1711e32 service placement] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:44.004808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902efd2-38e5-4c4b-b1cd-c64044d8b0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:44.005880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902efd2-38e5-4c4b-b1cd-c64044d8b0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:44.006412 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902efd2-38e5-4c4b-b1cd-c64044d8b0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:44.006767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902efd2-38e5-4c4b-b1cd-c64044d8b0fe admin admin] PATH_INFO: `/v3/users/99687792e2714e4b8db1b6e699901dfe` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:44.008197 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902efd2-38e5-4c4b-b1cd-c64044d8b0fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=99687792e2714e4b8db1b6e699901dfe)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:44.010570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902efd2-38e5-4c4b-b1cd-c64044d8b0fe admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:44.248926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4902efd2-38e5-4c4b-b1cd-c64044d8b0fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99687792e2714e4b8db1b6e699901dfe'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:44.258632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c8d71782-30cd-473a-b15c-6a84a4a3fa69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4078362ea48346cea1892dac5473e2e9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:44.276855 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c8d71782-30cd-473a-b15c-6a84a4a3fa69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4078362ea48346cea1892dac5473e2e9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:44.278064 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c8d71782-30cd-473a-b15c-6a84a4a3fa69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4078362ea48346cea1892dac5473e2e9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:44.278943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c8d71782-30cd-473a-b15c-6a84a4a3fa69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4078362ea48346cea1892dac5473e2e9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:44.289291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c8d71782-30cd-473a-b15c-6a84a4a3fa69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4078362ea48346cea1892dac5473e2e9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:44.290453 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4902efd2-38e5-4c4b-b1cd-c64044d8b0fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99687792e2714e4b8db1b6e699901dfe'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:44.313670 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4902efd2-38e5-4c4b-b1cd-c64044d8b0fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99687792e2714e4b8db1b6e699901dfe'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:44.313670 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4902efd2-38e5-4c4b-b1cd-c64044d8b0fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99687792e2714e4b8db1b6e699901dfe'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:44.313670 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4902efd2-38e5-4c4b-b1cd-c64044d8b0fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99687792e2714e4b8db1b6e699901dfe'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:44.405358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 855/1720] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:34:43 2022] DELETE /identity/v3/users/4078362ea48346cea1892dac5473e2e9 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:44.405358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe33cb8-63ec-4d26-bf6a-a3aaec1c19a4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:44.405358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe33cb8-63ec-4d26-bf6a-a3aaec1c19a4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:44.405358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe33cb8-63ec-4d26-bf6a-a3aaec1c19a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:44.458966 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-afe33cb8-63ec-4d26-bf6a-a3aaec1c19a4 None None] MFA Rules not processed for user `a3ea40ad7d7546449f60539341abc545`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:44.460207 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-afe33cb8-63ec-4d26-bf6a-a3aaec1c19a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:44.469309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 866/1721] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:34:43 2022] DELETE /identity/v3/users/99687792e2714e4b8db1b6e699901dfe => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:44.473475 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b8d86-5cd4-48a6-9be5-4d665a997f70 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:44.473943 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b8d86-5cd4-48a6-9be5-4d665a997f70 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:44.474328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b8d86-5cd4-48a6-9be5-4d665a997f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:44.542729 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-894b8d86-5cd4-48a6-9be5-4d665a997f70 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:44.547033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-894b8d86-5cd4-48a6-9be5-4d665a997f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:44.567349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:44.604463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 856/1722] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:44.639445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 867/1723] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:34:44.661838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6732bff-63d8-49cf-8495-e0c312dc6c52 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:44.662095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6732bff-63d8-49cf-8495-e0c312dc6c52 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:44.662382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6732bff-63d8-49cf-8495-e0c312dc6c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:44.694652 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b8d86-5cd4-48a6-9be5-4d665a997f70 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:44.696119 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-894b8d86-5cd4-48a6-9be5-4d665a997f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:44.698891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c6732bff-63d8-49cf-8495-e0c312dc6c52 None None] MFA Rules not processed for user `9144d74a341b4e08ae353b384fe1186e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:44.700266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c6732bff-63d8-49cf-8495-e0c312dc6c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:44.771501 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:44.828776 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 857/1724] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Jun 17 07:34:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:44.831706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b8d86-5cd4-48a6-9be5-4d665a997f70 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:44.835957 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72ee6c-017e-4228-b8d7-015c669416e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:44.837109 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72ee6c-017e-4228-b8d7-015c669416e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:44.837948 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72ee6c-017e-4228-b8d7-015c669416e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:44.838383 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72ee6c-017e-4228-b8d7-015c669416e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:44.851435 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72ee6c-017e-4228-b8d7-015c669416e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:44.853054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72ee6c-017e-4228-b8d7-015c669416e1 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:44.886278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 868/1725] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:34:45.336590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6732bff-63d8-49cf-8495-e0c312dc6c52 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:45.340847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c6732bff-63d8-49cf-8495-e0c312dc6c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:45.464280 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6732bff-63d8-49cf-8495-e0c312dc6c52 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:45.471394 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488719c-57c2-4e27-87f6-fdf5106eec66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a18b07c033224d2085773936dad33eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:45.472260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488719c-57c2-4e27-87f6-fdf5106eec66 service swift] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:45.472605 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488719c-57c2-4e27-87f6-fdf5106eec66 service swift] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:45.472871 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488719c-57c2-4e27-87f6-fdf5106eec66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:45.485575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488719c-57c2-4e27-87f6-fdf5106eec66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:45.485921 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488719c-57c2-4e27-87f6-fdf5106eec66 service swift] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:45.495530 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 858/1726] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Jun 17 07:34:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:34:45.614790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72ee6c-017e-4228-b8d7-015c669416e1 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:45.617034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bc72ee6c-017e-4228-b8d7-015c669416e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:45.648201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72ee6c-017e-4228-b8d7-015c669416e1 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:45.659321 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:45.660724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:45.668515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:45.668515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e admin admin] PATH_INFO: `/v3/projects/add6af2bac2e46059305d6de6e1c379f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:45.668515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=add6af2bac2e46059305d6de6e1c379f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:45.668515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:45.855730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'add6af2bac2e46059305d6de6e1c379f', 'request_id': 'req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:45.926710 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488719c-57c2-4e27-87f6-fdf5106eec66 service swift] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:45.929912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4488719c-57c2-4e27-87f6-fdf5106eec66 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:45.940565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'add6af2bac2e46059305d6de6e1c379f', 'request_id': 'req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:45.948256 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'add6af2bac2e46059305d6de6e1c379f', 'request_id': 'req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:45.963248 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e admin admin] The token cache is being invalidate because project add6af2bac2e46059305d6de6e1c379f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:34:45.963783 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:45.964663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:45.966568 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 869/1727] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:34:45 2022] DELETE /identity/v3/projects/add6af2bac2e46059305d6de6e1c379f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:45.971270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:45.978977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:45.983664 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488719c-57c2-4e27-87f6-fdf5106eec66 service swift] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:46.050034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:46.065746 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59887e5d-4acb-4be2-b1fc-9fa53a470c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:46.066000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e3c6c-38e1-4afd-bde3-7e377708ff4e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:46.066768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59887e5d-4acb-4be2-b1fc-9fa53a470c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:46.067055 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59887e5d-4acb-4be2-b1fc-9fa53a470c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:46.067330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59887e5d-4acb-4be2-b1fc-9fa53a470c99 admin admin] PATH_INFO: `/v3/projects/48a9b5852b69438eac339b063882d08c` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:46.068594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59887e5d-4acb-4be2-b1fc-9fa53a470c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a9b5852b69438eac339b063882d08c)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:46.070898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59887e5d-4acb-4be2-b1fc-9fa53a470c99 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:46.074297 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a85c0-807e-455a-9bb9-89e0c4840ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:46.075193 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a85c0-807e-455a-9bb9-89e0c4840ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:46.075841 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a85c0-807e-455a-9bb9-89e0c4840ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:46.076262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a85c0-807e-455a-9bb9-89e0c4840ec5 admin admin] PATH_INFO: `/v3/users/7f884cdbb39b473099df8e30dbc68c47` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:46.078205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a85c0-807e-455a-9bb9-89e0c4840ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f884cdbb39b473099df8e30dbc68c47)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:46.080154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a85c0-807e-455a-9bb9-89e0c4840ec5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:46.303665 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-59887e5d-4acb-4be2-b1fc-9fa53a470c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a9b5852b69438eac339b063882d08c', 'request_id': 'req-59887e5d-4acb-4be2-b1fc-9fa53a470c99'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:46.303868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-af2a85c0-807e-455a-9bb9-89e0c4840ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f884cdbb39b473099df8e30dbc68c47'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:46.310617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-59887e5d-4acb-4be2-b1fc-9fa53a470c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a9b5852b69438eac339b063882d08c', 'request_id': 'req-59887e5d-4acb-4be2-b1fc-9fa53a470c99'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:46.316018 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-af2a85c0-807e-455a-9bb9-89e0c4840ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f884cdbb39b473099df8e30dbc68c47'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:46.324051 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-af2a85c0-807e-455a-9bb9-89e0c4840ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f884cdbb39b473099df8e30dbc68c47'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:46.324874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-af2a85c0-807e-455a-9bb9-89e0c4840ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f884cdbb39b473099df8e30dbc68c47'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:46.325536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-af2a85c0-807e-455a-9bb9-89e0c4840ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f884cdbb39b473099df8e30dbc68c47'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:46.402273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-59887e5d-4acb-4be2-b1fc-9fa53a470c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a9b5852b69438eac339b063882d08c', 'request_id': 'req-59887e5d-4acb-4be2-b1fc-9fa53a470c99'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:46.414308 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-59887e5d-4acb-4be2-b1fc-9fa53a470c99 admin admin] The token cache is being invalidate because project 48a9b5852b69438eac339b063882d08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:34:46.414602 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-59887e5d-4acb-4be2-b1fc-9fa53a470c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:46.415767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-59887e5d-4acb-4be2-b1fc-9fa53a470c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:46.417613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 859/1728] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:34:45 2022] DELETE /identity/v3/projects/48a9b5852b69438eac339b063882d08c => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:46.422288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd87279-4a52-47c0-80a3-797fc66a69f6 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:46.422573 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd87279-4a52-47c0-80a3-797fc66a69f6 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:46.422852 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd87279-4a52-47c0-80a3-797fc66a69f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:46.428979 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:46.441999 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8cd87279-4a52-47c0-80a3-797fc66a69f6 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:46.443207 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8cd87279-4a52-47c0-80a3-797fc66a69f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:46.505694 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 860/1729] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:34:46.514625 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1499022-b010-4bb3-a24f-ef6af8532fef None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:46.514919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1499022-b010-4bb3-a24f-ef6af8532fef None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:46.515137 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1499022-b010-4bb3-a24f-ef6af8532fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:46.516555 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 870/1730] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:34:45 2022] DELETE /identity/v3/users/7f884cdbb39b473099df8e30dbc68c47 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:34:46.540047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a1499022-b010-4bb3-a24f-ef6af8532fef None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:46.542194 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a1499022-b010-4bb3-a24f-ef6af8532fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:46.648414 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 861/1731] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:34:46.650278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a85c0-807e-455a-9bb9-89e0c4840ec5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:46.653646 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-af2a85c0-807e-455a-9bb9-89e0c4840ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:46.677104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a85c0-807e-455a-9bb9-89e0c4840ec5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:46.683197 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db63c60-1e18-4fb9-916d-e0abbe72a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:46.683884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db63c60-1e18-4fb9-916d-e0abbe72a8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:46.684165 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db63c60-1e18-4fb9-916d-e0abbe72a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:46.684444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db63c60-1e18-4fb9-916d-e0abbe72a8a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:46.685186 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db63c60-1e18-4fb9-916d-e0abbe72a8a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:34:46.685519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db63c60-1e18-4fb9-916d-e0abbe72a8a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:46.694946 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db63c60-1e18-4fb9-916d-e0abbe72a8a7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:46.708582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 871/1732] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:34:46.714706 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1499022-b010-4bb3-a24f-ef6af8532fef None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:46.732279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1499022-b010-4bb3-a24f-ef6af8532fef None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:46.736413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4ad05-8432-46d0-bee4-f6404f05b5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:46.737163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4ad05-8432-46d0-bee4-f6404f05b5bf admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:46.737552 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4ad05-8432-46d0-bee4-f6404f05b5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:46.737897 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4ad05-8432-46d0-bee4-f6404f05b5bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:46.738680 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4ad05-8432-46d0-bee4-f6404f05b5bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:46.740609 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4ad05-8432-46d0-bee4-f6404f05b5bf admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:46.829515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db63c60-1e18-4fb9-916d-e0abbe72a8a7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:46.831282 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4db63c60-1e18-4fb9-916d-e0abbe72a8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:46.847076 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db63c60-1e18-4fb9-916d-e0abbe72a8a7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:46.851806 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df110e5b-732a-47b4-8c3a-f34dbf992d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:46.852753 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df110e5b-732a-47b4-8c3a-f34dbf992d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:46.853589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df110e5b-732a-47b4-8c3a-f34dbf992d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:46.856279 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df110e5b-732a-47b4-8c3a-f34dbf992d48 admin admin] PATH_INFO: `/v3/projects/037995adc3bf40ff81f75d7686cd2c07` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:46.856279 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df110e5b-732a-47b4-8c3a-f34dbf992d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=037995adc3bf40ff81f75d7686cd2c07)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:46.857172 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df110e5b-732a-47b4-8c3a-f34dbf992d48 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:46.882278 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 862/1733] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:46 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:46.886590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4ad05-8432-46d0-bee4-f6404f05b5bf admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:46.950566 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4ad05-8432-46d0-bee4-f6404f05b5bf admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:46.955492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb491c-de84-4676-9db3-c86cdfd2121a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:46.956122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb491c-de84-4676-9db3-c86cdfd2121a admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:46.956413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb491c-de84-4676-9db3-c86cdfd2121a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:46.956691 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb491c-de84-4676-9db3-c86cdfd2121a admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:46.957421 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb491c-de84-4676-9db3-c86cdfd2121a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:46.959473 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb491c-de84-4676-9db3-c86cdfd2121a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:46.994920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-df110e5b-732a-47b4-8c3a-f34dbf992d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '037995adc3bf40ff81f75d7686cd2c07', 'request_id': 'req-df110e5b-732a-47b4-8c3a-f34dbf992d48'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:47.054639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 863/1734] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:46 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:47.056640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb491c-de84-4676-9db3-c86cdfd2121a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:47.066654 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb491c-de84-4676-9db3-c86cdfd2121a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:47.067749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-df110e5b-732a-47b4-8c3a-f34dbf992d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '037995adc3bf40ff81f75d7686cd2c07', 'request_id': 'req-df110e5b-732a-47b4-8c3a-f34dbf992d48'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:47.075482 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-df110e5b-732a-47b4-8c3a-f34dbf992d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '037995adc3bf40ff81f75d7686cd2c07', 'request_id': 'req-df110e5b-732a-47b4-8c3a-f34dbf992d48'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:47.085993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-df110e5b-732a-47b4-8c3a-f34dbf992d48 admin admin] The token cache is being invalidate because project 037995adc3bf40ff81f75d7686cd2c07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:34:47.086278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-df110e5b-732a-47b4-8c3a-f34dbf992d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:47.087108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-df110e5b-732a-47b4-8c3a-f34dbf992d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:47.088908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 872/1735] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:34:46 2022] DELETE /identity/v3/projects/037995adc3bf40ff81f75d7686cd2c07 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:47.094743 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81992bff-4a19-4454-913c-745e7a7adb8c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:47.095029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81992bff-4a19-4454-913c-745e7a7adb8c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:47.095309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81992bff-4a19-4454-913c-745e7a7adb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:47.116036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-81992bff-4a19-4454-913c-745e7a7adb8c None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:47.117699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-81992bff-4a19-4454-913c-745e7a7adb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:47.138684 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ba724-8bb8-4722-901b-6dc22ada934e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:47.139554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ba724-8bb8-4722-901b-6dc22ada934e admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:47.139630 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ba724-8bb8-4722-901b-6dc22ada934e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:47.139888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ba724-8bb8-4722-901b-6dc22ada934e admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:47.140777 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ba724-8bb8-4722-901b-6dc22ada934e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:47.142584 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ba724-8bb8-4722-901b-6dc22ada934e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:47.154553 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 864/1736] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:47.162877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ba724-8bb8-4722-901b-6dc22ada934e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:47.164968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e26ba724-8bb8-4722-901b-6dc22ada934e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:47.188507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ba724-8bb8-4722-901b-6dc22ada934e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:47.195772 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6df70d-3dc6-4cec-a208-bb37d460f297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:47.196989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6df70d-3dc6-4cec-a208-bb37d460f297 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:47.197525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6df70d-3dc6-4cec-a208-bb37d460f297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:47.198078 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6df70d-3dc6-4cec-a208-bb37d460f297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:47.199593 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6df70d-3dc6-4cec-a208-bb37d460f297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:47.201513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6df70d-3dc6-4cec-a208-bb37d460f297 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:47.217233 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 865/1737] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:47.221996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6df70d-3dc6-4cec-a208-bb37d460f297 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:47.254482 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 873/1738] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:47.255132 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6df70d-3dc6-4cec-a208-bb37d460f297 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:47.256408 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb04fe2-c415-428e-84ad-c30ff69656b2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:47.256861 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb04fe2-c415-428e-84ad-c30ff69656b2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:47.260335 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb04fe2-c415-428e-84ad-c30ff69656b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:47.269772 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43913abf-08cd-4289-a44f-3937b0129d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:47.272219 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43913abf-08cd-4289-a44f-3937b0129d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:47.272666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43913abf-08cd-4289-a44f-3937b0129d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:47.273581 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43913abf-08cd-4289-a44f-3937b0129d45 admin admin] PATH_INFO: `/v3/projects/2789a688bef94014aa5fed274d2f34fa/users/3a2216c1c0c845e293049006db9b207e/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:47.298364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43913abf-08cd-4289-a44f-3937b0129d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2789a688bef94014aa5fed274d2f34fa, user_id=3a2216c1c0c845e293049006db9b207e, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:47.301488 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43913abf-08cd-4289-a44f-3937b0129d45 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:47.315176 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9cb04fe2-c415-428e-84ad-c30ff69656b2 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:47.316642 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9cb04fe2-c415-428e-84ad-c30ff69656b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:47.333559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 874/1739] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:47.341518 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb04fe2-c415-428e-84ad-c30ff69656b2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:47.355714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb04fe2-c415-428e-84ad-c30ff69656b2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:47.362962 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fc0da-c0ef-4b0b-beee-938a9881e1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:47.363767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fc0da-c0ef-4b0b-beee-938a9881e1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:47.364116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fc0da-c0ef-4b0b-beee-938a9881e1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:47.364462 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fc0da-c0ef-4b0b-beee-938a9881e1a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:47.365278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fc0da-c0ef-4b0b-beee-938a9881e1a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:34:47.365695 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fc0da-c0ef-4b0b-beee-938a9881e1a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:47.367434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fc0da-c0ef-4b0b-beee-938a9881e1a7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:47.387434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 875/1740] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:34:47.395506 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fc0da-c0ef-4b0b-beee-938a9881e1a7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:47.404093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 866/1741] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:47 2022] PUT /identity/v3/projects/2789a688bef94014aa5fed274d2f34fa/users/3a2216c1c0c845e293049006db9b207e/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:47.412609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fc0da-c0ef-4b0b-beee-938a9881e1a7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:47.423339 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1e688-6d44-4682-a751-c212e703aa41 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:47.424254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1e688-6d44-4682-a751-c212e703aa41 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:47.424671 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1e688-6d44-4682-a751-c212e703aa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:47.495386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-ecc1e688-6d44-4682-a751-c212e703aa41 None None] MFA Rules not processed for user `3a2216c1c0c845e293049006db9b207e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:47.497292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ecc1e688-6d44-4682-a751-c212e703aa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:47.530895 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9e707-0805-4d64-95c4-c363cefa2aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:47.531922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9e707-0805-4d64-95c4-c363cefa2aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:47.533371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9e707-0805-4d64-95c4-c363cefa2aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:47.533814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9e707-0805-4d64-95c4-c363cefa2aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:47.534526 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9e707-0805-4d64-95c4-c363cefa2aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:47.536669 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9e707-0805-4d64-95c4-c363cefa2aa0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:47.642570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 876/1742] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:47 2022] POST /identity/v3/projects => generated 365 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:47.644328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9e707-0805-4d64-95c4-c363cefa2aa0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:47.689665 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:47.733119 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 867/1743] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:47.748165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:47.752015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1e688-6d44-4682-a751-c212e703aa41 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:47.752583 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9e707-0805-4d64-95c4-c363cefa2aa0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:47.760173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc359e2-a63e-47e6-8b41-921a78be8831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:47.760952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc359e2-a63e-47e6-8b41-921a78be8831 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:47.761239 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc359e2-a63e-47e6-8b41-921a78be8831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:47.761617 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc359e2-a63e-47e6-8b41-921a78be8831 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:47.762578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc359e2-a63e-47e6-8b41-921a78be8831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:47.765294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc359e2-a63e-47e6-8b41-921a78be8831 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:47.767578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1e688-6d44-4682-a751-c212e703aa41 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:47.773782 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66c752-22bc-41a0-9df3-32bd078d5bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:47.775255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66c752-22bc-41a0-9df3-32bd078d5bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:47.775618 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66c752-22bc-41a0-9df3-32bd078d5bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:47.775955 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66c752-22bc-41a0-9df3-32bd078d5bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:47.776809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66c752-22bc-41a0-9df3-32bd078d5bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:47.779008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66c752-22bc-41a0-9df3-32bd078d5bb3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:47.880361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 877/1744] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:47 2022] POST /identity/v3/users => generated 283 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:34:47.881844 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc359e2-a63e-47e6-8b41-921a78be8831 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:47.894240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 868/1745] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:47 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:47.898303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66c752-22bc-41a0-9df3-32bd078d5bb3 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:47.900704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc359e2-a63e-47e6-8b41-921a78be8831 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:47.991144 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66c752-22bc-41a0-9df3-32bd078d5bb3 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:47.996142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acde56b-487e-4f4f-8558-c19cd67e41b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:47.996818 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acde56b-487e-4f4f-8558-c19cd67e41b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:47.997095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acde56b-487e-4f4f-8558-c19cd67e41b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:47.997391 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acde56b-487e-4f4f-8558-c19cd67e41b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:47.998075 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acde56b-487e-4f4f-8558-c19cd67e41b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:48.000192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be53f1f-6bc6-479f-8a84-04e2d0466a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:48.000327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acde56b-487e-4f4f-8558-c19cd67e41b2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:48.000937 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be53f1f-6bc6-479f-8a84-04e2d0466a5c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:48.001238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be53f1f-6bc6-479f-8a84-04e2d0466a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:48.001547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be53f1f-6bc6-479f-8a84-04e2d0466a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:48.002282 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be53f1f-6bc6-479f-8a84-04e2d0466a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:48.004322 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be53f1f-6bc6-479f-8a84-04e2d0466a5c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:48.015522 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 878/1746] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:48.080847 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be53f1f-6bc6-479f-8a84-04e2d0466a5c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:48.092313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be53f1f-6bc6-479f-8a84-04e2d0466a5c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:48.097436 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70720a9-a9b4-4359-899e-0114f3b7b3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:48.098127 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70720a9-a9b4-4359-899e-0114f3b7b3cf admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:48.098413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70720a9-a9b4-4359-899e-0114f3b7b3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:48.098688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70720a9-a9b4-4359-899e-0114f3b7b3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:48.099416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70720a9-a9b4-4359-899e-0114f3b7b3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:48.101038 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70720a9-a9b4-4359-899e-0114f3b7b3cf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:48.120303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 879/1747] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:48.126902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70720a9-a9b4-4359-899e-0114f3b7b3cf admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:48.140031 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70720a9-a9b4-4359-899e-0114f3b7b3cf admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:48.146499 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3012e5-631b-4ee1-a919-148fc1b98ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:48.152130 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3012e5-631b-4ee1-a919-148fc1b98ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:48.152425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3012e5-631b-4ee1-a919-148fc1b98ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:48.152708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3012e5-631b-4ee1-a919-148fc1b98ab5 admin admin] PATH_INFO: `/v3/projects/09344e51a7b04687a50fe866c20d3517/users/73cde8b52bd64217a556446efaedebae/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:48.173769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3012e5-631b-4ee1-a919-148fc1b98ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09344e51a7b04687a50fe866c20d3517, user_id=73cde8b52bd64217a556446efaedebae, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:48.179052 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3012e5-631b-4ee1-a919-148fc1b98ab5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:48.439860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 869/1748] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:47 2022] POST /identity/v3/users => generated 293 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:48.442972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acde56b-487e-4f4f-8558-c19cd67e41b2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:48.455596 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acde56b-487e-4f4f-8558-c19cd67e41b2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:48.473642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8eac85-8e54-49e0-b51f-d91a1c642ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:48.474326 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eac85-8e54-49e0-b51f-d91a1c642ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:48.474651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eac85-8e54-49e0-b51f-d91a1c642ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:48.475044 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eac85-8e54-49e0-b51f-d91a1c642ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:48.475781 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8eac85-8e54-49e0-b51f-d91a1c642ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:48.477418 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8eac85-8e54-49e0-b51f-d91a1c642ca6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:48.478481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 880/1749] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:48 2022] PUT /identity/v3/projects/09344e51a7b04687a50fe866c20d3517/users/73cde8b52bd64217a556446efaedebae/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:48.488834 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 870/1750] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:34:48.491679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac74f88-9520-4c4c-913b-c49fa20920af None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:48.491679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac74f88-9520-4c4c-913b-c49fa20920af None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:48.491679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac74f88-9520-4c4c-913b-c49fa20920af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:48.495111 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8eac85-8e54-49e0-b51f-d91a1c642ca6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:48.506254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8eac85-8e54-49e0-b51f-d91a1c642ca6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:48.524107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7ac74f88-9520-4c4c-913b-c49fa20920af None None] MFA Rules not processed for user `73cde8b52bd64217a556446efaedebae`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:48.525541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7ac74f88-9520-4c4c-913b-c49fa20920af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:48.575588 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed4aa8-82d0-44bb-b2c7-5c68273005a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:48.576497 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed4aa8-82d0-44bb-b2c7-5c68273005a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:48.576863 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed4aa8-82d0-44bb-b2c7-5c68273005a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:48.577051 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed4aa8-82d0-44bb-b2c7-5c68273005a3 admin admin] PATH_INFO: `/v3/projects/6910b6e72cf846709e1c1e89c5d12590/users/ec33991902764e1ab9e7b3601de234ff/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:48.587164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:48.594261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed4aa8-82d0-44bb-b2c7-5c68273005a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6910b6e72cf846709e1c1e89c5d12590, user_id=ec33991902764e1ab9e7b3601de234ff, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:48.596974 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed4aa8-82d0-44bb-b2c7-5c68273005a3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:48.597543 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 881/1751] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:34:48.602092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac74f88-9520-4c4c-913b-c49fa20920af None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:48.614000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac74f88-9520-4c4c-913b-c49fa20920af None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:48.619277 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d3ebb-b45d-4b10-a4e7-84a55303d07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:48.620049 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d3ebb-b45d-4b10-a4e7-84a55303d07d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:48.620421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d3ebb-b45d-4b10-a4e7-84a55303d07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:48.620720 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d3ebb-b45d-4b10-a4e7-84a55303d07d admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:48.621499 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d3ebb-b45d-4b10-a4e7-84a55303d07d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:48.623568 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d3ebb-b45d-4b10-a4e7-84a55303d07d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:48.762451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 871/1752] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:48 2022] PUT /identity/v3/projects/6910b6e72cf846709e1c1e89c5d12590/users/ec33991902764e1ab9e7b3601de234ff/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:34:48.766296 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed4aa8-82d0-44bb-b2c7-5c68273005a3 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:48.769276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 882/1753] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:48 2022] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:34:48.770163 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d3ebb-b45d-4b10-a4e7-84a55303d07d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:48.838937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed4aa8-82d0-44bb-b2c7-5c68273005a3 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:48.843098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:48.896687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d3ebb-b45d-4b10-a4e7-84a55303d07d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:48.901757 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95723736-12ce-4f6d-b17a-114672be458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:48.902435 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95723736-12ce-4f6d-b17a-114672be458d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:48.902783 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95723736-12ce-4f6d-b17a-114672be458d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:48.903006 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95723736-12ce-4f6d-b17a-114672be458d admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:48.904064 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95723736-12ce-4f6d-b17a-114672be458d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:48.906632 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95723736-12ce-4f6d-b17a-114672be458d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:48.913358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af5ed9-d0c2-4202-8e35-d6ed87a961ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:48.913358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af5ed9-d0c2-4202-8e35-d6ed87a961ba admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:48.913358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af5ed9-d0c2-4202-8e35-d6ed87a961ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:48.913358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af5ed9-d0c2-4202-8e35-d6ed87a961ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:48.913877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af5ed9-d0c2-4202-8e35-d6ed87a961ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:48.915931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af5ed9-d0c2-4202-8e35-d6ed87a961ba admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:48.927965 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 872/1754] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:34:48.932765 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af5ed9-d0c2-4202-8e35-d6ed87a961ba admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:48.943011 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af5ed9-d0c2-4202-8e35-d6ed87a961ba admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:48.945458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:48.951825 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2953484-2505-4f21-9e51-c0834a41d36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:48.952979 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2953484-2505-4f21-9e51-c0834a41d36a admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:48.953255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2953484-2505-4f21-9e51-c0834a41d36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:48.953563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2953484-2505-4f21-9e51-c0834a41d36a admin admin] PATH_INFO: `/v3/projects/6910b6e72cf846709e1c1e89c5d12590/users/ec33991902764e1ab9e7b3601de234ff/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:48.955841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2953484-2505-4f21-9e51-c0834a41d36a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6910b6e72cf846709e1c1e89c5d12590, user_id=ec33991902764e1ab9e7b3601de234ff, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:48.959004 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2953484-2505-4f21-9e51-c0834a41d36a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:48.970828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 873/1755] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:48 2022] PUT /identity/v3/projects/6910b6e72cf846709e1c1e89c5d12590/users/ec33991902764e1ab9e7b3601de234ff/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:34:48.981685 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125c0a3-8bd4-4ed2-94c4-4766e337e159 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:48.981967 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125c0a3-8bd4-4ed2-94c4-4766e337e159 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:48.983034 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125c0a3-8bd4-4ed2-94c4-4766e337e159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:49.011843 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-9125c0a3-8bd4-4ed2-94c4-4766e337e159 None None] MFA Rules not processed for user `ec33991902764e1ab9e7b3601de234ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:49.013089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9125c0a3-8bd4-4ed2-94c4-4766e337e159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:49.037169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 883/1756] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:48 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:49.041827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95723736-12ce-4f6d-b17a-114672be458d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:49.054452 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:49.066965 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95723736-12ce-4f6d-b17a-114672be458d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:49.203695 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 874/1757] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:34:49.217722 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125c0a3-8bd4-4ed2-94c4-4766e337e159 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:49.219683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9125c0a3-8bd4-4ed2-94c4-4766e337e159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:49.232971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3888de8-089a-4a5c-b04a-e7075257d5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:49.233861 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3888de8-089a-4a5c-b04a-e7075257d5aa admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:49.234248 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3888de8-089a-4a5c-b04a-e7075257d5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:49.234626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3888de8-089a-4a5c-b04a-e7075257d5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:49.235865 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3888de8-089a-4a5c-b04a-e7075257d5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:49.237716 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3888de8-089a-4a5c-b04a-e7075257d5aa admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:49.262477 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 884/1758] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:49.263689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3888de8-089a-4a5c-b04a-e7075257d5aa admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:49.274975 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3888de8-089a-4a5c-b04a-e7075257d5aa admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:49.280256 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dff70-208f-4165-b444-266b8323b6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:49.281254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dff70-208f-4165-b444-266b8323b6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:49.281657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dff70-208f-4165-b444-266b8323b6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:49.281994 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dff70-208f-4165-b444-266b8323b6a9 admin admin] PATH_INFO: `/v3/projects/d40e77ad7fef4163a1b66a3e96ba6f27/users/ab735699e0e242ac8d22fe38e10447a7/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:49.300132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dff70-208f-4165-b444-266b8323b6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40e77ad7fef4163a1b66a3e96ba6f27, user_id=ab735699e0e242ac8d22fe38e10447a7, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:49.303070 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dff70-208f-4165-b444-266b8323b6a9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:49.317174 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125c0a3-8bd4-4ed2-94c4-4766e337e159 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:49.321151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a03494-8959-475e-93b4-418d613dbf4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:49.322428 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a03494-8959-475e-93b4-418d613dbf4d service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:49.322709 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a03494-8959-475e-93b4-418d613dbf4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:49.322983 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a03494-8959-475e-93b4-418d613dbf4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:49.336038 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a03494-8959-475e-93b4-418d613dbf4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:49.337166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a03494-8959-475e-93b4-418d613dbf4d service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:49.353649 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 875/1759] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:34:49.429360 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 885/1760] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:49 2022] PUT /identity/v3/projects/d40e77ad7fef4163a1b66a3e96ba6f27/users/ab735699e0e242ac8d22fe38e10447a7/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:49.433842 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a03494-8959-475e-93b4-418d613dbf4d service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:49.451895 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a03494-8959-475e-93b4-418d613dbf4d service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:49.586316 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd2bea-3fea-4d3c-baba-aea21d4b25c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:49.587122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd2bea-3fea-4d3c-baba-aea21d4b25c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:49.591858 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd2bea-3fea-4d3c-baba-aea21d4b25c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:49.592053 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd2bea-3fea-4d3c-baba-aea21d4b25c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:49.592776 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd2bea-3fea-4d3c-baba-aea21d4b25c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:49.594489 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd2bea-3fea-4d3c-baba-aea21d4b25c6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:49.604544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:49.611784 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dff70-208f-4165-b444-266b8323b6a9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:49.621991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 876/1761] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:49.627243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dff70-208f-4165-b444-266b8323b6a9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:49.630507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c44de-7b06-4120-a06f-46be38b4d10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:49.631448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c44de-7b06-4120-a06f-46be38b4d10e admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:49.631737 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c44de-7b06-4120-a06f-46be38b4d10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:49.632013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c44de-7b06-4120-a06f-46be38b4d10e admin admin] PATH_INFO: `/v3/projects/d40e77ad7fef4163a1b66a3e96ba6f27/users/ab735699e0e242ac8d22fe38e10447a7/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:49.634699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c44de-7b06-4120-a06f-46be38b4d10e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40e77ad7fef4163a1b66a3e96ba6f27, user_id=ab735699e0e242ac8d22fe38e10447a7, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:49.637659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c44de-7b06-4120-a06f-46be38b4d10e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:49.666219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 886/1762] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:49 2022] PUT /identity/v3/projects/d40e77ad7fef4163a1b66a3e96ba6f27/users/ab735699e0e242ac8d22fe38e10447a7/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:34:49.681640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce7ed0-1934-4bad-a419-d0e648917fa1 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:49.681640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce7ed0-1934-4bad-a419-d0e648917fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:49.681640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce7ed0-1934-4bad-a419-d0e648917fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:49.713157 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-45ce7ed0-1934-4bad-a419-d0e648917fa1 None None] MFA Rules not processed for user `ab735699e0e242ac8d22fe38e10447a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:49.715347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-45ce7ed0-1934-4bad-a419-d0e648917fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:49.794949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 877/1763] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:49.815650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c44de-7b06-4120-a06f-46be38b4d10e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:49.879330 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c44de-7b06-4120-a06f-46be38b4d10e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:49.883311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa5c16-0c78-4f33-9d7b-fce2cbfeca18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:49.884788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa5c16-0c78-4f33-9d7b-fce2cbfeca18 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:49.885087 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa5c16-0c78-4f33-9d7b-fce2cbfeca18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:49.885498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa5c16-0c78-4f33-9d7b-fce2cbfeca18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:49.895494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa5c16-0c78-4f33-9d7b-fce2cbfeca18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:49.896934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa5c16-0c78-4f33-9d7b-fce2cbfeca18 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:49.908710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 887/1764] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:50.288249 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce7ed0-1934-4bad-a419-d0e648917fa1 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:50.289665 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-45ce7ed0-1934-4bad-a419-d0e648917fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:50.301670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce7ed0-1934-4bad-a419-d0e648917fa1 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:50.305603 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc023164-73a6-463b-8ddd-ba30cc05ba9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:50.306460 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc023164-73a6-463b-8ddd-ba30cc05ba9f service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:50.306747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc023164-73a6-463b-8ddd-ba30cc05ba9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:50.307027 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc023164-73a6-463b-8ddd-ba30cc05ba9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:50.368295 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc023164-73a6-463b-8ddd-ba30cc05ba9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:50.370135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc023164-73a6-463b-8ddd-ba30cc05ba9f service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:50.380575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 878/1765] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:50.951578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa5c16-0c78-4f33-9d7b-fce2cbfeca18 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:51.020035 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:51.034067 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa5c16-0c78-4f33-9d7b-fce2cbfeca18 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:51.042630 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc62c6b-c3fe-4c77-bed1-e645c1ef2242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:51.044188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc62c6b-c3fe-4c77-bed1-e645c1ef2242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:51.044672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc62c6b-c3fe-4c77-bed1-e645c1ef2242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:51.045074 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc62c6b-c3fe-4c77-bed1-e645c1ef2242 admin admin] PATH_INFO: `/v3/users/3a2216c1c0c845e293049006db9b207e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:51.046664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc62c6b-c3fe-4c77-bed1-e645c1ef2242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2216c1c0c845e293049006db9b207e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:51.048630 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc62c6b-c3fe-4c77-bed1-e645c1ef2242 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:51.263646 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fdc62c6b-c3fe-4c77-bed1-e645c1ef2242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2216c1c0c845e293049006db9b207e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:51.277691 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fdc62c6b-c3fe-4c77-bed1-e645c1ef2242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2216c1c0c845e293049006db9b207e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:51.298637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fdc62c6b-c3fe-4c77-bed1-e645c1ef2242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2216c1c0c845e293049006db9b207e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:51.299396 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fdc62c6b-c3fe-4c77-bed1-e645c1ef2242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2216c1c0c845e293049006db9b207e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:51.300019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fdc62c6b-c3fe-4c77-bed1-e645c1ef2242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2216c1c0c845e293049006db9b207e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:51.367627 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 888/1766] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:34:50 2022] DELETE /identity/v3/users/3a2216c1c0c845e293049006db9b207e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:34:51.372950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80633940-6ae1-4e20-9d60-aca5cbd00494 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:51.373545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80633940-6ae1-4e20-9d60-aca5cbd00494 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:51.373545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80633940-6ae1-4e20-9d60-aca5cbd00494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:51.390700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-80633940-6ae1-4e20-9d60-aca5cbd00494 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:51.391912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-80633940-6ae1-4e20-9d60-aca5cbd00494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:51.449604 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 879/1767] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:51.459464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc62c6b-c3fe-4c77-bed1-e645c1ef2242 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:51.460907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fdc62c6b-c3fe-4c77-bed1-e645c1ef2242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:51.520572 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc62c6b-c3fe-4c77-bed1-e645c1ef2242 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:51.527153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e70a6-7b4e-438c-9afa-dbcca7fa606b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:51.527883 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e70a6-7b4e-438c-9afa-dbcca7fa606b service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:51.528235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e70a6-7b4e-438c-9afa-dbcca7fa606b service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:51.528580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e70a6-7b4e-438c-9afa-dbcca7fa606b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:51.538246 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e70a6-7b4e-438c-9afa-dbcca7fa606b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:51.539811 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e70a6-7b4e-438c-9afa-dbcca7fa606b service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:51.550464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 889/1768] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:52.032461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80633940-6ae1-4e20-9d60-aca5cbd00494 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:52.037869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-80633940-6ae1-4e20-9d60-aca5cbd00494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:52.069805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80633940-6ae1-4e20-9d60-aca5cbd00494 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:52.076908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aa20f-3df4-48ab-92b1-5317ea1b0534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:52.077836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aa20f-3df4-48ab-92b1-5317ea1b0534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:52.081036 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aa20f-3df4-48ab-92b1-5317ea1b0534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:52.081036 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aa20f-3df4-48ab-92b1-5317ea1b0534 admin admin] PATH_INFO: `/v3/projects/2789a688bef94014aa5fed274d2f34fa` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:52.081036 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15aa20f-3df4-48ab-92b1-5317ea1b0534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2789a688bef94014aa5fed274d2f34fa)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:52.081647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15aa20f-3df4-48ab-92b1-5317ea1b0534 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:52.107771 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:52.218841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c15aa20f-3df4-48ab-92b1-5317ea1b0534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2789a688bef94014aa5fed274d2f34fa', 'request_id': 'req-c15aa20f-3df4-48ab-92b1-5317ea1b0534'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:52.226977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c15aa20f-3df4-48ab-92b1-5317ea1b0534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2789a688bef94014aa5fed274d2f34fa', 'request_id': 'req-c15aa20f-3df4-48ab-92b1-5317ea1b0534'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:52.319084 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c15aa20f-3df4-48ab-92b1-5317ea1b0534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2789a688bef94014aa5fed274d2f34fa', 'request_id': 'req-c15aa20f-3df4-48ab-92b1-5317ea1b0534'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:52.332144 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c15aa20f-3df4-48ab-92b1-5317ea1b0534 admin admin] The token cache is being invalidate because project 2789a688bef94014aa5fed274d2f34fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:34:52.333588 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c15aa20f-3df4-48ab-92b1-5317ea1b0534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:52.333588 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c15aa20f-3df4-48ab-92b1-5317ea1b0534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:52.334718 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 880/1769] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:34:52 2022] DELETE /identity/v3/projects/2789a688bef94014aa5fed274d2f34fa => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:52.338967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e70a6-7b4e-438c-9afa-dbcca7fa606b service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:52.348974 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e70a6-7b4e-438c-9afa-dbcca7fa606b service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:52.409264 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138d155-5998-440f-ad13-1d03b121d1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:52.410487 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138d155-5998-440f-ad13-1d03b121d1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:52.410977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138d155-5998-440f-ad13-1d03b121d1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:52.411419 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138d155-5998-440f-ad13-1d03b121d1f2 admin admin] PATH_INFO: `/v3/users/ec33991902764e1ab9e7b3601de234ff` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:52.413019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138d155-5998-440f-ad13-1d03b121d1f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec33991902764e1ab9e7b3601de234ff)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:52.416082 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138d155-5998-440f-ad13-1d03b121d1f2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:52.432596 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:52.610620 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2138d155-5998-440f-ad13-1d03b121d1f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec33991902764e1ab9e7b3601de234ff'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:52.639492 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2138d155-5998-440f-ad13-1d03b121d1f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec33991902764e1ab9e7b3601de234ff'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:52.647328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2138d155-5998-440f-ad13-1d03b121d1f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec33991902764e1ab9e7b3601de234ff'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:52.648169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2138d155-5998-440f-ad13-1d03b121d1f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec33991902764e1ab9e7b3601de234ff'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:52.658944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2138d155-5998-440f-ad13-1d03b121d1f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec33991902764e1ab9e7b3601de234ff'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:52.785293 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 890/1770] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:34:52 2022] DELETE /identity/v3/users/ec33991902764e1ab9e7b3601de234ff => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:53.223476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aa20f-3df4-48ab-92b1-5317ea1b0534 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:53.225091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c15aa20f-3df4-48ab-92b1-5317ea1b0534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:53.252955 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aa20f-3df4-48ab-92b1-5317ea1b0534 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:53.355207 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceafc4b-0ccb-4ef8-b0c5-2f34f33e4af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:53.356086 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceafc4b-0ccb-4ef8-b0c5-2f34f33e4af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:53.356370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceafc4b-0ccb-4ef8-b0c5-2f34f33e4af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:53.356691 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceafc4b-0ccb-4ef8-b0c5-2f34f33e4af7 admin admin] PATH_INFO: `/v3/projects/6910b6e72cf846709e1c1e89c5d12590` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:53.357928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceafc4b-0ccb-4ef8-b0c5-2f34f33e4af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6910b6e72cf846709e1c1e89c5d12590)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:53.359906 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceafc4b-0ccb-4ef8-b0c5-2f34f33e4af7 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:53.481032 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-4ceafc4b-0ccb-4ef8-b0c5-2f34f33e4af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6910b6e72cf846709e1c1e89c5d12590', 'request_id': 'req-4ceafc4b-0ccb-4ef8-b0c5-2f34f33e4af7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:53.487365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-4ceafc4b-0ccb-4ef8-b0c5-2f34f33e4af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6910b6e72cf846709e1c1e89c5d12590', 'request_id': 'req-4ceafc4b-0ccb-4ef8-b0c5-2f34f33e4af7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:53.553356 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-4ceafc4b-0ccb-4ef8-b0c5-2f34f33e4af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6910b6e72cf846709e1c1e89c5d12590', 'request_id': 'req-4ceafc4b-0ccb-4ef8-b0c5-2f34f33e4af7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:53.565184 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-4ceafc4b-0ccb-4ef8-b0c5-2f34f33e4af7 admin admin] The token cache is being invalidate because project 6910b6e72cf846709e1c1e89c5d12590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:34:53.565499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-4ceafc4b-0ccb-4ef8-b0c5-2f34f33e4af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:53.566133 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-4ceafc4b-0ccb-4ef8-b0c5-2f34f33e4af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:53.567703 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 881/1771] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:34:53 2022] DELETE /identity/v3/projects/6910b6e72cf846709e1c1e89c5d12590 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:53.573446 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b7b3b-63de-4fb0-90f8-915cd16f57ce None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:53.573970 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b7b3b-63de-4fb0-90f8-915cd16f57ce None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:53.573970 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b7b3b-63de-4fb0-90f8-915cd16f57ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:53.593173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d17b7b3b-63de-4fb0-90f8-915cd16f57ce None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:53.594458 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d17b7b3b-63de-4fb0-90f8-915cd16f57ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:53.654109 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 891/1772] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:53.663019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751873f-1d49-41d6-9acb-79bfda8b5bdb None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:53.663309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751873f-1d49-41d6-9acb-79bfda8b5bdb None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:53.663588 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751873f-1d49-41d6-9acb-79bfda8b5bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:53.683003 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c751873f-1d49-41d6-9acb-79bfda8b5bdb None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:53.684272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c751873f-1d49-41d6-9acb-79bfda8b5bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:53.692604 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 882/1773] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:53.697792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b7b3b-63de-4fb0-90f8-915cd16f57ce None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:53.707604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b7b3b-63de-4fb0-90f8-915cd16f57ce None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:53.712475 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8335f2-3545-41b3-8bc6-34129774d748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:53.713295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8335f2-3545-41b3-8bc6-34129774d748 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:53.713607 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8335f2-3545-41b3-8bc6-34129774d748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:53.713884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8335f2-3545-41b3-8bc6-34129774d748 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:53.714611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8335f2-3545-41b3-8bc6-34129774d748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:34:53.714922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8335f2-3545-41b3-8bc6-34129774d748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:53.716545 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8335f2-3545-41b3-8bc6-34129774d748 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:53.728493 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 892/1774] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:34:53.732922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751873f-1d49-41d6-9acb-79bfda8b5bdb None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:53.742405 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751873f-1d49-41d6-9acb-79bfda8b5bdb None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:53.748004 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4992622-6219-475c-a277-340e8b19aa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:53.748679 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4992622-6219-475c-a277-340e8b19aa11 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:53.748962 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4992622-6219-475c-a277-340e8b19aa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:53.749537 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4992622-6219-475c-a277-340e8b19aa11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:53.750243 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4992622-6219-475c-a277-340e8b19aa11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:53.752193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4992622-6219-475c-a277-340e8b19aa11 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:53.853703 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 883/1775] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:53 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:53.859091 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8335f2-3545-41b3-8bc6-34129774d748 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:53.870689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8335f2-3545-41b3-8bc6-34129774d748 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:53.931846 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3bb92-e916-465d-89e5-d683c2daaca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:53.932774 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3bb92-e916-465d-89e5-d683c2daaca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:53.933115 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3bb92-e916-465d-89e5-d683c2daaca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:53.933873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3bb92-e916-465d-89e5-d683c2daaca9 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:53.934299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3bb92-e916-465d-89e5-d683c2daaca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:53.936303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3bb92-e916-465d-89e5-d683c2daaca9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:54.053806 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 893/1776] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:53 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:54.058210 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4992622-6219-475c-a277-340e8b19aa11 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:54.065056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:54.069152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4992622-6219-475c-a277-340e8b19aa11 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:54.075107 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc623ecf-0396-42d9-a1c0-57da6724ede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:54.075779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc623ecf-0396-42d9-a1c0-57da6724ede4 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:54.076175 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc623ecf-0396-42d9-a1c0-57da6724ede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:54.076626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc623ecf-0396-42d9-a1c0-57da6724ede4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:54.077390 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc623ecf-0396-42d9-a1c0-57da6724ede4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:54.079053 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc623ecf-0396-42d9-a1c0-57da6724ede4 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:54.096529 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 884/1777] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:54.106130 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3bb92-e916-465d-89e5-d683c2daaca9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:54.117033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3bb92-e916-465d-89e5-d683c2daaca9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:54.122925 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960f720-3d3f-4825-9e79-d747164058a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:54.126277 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960f720-3d3f-4825-9e79-d747164058a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:54.126277 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960f720-3d3f-4825-9e79-d747164058a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:54.126277 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960f720-3d3f-4825-9e79-d747164058a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:54.126277 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960f720-3d3f-4825-9e79-d747164058a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:54.126831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960f720-3d3f-4825-9e79-d747164058a9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:54.129508 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:54.139963 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 894/1778] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:34:54.144138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc623ecf-0396-42d9-a1c0-57da6724ede4 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:54.155599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc623ecf-0396-42d9-a1c0-57da6724ede4 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:54.160388 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de82d5-ecc6-47b1-8cd1-2eac98b7fdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:54.161295 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de82d5-ecc6-47b1-8cd1-2eac98b7fdd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:54.161609 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de82d5-ecc6-47b1-8cd1-2eac98b7fdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:54.161888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de82d5-ecc6-47b1-8cd1-2eac98b7fdd6 admin admin] PATH_INFO: `/v3/projects/7391f3e8709245aeac468bdad5601c05/users/f51249659b9d4f45a3e86610147aa130/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:54.178250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de82d5-ecc6-47b1-8cd1-2eac98b7fdd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7391f3e8709245aeac468bdad5601c05, user_id=f51249659b9d4f45a3e86610147aa130, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:54.181680 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de82d5-ecc6-47b1-8cd1-2eac98b7fdd6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:54.287903 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 885/1779] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:54 2022] PUT /identity/v3/projects/7391f3e8709245aeac468bdad5601c05/users/f51249659b9d4f45a3e86610147aa130/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:34:54.298095 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483782d-66cf-46b7-baae-6bebe12abc31 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:54.298386 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483782d-66cf-46b7-baae-6bebe12abc31 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:54.298663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483782d-66cf-46b7-baae-6bebe12abc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:54.331401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b483782d-66cf-46b7-baae-6bebe12abc31 None None] MFA Rules not processed for user `f51249659b9d4f45a3e86610147aa130`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:54.334139 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b483782d-66cf-46b7-baae-6bebe12abc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:54.410685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 895/1780] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:54.415862 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de82d5-ecc6-47b1-8cd1-2eac98b7fdd6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:54.507476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de82d5-ecc6-47b1-8cd1-2eac98b7fdd6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:54.512878 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1feb545-4394-46be-9793-9b8e20b02b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:54.513586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feb545-4394-46be-9793-9b8e20b02b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:54.513860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feb545-4394-46be-9793-9b8e20b02b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:54.514275 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feb545-4394-46be-9793-9b8e20b02b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:54.514975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1feb545-4394-46be-9793-9b8e20b02b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:54.516894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1feb545-4394-46be-9793-9b8e20b02b7d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:54.608518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 886/1781] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:54 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:54.615114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483782d-66cf-46b7-baae-6bebe12abc31 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:54.627607 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483782d-66cf-46b7-baae-6bebe12abc31 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:54.696680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c69bb-59cd-40ea-b1b4-2460aaf65eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:54.697621 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c69bb-59cd-40ea-b1b4-2460aaf65eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:54.697971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c69bb-59cd-40ea-b1b4-2460aaf65eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:54.701679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c69bb-59cd-40ea-b1b4-2460aaf65eb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:54.701679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c69bb-59cd-40ea-b1b4-2460aaf65eb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:54.701679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c69bb-59cd-40ea-b1b4-2460aaf65eb0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:54.802211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 896/1782] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:54 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:34:54.807251 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1feb545-4394-46be-9793-9b8e20b02b7d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:54.817583 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1feb545-4394-46be-9793-9b8e20b02b7d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:54.822219 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837abe5-5fa4-49ca-8e28-7dd7f3aab47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:54.822877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837abe5-5fa4-49ca-8e28-7dd7f3aab47e admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:54.823163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837abe5-5fa4-49ca-8e28-7dd7f3aab47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:54.823443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837abe5-5fa4-49ca-8e28-7dd7f3aab47e admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:54.824170 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837abe5-5fa4-49ca-8e28-7dd7f3aab47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:54.825817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837abe5-5fa4-49ca-8e28-7dd7f3aab47e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:54.838671 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 887/1783] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:54.850250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c69bb-59cd-40ea-b1b4-2460aaf65eb0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:54.867752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c69bb-59cd-40ea-b1b4-2460aaf65eb0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:54.885778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4029444-0f00-4d77-96bc-41fbb88a3871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:54.886667 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4029444-0f00-4d77-96bc-41fbb88a3871 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:54.886950 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4029444-0f00-4d77-96bc-41fbb88a3871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:54.887227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4029444-0f00-4d77-96bc-41fbb88a3871 admin admin] PATH_INFO: `/v3/projects/50e675b755274ede90487dd81d30abc3/users/926a2386f2d04515817d5c784de81122/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:54.924259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4029444-0f00-4d77-96bc-41fbb88a3871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e675b755274ede90487dd81d30abc3, user_id=926a2386f2d04515817d5c784de81122, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:54.926974 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4029444-0f00-4d77-96bc-41fbb88a3871 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:55.049394 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 897/1784] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:54 2022] PUT /identity/v3/projects/50e675b755274ede90487dd81d30abc3/users/926a2386f2d04515817d5c784de81122/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:55.053452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837abe5-5fa4-49ca-8e28-7dd7f3aab47e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:55.066112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837abe5-5fa4-49ca-8e28-7dd7f3aab47e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:55.211330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50706a7a-807f-4614-9483-a9015f60eaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:55.213544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706a7a-807f-4614-9483-a9015f60eaea admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:55.214629 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706a7a-807f-4614-9483-a9015f60eaea admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:55.215393 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706a7a-807f-4614-9483-a9015f60eaea admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:55.216851 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50706a7a-807f-4614-9483-a9015f60eaea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:55.221245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50706a7a-807f-4614-9483-a9015f60eaea admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:55.247382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 888/1785] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:34:55.248483 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4029444-0f00-4d77-96bc-41fbb88a3871 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:55.272032 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4029444-0f00-4d77-96bc-41fbb88a3871 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:55.280437 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4444fd-a85d-42bb-be8c-928c15288766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:55.281714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4444fd-a85d-42bb-be8c-928c15288766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:55.282139 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4444fd-a85d-42bb-be8c-928c15288766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:55.282556 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4444fd-a85d-42bb-be8c-928c15288766 admin admin] PATH_INFO: `/v3/projects/50e675b755274ede90487dd81d30abc3/users/926a2386f2d04515817d5c784de81122/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:55.285253 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4444fd-a85d-42bb-be8c-928c15288766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e675b755274ede90487dd81d30abc3, user_id=926a2386f2d04515817d5c784de81122, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:55.287954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4444fd-a85d-42bb-be8c-928c15288766 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:55.300354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 898/1786] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:55 2022] PUT /identity/v3/projects/50e675b755274ede90487dd81d30abc3/users/926a2386f2d04515817d5c784de81122/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:55.312566 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfba48e-31eb-4202-ade6-de5e8da11f44 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:55.313253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfba48e-31eb-4202-ade6-de5e8da11f44 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:55.313253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfba48e-31eb-4202-ade6-de5e8da11f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:55.346788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-9dfba48e-31eb-4202-ade6-de5e8da11f44 None None] MFA Rules not processed for user `926a2386f2d04515817d5c784de81122`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:55.348492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9dfba48e-31eb-4202-ade6-de5e8da11f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:55.406625 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:55.479001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 889/1787] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:55.492418 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4444fd-a85d-42bb-be8c-928c15288766 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:55.494640 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9d4444fd-a85d-42bb-be8c-928c15288766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:55.566309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:55.581268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4444fd-a85d-42bb-be8c-928c15288766 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:55.589458 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df37435-cf20-4307-99be-059b11850ef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:55.591132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df37435-cf20-4307-99be-059b11850ef2 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:55.591492 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df37435-cf20-4307-99be-059b11850ef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:55.591775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df37435-cf20-4307-99be-059b11850ef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:55.603950 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df37435-cf20-4307-99be-059b11850ef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:55.605574 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df37435-cf20-4307-99be-059b11850ef2 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:55.632414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 899/1788] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:55.666665 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfba48e-31eb-4202-ade6-de5e8da11f44 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:55.758511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfba48e-31eb-4202-ade6-de5e8da11f44 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:55.770329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72944dc-667a-4a15-b811-1e9b9826afa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:55.771292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72944dc-667a-4a15-b811-1e9b9826afa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:55.771707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72944dc-667a-4a15-b811-1e9b9826afa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:55.772086 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72944dc-667a-4a15-b811-1e9b9826afa9 admin admin] PATH_INFO: `/v3/users/f51249659b9d4f45a3e86610147aa130` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:55.783956 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72944dc-667a-4a15-b811-1e9b9826afa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51249659b9d4f45a3e86610147aa130)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:55.786143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72944dc-667a-4a15-b811-1e9b9826afa9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:56.041374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d72944dc-667a-4a15-b811-1e9b9826afa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51249659b9d4f45a3e86610147aa130'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:56.057078 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d72944dc-667a-4a15-b811-1e9b9826afa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51249659b9d4f45a3e86610147aa130'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:56.065534 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d72944dc-667a-4a15-b811-1e9b9826afa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51249659b9d4f45a3e86610147aa130'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:56.069903 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d72944dc-667a-4a15-b811-1e9b9826afa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51249659b9d4f45a3e86610147aa130'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:56.085140 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d72944dc-667a-4a15-b811-1e9b9826afa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51249659b9d4f45a3e86610147aa130'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:56.181516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 890/1789] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:34:55 2022] DELETE /identity/v3/users/f51249659b9d4f45a3e86610147aa130 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:56.194307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c234edf-109e-44bc-9b73-9f2815358120 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:56.196534 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c234edf-109e-44bc-9b73-9f2815358120 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:56.196965 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c234edf-109e-44bc-9b73-9f2815358120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:56.221405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6c234edf-109e-44bc-9b73-9f2815358120 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:56.222419 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6c234edf-109e-44bc-9b73-9f2815358120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:56.355041 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 900/1790] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:56.368491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72944dc-667a-4a15-b811-1e9b9826afa9 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:56.370501 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d72944dc-667a-4a15-b811-1e9b9826afa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:56.466681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:56.489957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72944dc-667a-4a15-b811-1e9b9826afa9 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:56.501589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb1998-e157-4adb-b80c-6afc3d743bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:56.502704 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb1998-e157-4adb-b80c-6afc3d743bbb service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:56.503142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb1998-e157-4adb-b80c-6afc3d743bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:56.503432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb1998-e157-4adb-b80c-6afc3d743bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:56.523073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb1998-e157-4adb-b80c-6afc3d743bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:56.524916 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb1998-e157-4adb-b80c-6afc3d743bbb service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:56.553867 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 891/1791] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:57.228057 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c234edf-109e-44bc-9b73-9f2815358120 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:57.230228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6c234edf-109e-44bc-9b73-9f2815358120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:57.257810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c234edf-109e-44bc-9b73-9f2815358120 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:57.266158 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d3d5d-80fe-4d76-8630-ae45f738165e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:57.267436 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d3d5d-80fe-4d76-8630-ae45f738165e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:57.267887 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d3d5d-80fe-4d76-8630-ae45f738165e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:57.268328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d3d5d-80fe-4d76-8630-ae45f738165e admin admin] PATH_INFO: `/v3/projects/7391f3e8709245aeac468bdad5601c05` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:57.270132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d3d5d-80fe-4d76-8630-ae45f738165e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7391f3e8709245aeac468bdad5601c05)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:57.273651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d3d5d-80fe-4d76-8630-ae45f738165e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:57.442479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-042d3d5d-80fe-4d76-8630-ae45f738165e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7391f3e8709245aeac468bdad5601c05', 'request_id': 'req-042d3d5d-80fe-4d76-8630-ae45f738165e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:57.510995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-042d3d5d-80fe-4d76-8630-ae45f738165e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7391f3e8709245aeac468bdad5601c05', 'request_id': 'req-042d3d5d-80fe-4d76-8630-ae45f738165e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:57.528919 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-042d3d5d-80fe-4d76-8630-ae45f738165e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7391f3e8709245aeac468bdad5601c05', 'request_id': 'req-042d3d5d-80fe-4d76-8630-ae45f738165e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:57.546103 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-042d3d5d-80fe-4d76-8630-ae45f738165e admin admin] The token cache is being invalidate because project 7391f3e8709245aeac468bdad5601c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:34:57.546778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-042d3d5d-80fe-4d76-8630-ae45f738165e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:57.549361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-042d3d5d-80fe-4d76-8630-ae45f738165e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:57.552287 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 901/1792] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:34:57 2022] DELETE /identity/v3/projects/7391f3e8709245aeac468bdad5601c05 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:57.553543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb1998-e157-4adb-b80c-6afc3d743bbb service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:57.577202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb1998-e157-4adb-b80c-6afc3d743bbb service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:57.654322 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d3d5d-80fe-4d76-8630-ae45f738165e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:57.656876 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5bfa6-7234-4bd3-85b0-441b5e6907b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:57.657408 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-042d3d5d-80fe-4d76-8630-ae45f738165e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:57.657981 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5bfa6-7234-4bd3-85b0-441b5e6907b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:57.658415 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5bfa6-7234-4bd3-85b0-441b5e6907b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:57.658733 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5bfa6-7234-4bd3-85b0-441b5e6907b9 admin admin] PATH_INFO: `/v3/users/926a2386f2d04515817d5c784de81122` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:57.660023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5bfa6-7234-4bd3-85b0-441b5e6907b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=926a2386f2d04515817d5c784de81122)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:57.662232 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5bfa6-7234-4bd3-85b0-441b5e6907b9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:57.673357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d3d5d-80fe-4d76-8630-ae45f738165e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:57.689274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8a7c6-26ee-4144-9df6-af2ca0eb2841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:57.690257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8a7c6-26ee-4144-9df6-af2ca0eb2841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:57.690541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8a7c6-26ee-4144-9df6-af2ca0eb2841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:57.690872 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8a7c6-26ee-4144-9df6-af2ca0eb2841 admin admin] PATH_INFO: `/v3/users/73cde8b52bd64217a556446efaedebae` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:57.694660 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8a7c6-26ee-4144-9df6-af2ca0eb2841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73cde8b52bd64217a556446efaedebae)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:57.697518 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8a7c6-26ee-4144-9df6-af2ca0eb2841 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:57.906971 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e1d5bfa6-7234-4bd3-85b0-441b5e6907b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926a2386f2d04515817d5c784de81122'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:57.913366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f9a8a7c6-26ee-4144-9df6-af2ca0eb2841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73cde8b52bd64217a556446efaedebae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:57.922593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:57.925103 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e1d5bfa6-7234-4bd3-85b0-441b5e6907b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926a2386f2d04515817d5c784de81122'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:57.925232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f9a8a7c6-26ee-4144-9df6-af2ca0eb2841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73cde8b52bd64217a556446efaedebae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:57.936236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e1d5bfa6-7234-4bd3-85b0-441b5e6907b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926a2386f2d04515817d5c784de81122'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:57.936236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e1d5bfa6-7234-4bd3-85b0-441b5e6907b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926a2386f2d04515817d5c784de81122'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:57.939742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f9a8a7c6-26ee-4144-9df6-af2ca0eb2841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73cde8b52bd64217a556446efaedebae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:57.940517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f9a8a7c6-26ee-4144-9df6-af2ca0eb2841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73cde8b52bd64217a556446efaedebae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:57.941170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f9a8a7c6-26ee-4144-9df6-af2ca0eb2841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73cde8b52bd64217a556446efaedebae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:57.944761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e1d5bfa6-7234-4bd3-85b0-441b5e6907b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926a2386f2d04515817d5c784de81122'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:58.050658 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 902/1793] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:34:57 2022] DELETE /identity/v3/users/73cde8b52bd64217a556446efaedebae => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:58.055142 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a2f67-9106-44e4-bded-79b96830f517 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:58.056089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a2f67-9106-44e4-bded-79b96830f517 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:58.056507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a2f67-9106-44e4-bded-79b96830f517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:58.076680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-fe2a2f67-9106-44e4-bded-79b96830f517 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:58.077991 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fe2a2f67-9106-44e4-bded-79b96830f517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:58.126486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 892/1794] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:34:57 2022] DELETE /identity/v3/users/926a2386f2d04515817d5c784de81122 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:34:58.148351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 903/1795] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:34:58.158740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5bfa6-7234-4bd3-85b0-441b5e6907b9 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:58.160571 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e1d5bfa6-7234-4bd3-85b0-441b5e6907b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:58.250642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5bfa6-7234-4bd3-85b0-441b5e6907b9 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:58.255302 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bd83f-59b7-4082-bcd9-9f973646320c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:58.255964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bd83f-59b7-4082-bcd9-9f973646320c service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:58.256884 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bd83f-59b7-4082-bcd9-9f973646320c service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:58.257217 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bd83f-59b7-4082-bcd9-9f973646320c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:58.330123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bd83f-59b7-4082-bcd9-9f973646320c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:58.331655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bd83f-59b7-4082-bcd9-9f973646320c service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:58.342049 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 893/1796] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:34:58.409657 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:58.687558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a2f67-9106-44e4-bded-79b96830f517 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:58.689033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fe2a2f67-9106-44e4-bded-79b96830f517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:58.702769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a2f67-9106-44e4-bded-79b96830f517 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:58.707895 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcf14b-9f85-410c-9550-43b55fadc496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:58.709061 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcf14b-9f85-410c-9550-43b55fadc496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:58.709989 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcf14b-9f85-410c-9550-43b55fadc496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:58.710310 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcf14b-9f85-410c-9550-43b55fadc496 admin admin] PATH_INFO: `/v3/projects/50e675b755274ede90487dd81d30abc3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:58.712485 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcf14b-9f85-410c-9550-43b55fadc496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e675b755274ede90487dd81d30abc3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:58.714946 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcf14b-9f85-410c-9550-43b55fadc496 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:58.859958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7efcf14b-9f85-410c-9550-43b55fadc496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e675b755274ede90487dd81d30abc3', 'request_id': 'req-7efcf14b-9f85-410c-9550-43b55fadc496'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:58.878159 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bd83f-59b7-4082-bcd9-9f973646320c service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:58.880521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-960bd83f-59b7-4082-bcd9-9f973646320c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:58.894996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bd83f-59b7-4082-bcd9-9f973646320c service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:58.944987 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7efcf14b-9f85-410c-9550-43b55fadc496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e675b755274ede90487dd81d30abc3', 'request_id': 'req-7efcf14b-9f85-410c-9550-43b55fadc496'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:58.954109 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7efcf14b-9f85-410c-9550-43b55fadc496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e675b755274ede90487dd81d30abc3', 'request_id': 'req-7efcf14b-9f85-410c-9550-43b55fadc496'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:58.970758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a8d96-61d0-473e-b69e-9fa91c008da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:58.971724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a8d96-61d0-473e-b69e-9fa91c008da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:58.971947 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a8d96-61d0-473e-b69e-9fa91c008da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:58.972227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a8d96-61d0-473e-b69e-9fa91c008da2 admin admin] PATH_INFO: `/v3/projects/09344e51a7b04687a50fe866c20d3517` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:58.973011 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7efcf14b-9f85-410c-9550-43b55fadc496 admin admin] The token cache is being invalidate because project 50e675b755274ede90487dd81d30abc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:34:58.973677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7efcf14b-9f85-410c-9550-43b55fadc496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:58.973796 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a8d96-61d0-473e-b69e-9fa91c008da2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09344e51a7b04687a50fe866c20d3517)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:58.974837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7efcf14b-9f85-410c-9550-43b55fadc496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:58.975692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a8d96-61d0-473e-b69e-9fa91c008da2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:58.980579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 904/1797] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:34:58 2022] DELETE /identity/v3/projects/50e675b755274ede90487dd81d30abc3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:58.982417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77372c9d-4a43-4c63-b744-c1e4de4a0895 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:58.982948 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77372c9d-4a43-4c63-b744-c1e4de4a0895 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:58.983432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77372c9d-4a43-4c63-b744-c1e4de4a0895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:59.004517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-77372c9d-4a43-4c63-b744-c1e4de4a0895 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:59.007164 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-77372c9d-4a43-4c63-b744-c1e4de4a0895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:59.016796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 905/1798] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:59.025523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d5a86-1a93-4e99-a9d4-3df4ba7c91f4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:59.025523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d5a86-1a93-4e99-a9d4-3df4ba7c91f4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:59.025523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d5a86-1a93-4e99-a9d4-3df4ba7c91f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:59.046789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-447d5a86-1a93-4e99-a9d4-3df4ba7c91f4 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:59.048031 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-447d5a86-1a93-4e99-a9d4-3df4ba7c91f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:59.057001 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 906/1799] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:59.061092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d5a86-1a93-4e99-a9d4-3df4ba7c91f4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:59.070202 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d5a86-1a93-4e99-a9d4-3df4ba7c91f4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:59.075615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105370c-af71-4a04-877b-05b2c1d060ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:59.076281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105370c-af71-4a04-877b-05b2c1d060ae admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:59.076560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105370c-af71-4a04-877b-05b2c1d060ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:59.076834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105370c-af71-4a04-877b-05b2c1d060ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:59.077606 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105370c-af71-4a04-877b-05b2c1d060ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:34:59.093010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105370c-af71-4a04-877b-05b2c1d060ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:59.093010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105370c-af71-4a04-877b-05b2c1d060ae admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:59.093250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-833a8d96-61d0-473e-b69e-9fa91c008da2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09344e51a7b04687a50fe866c20d3517', 'request_id': 'req-833a8d96-61d0-473e-b69e-9fa91c008da2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:59.093373 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 907/1800] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:34:59.097421 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-833a8d96-61d0-473e-b69e-9fa91c008da2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09344e51a7b04687a50fe866c20d3517', 'request_id': 'req-833a8d96-61d0-473e-b69e-9fa91c008da2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:59.097630 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105370c-af71-4a04-877b-05b2c1d060ae admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:59.108328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105370c-af71-4a04-877b-05b2c1d060ae admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:59.164063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1d13a-6e8b-4e75-b8c9-9aec2e7227be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:59.165247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1d13a-6e8b-4e75-b8c9-9aec2e7227be admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:59.165560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1d13a-6e8b-4e75-b8c9-9aec2e7227be admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:59.165862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1d13a-6e8b-4e75-b8c9-9aec2e7227be admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:59.166553 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1d13a-6e8b-4e75-b8c9-9aec2e7227be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:59.168610 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1d13a-6e8b-4e75-b8c9-9aec2e7227be admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:59.207696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-833a8d96-61d0-473e-b69e-9fa91c008da2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09344e51a7b04687a50fe866c20d3517', 'request_id': 'req-833a8d96-61d0-473e-b69e-9fa91c008da2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:59.218934 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-833a8d96-61d0-473e-b69e-9fa91c008da2 admin admin] The token cache is being invalidate because project 09344e51a7b04687a50fe866c20d3517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:34:59.219350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-833a8d96-61d0-473e-b69e-9fa91c008da2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:59.219994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-833a8d96-61d0-473e-b69e-9fa91c008da2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:59.221676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 894/1801] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:34:58 2022] DELETE /identity/v3/projects/09344e51a7b04687a50fe866c20d3517 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:34:59.225532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a8d96-61d0-473e-b69e-9fa91c008da2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:59.226839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-833a8d96-61d0-473e-b69e-9fa91c008da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:59.239625 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a8d96-61d0-473e-b69e-9fa91c008da2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:59.245073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f79cb-f166-42d1-9678-5431a76b1b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:59.245962 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f79cb-f166-42d1-9678-5431a76b1b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:59.246241 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f79cb-f166-42d1-9678-5431a76b1b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:59.246513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f79cb-f166-42d1-9678-5431a76b1b5e admin admin] PATH_INFO: `/v3/users/ab735699e0e242ac8d22fe38e10447a7` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:59.247732 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f79cb-f166-42d1-9678-5431a76b1b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab735699e0e242ac8d22fe38e10447a7)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:59.249975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f79cb-f166-42d1-9678-5431a76b1b5e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:59.274585 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 908/1802] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:59 2022] POST /identity/v3/projects => generated 393 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:34:59.278503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1d13a-6e8b-4e75-b8c9-9aec2e7227be admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:59.280354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-daa1d13a-6e8b-4e75-b8c9-9aec2e7227be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:59.342554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1d13a-6e8b-4e75-b8c9-9aec2e7227be admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:59.347105 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c9262-ca43-4740-847f-4819b84125bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:59.347771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c9262-ca43-4740-847f-4819b84125bc admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:59.348049 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c9262-ca43-4740-847f-4819b84125bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:59.348321 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c9262-ca43-4740-847f-4819b84125bc admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:59.349008 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c9262-ca43-4740-847f-4819b84125bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:59.350982 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c9262-ca43-4740-847f-4819b84125bc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:59.480895 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-463f79cb-f166-42d1-9678-5431a76b1b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab735699e0e242ac8d22fe38e10447a7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:59.493282 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 909/1803] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:34:59 2022] POST /identity/v3/users => generated 297 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:34:59.494070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-463f79cb-f166-42d1-9678-5431a76b1b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab735699e0e242ac8d22fe38e10447a7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:59.494930 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-463f79cb-f166-42d1-9678-5431a76b1b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab735699e0e242ac8d22fe38e10447a7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:59.495707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-463f79cb-f166-42d1-9678-5431a76b1b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab735699e0e242ac8d22fe38e10447a7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:59.497520 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c9262-ca43-4740-847f-4819b84125bc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:59.499850 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-976c9262-ca43-4740-847f-4819b84125bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:59.504191 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-463f79cb-f166-42d1-9678-5431a76b1b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab735699e0e242ac8d22fe38e10447a7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:34:59.513879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c9262-ca43-4740-847f-4819b84125bc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:59.523574 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee241ed-27fb-43e9-8bd9-1d75433dcefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:59.524904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee241ed-27fb-43e9-8bd9-1d75433dcefc admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:59.525254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee241ed-27fb-43e9-8bd9-1d75433dcefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:59.525598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee241ed-27fb-43e9-8bd9-1d75433dcefc admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:59.528475 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee241ed-27fb-43e9-8bd9-1d75433dcefc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:59.528475 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee241ed-27fb-43e9-8bd9-1d75433dcefc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:59.538562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 910/1804] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:34:59.543160 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee241ed-27fb-43e9-8bd9-1d75433dcefc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:59.553413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee241ed-27fb-43e9-8bd9-1d75433dcefc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:59.558963 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d40b0-02eb-49a2-830b-230dd12418de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:59.559642 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d40b0-02eb-49a2-830b-230dd12418de admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:59.559920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d40b0-02eb-49a2-830b-230dd12418de admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:59.560252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d40b0-02eb-49a2-830b-230dd12418de admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:59.561085 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d40b0-02eb-49a2-830b-230dd12418de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:59.562761 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d40b0-02eb-49a2-830b-230dd12418de admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:59.574645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 911/1805] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:34:59.578880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d40b0-02eb-49a2-830b-230dd12418de admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:59.584439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 895/1806] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:34:59 2022] DELETE /identity/v3/users/ab735699e0e242ac8d22fe38e10447a7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:34:59.593205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d40b0-02eb-49a2-830b-230dd12418de admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:59.664176 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d56e9e-9f01-45f6-872f-635c2fc2a393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:59.665630 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d56e9e-9f01-45f6-872f-635c2fc2a393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:59.665912 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d56e9e-9f01-45f6-872f-635c2fc2a393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:59.666190 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d56e9e-9f01-45f6-872f-635c2fc2a393 admin admin] PATH_INFO: `/v3/projects/d1752235e1664d719ed3186aba3167ca/users/4c9fb5f5cdd74a69b856bde0d61c65bb/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:59.688819 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d56e9e-9f01-45f6-872f-635c2fc2a393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1752235e1664d719ed3186aba3167ca, user_id=4c9fb5f5cdd74a69b856bde0d61c65bb, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:59.691707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d56e9e-9f01-45f6-872f-635c2fc2a393 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:34:59.798133 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 912/1807] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:34:59 2022] PUT /identity/v3/projects/d1752235e1664d719ed3186aba3167ca/users/4c9fb5f5cdd74a69b856bde0d61c65bb/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:34:59.808532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641ff59-8054-4ed7-8eab-62d4e4bb7eaa None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:59.808817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641ff59-8054-4ed7-8eab-62d4e4bb7eaa None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:59.809092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641ff59-8054-4ed7-8eab-62d4e4bb7eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:59.838578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8641ff59-8054-4ed7-8eab-62d4e4bb7eaa None None] MFA Rules not processed for user `4c9fb5f5cdd74a69b856bde0d61c65bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:34:59.839828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8641ff59-8054-4ed7-8eab-62d4e4bb7eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:34:59.908400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 896/1808] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:34:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:34:59.912850 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d56e9e-9f01-45f6-872f-635c2fc2a393 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:34:59.975336 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d56e9e-9f01-45f6-872f-635c2fc2a393 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:34:59.980500 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619545e2-71d3-496d-bcd0-7b257d24a6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:34:59.981164 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619545e2-71d3-496d-bcd0-7b257d24a6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:34:59.981487 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619545e2-71d3-496d-bcd0-7b257d24a6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:34:59.981768 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619545e2-71d3-496d-bcd0-7b257d24a6a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:34:59.982518 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619545e2-71d3-496d-bcd0-7b257d24a6a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:34:59.984470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619545e2-71d3-496d-bcd0-7b257d24a6a7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:00.063386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641ff59-8054-4ed7-8eab-62d4e4bb7eaa None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:00.063386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8641ff59-8054-4ed7-8eab-62d4e4bb7eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:00.078149 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641ff59-8054-4ed7-8eab-62d4e4bb7eaa None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:00.083762 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff28a6-5e0e-4f1b-93fd-dd2816b15392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:00.084946 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff28a6-5e0e-4f1b-93fd-dd2816b15392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:00.091972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff28a6-5e0e-4f1b-93fd-dd2816b15392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:00.091972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff28a6-5e0e-4f1b-93fd-dd2816b15392 admin admin] PATH_INFO: `/v3/projects/d40e77ad7fef4163a1b66a3e96ba6f27` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:00.091972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff28a6-5e0e-4f1b-93fd-dd2816b15392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d40e77ad7fef4163a1b66a3e96ba6f27)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:00.091972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff28a6-5e0e-4f1b-93fd-dd2816b15392 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:00.097513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 913/1809] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:34:59 2022] POST /identity/v3/projects => generated 393 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:00.098442 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619545e2-71d3-496d-bcd0-7b257d24a6a7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:00.171628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619545e2-71d3-496d-bcd0-7b257d24a6a7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:00.176325 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c66b48-8661-44d2-a0dd-5b317ae84f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:00.177001 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c66b48-8661-44d2-a0dd-5b317ae84f70 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:00.177284 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c66b48-8661-44d2-a0dd-5b317ae84f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:00.177590 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c66b48-8661-44d2-a0dd-5b317ae84f70 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:00.178282 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c66b48-8661-44d2-a0dd-5b317ae84f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:00.180217 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c66b48-8661-44d2-a0dd-5b317ae84f70 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:00.205988 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-23ff28a6-5e0e-4f1b-93fd-dd2816b15392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40e77ad7fef4163a1b66a3e96ba6f27', 'request_id': 'req-23ff28a6-5e0e-4f1b-93fd-dd2816b15392'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:00.212721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-23ff28a6-5e0e-4f1b-93fd-dd2816b15392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40e77ad7fef4163a1b66a3e96ba6f27', 'request_id': 'req-23ff28a6-5e0e-4f1b-93fd-dd2816b15392'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:00.284515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 914/1810] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:00 2022] POST /identity/v3/users => generated 303 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:00.288315 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c66b48-8661-44d2-a0dd-5b317ae84f70 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:00.298368 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c66b48-8661-44d2-a0dd-5b317ae84f70 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:00.308254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-23ff28a6-5e0e-4f1b-93fd-dd2816b15392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40e77ad7fef4163a1b66a3e96ba6f27', 'request_id': 'req-23ff28a6-5e0e-4f1b-93fd-dd2816b15392'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:00.321136 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-23ff28a6-5e0e-4f1b-93fd-dd2816b15392 admin admin] The token cache is being invalidate because project d40e77ad7fef4163a1b66a3e96ba6f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:00.321719 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-23ff28a6-5e0e-4f1b-93fd-dd2816b15392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:00.322655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-23ff28a6-5e0e-4f1b-93fd-dd2816b15392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:00.324667 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 897/1811] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:00 2022] DELETE /identity/v3/projects/d40e77ad7fef4163a1b66a3e96ba6f27 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:00.329799 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde10c64-219b-4b91-8f88-ddea5c2f74e6 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:00.330076 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde10c64-219b-4b91-8f88-ddea5c2f74e6 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:00.330850 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde10c64-219b-4b91-8f88-ddea5c2f74e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:00.349914 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-fde10c64-219b-4b91-8f88-ddea5c2f74e6 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:00.351131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fde10c64-219b-4b91-8f88-ddea5c2f74e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:00.357653 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968455f-b457-4f78-833f-336447548e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:00.358513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968455f-b457-4f78-833f-336447548e34 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:00.358997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968455f-b457-4f78-833f-336447548e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:00.359280 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968455f-b457-4f78-833f-336447548e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:00.360014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968455f-b457-4f78-833f-336447548e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:00.361686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968455f-b457-4f78-833f-336447548e34 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:00.371827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 915/1812] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:00.376263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968455f-b457-4f78-833f-336447548e34 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:00.377913 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a968455f-b457-4f78-833f-336447548e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:00.390264 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968455f-b457-4f78-833f-336447548e34 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:00.394842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8951538-3239-46ce-a7e6-558331a9d40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:00.395758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8951538-3239-46ce-a7e6-558331a9d40d admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:00.396039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8951538-3239-46ce-a7e6-558331a9d40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:00.396316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8951538-3239-46ce-a7e6-558331a9d40d admin admin] PATH_INFO: `/v3/projects/d6fda8e192d84ea38ce090a8e722be27/users/79ab10c83b594f15b5ee91c9a99889d9/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:00.411151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8951538-3239-46ce-a7e6-558331a9d40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fda8e192d84ea38ce090a8e722be27, user_id=79ab10c83b594f15b5ee91c9a99889d9, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:00.412414 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 898/1813] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:00.415594 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8951538-3239-46ce-a7e6-558331a9d40d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:00.421993 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c348da-5eed-494f-a200-4b8bdd17003b None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:00.422285 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c348da-5eed-494f-a200-4b8bdd17003b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:00.422567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c348da-5eed-494f-a200-4b8bdd17003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:00.440712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a6c348da-5eed-494f-a200-4b8bdd17003b None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:00.442210 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:00.444039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a6c348da-5eed-494f-a200-4b8bdd17003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:00.450972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 899/1814] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:00.455016 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c348da-5eed-494f-a200-4b8bdd17003b None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:00.464389 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c348da-5eed-494f-a200-4b8bdd17003b None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:00.468923 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b674b-41c4-42bf-a541-1a51956aa3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:00.472752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b674b-41c4-42bf-a541-1a51956aa3ae admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:00.472752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b674b-41c4-42bf-a541-1a51956aa3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:00.472752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b674b-41c4-42bf-a541-1a51956aa3ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:00.472752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b674b-41c4-42bf-a541-1a51956aa3ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:00.472752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b674b-41c4-42bf-a541-1a51956aa3ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:00.472752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b674b-41c4-42bf-a541-1a51956aa3ae admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:00.485170 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 900/1815] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:35:00.489202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b674b-41c4-42bf-a541-1a51956aa3ae admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:00.499416 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b674b-41c4-42bf-a541-1a51956aa3ae admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:00.500145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 916/1816] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:00 2022] PUT /identity/v3/projects/d6fda8e192d84ea38ce090a8e722be27/users/79ab10c83b594f15b5ee91c9a99889d9/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:00.504847 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8951538-3239-46ce-a7e6-558331a9d40d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:00.559089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018dcb7-802c-459b-a18c-8477751dbf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:00.559846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018dcb7-802c-459b-a18c-8477751dbf2d admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:00.560203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018dcb7-802c-459b-a18c-8477751dbf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:00.560483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018dcb7-802c-459b-a18c-8477751dbf2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:00.561189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018dcb7-802c-459b-a18c-8477751dbf2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:00.563161 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018dcb7-802c-459b-a18c-8477751dbf2d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:00.576761 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8951538-3239-46ce-a7e6-558331a9d40d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:00.581558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a810e4-596e-4449-8055-87136bee599d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:00.582241 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a810e4-596e-4449-8055-87136bee599d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:00.582524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a810e4-596e-4449-8055-87136bee599d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:00.582804 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a810e4-596e-4449-8055-87136bee599d admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:00.583534 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a810e4-596e-4449-8055-87136bee599d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:00.585220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a810e4-596e-4449-8055-87136bee599d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:00.596203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 917/1817] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:00.600259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a810e4-596e-4449-8055-87136bee599d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:00.609829 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a810e4-596e-4449-8055-87136bee599d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:00.614572 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5cfbc-1895-45c4-bc19-e2b131bcec47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:00.616342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5cfbc-1895-45c4-bc19-e2b131bcec47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:00.616342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5cfbc-1895-45c4-bc19-e2b131bcec47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:00.616510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:00.616593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5cfbc-1895-45c4-bc19-e2b131bcec47 admin admin] PATH_INFO: `/v3/projects/d6fda8e192d84ea38ce090a8e722be27/users/79ab10c83b594f15b5ee91c9a99889d9/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:00.618341 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5cfbc-1895-45c4-bc19-e2b131bcec47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fda8e192d84ea38ce090a8e722be27, user_id=79ab10c83b594f15b5ee91c9a99889d9, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:00.621014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5cfbc-1895-45c4-bc19-e2b131bcec47 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:00.631866 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 918/1818] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:00 2022] PUT /identity/v3/projects/d6fda8e192d84ea38ce090a8e722be27/users/79ab10c83b594f15b5ee91c9a99889d9/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:00.648672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40d01-586e-4418-97a6-4134e3658326 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:00.648957 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40d01-586e-4418-97a6-4134e3658326 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:00.649912 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40d01-586e-4418-97a6-4134e3658326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:00.677898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f8a40d01-586e-4418-97a6-4134e3658326 None None] MFA Rules not processed for user `79ab10c83b594f15b5ee91c9a99889d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:00.679126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f8a40d01-586e-4418-97a6-4134e3658326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:00.690889 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 901/1819] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:00 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:00.694610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018dcb7-802c-459b-a18c-8477751dbf2d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:00.756372 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 919/1820] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:00.771850 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a40d01-586e-4418-97a6-4134e3658326 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:00.771850 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f8a40d01-586e-4418-97a6-4134e3658326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:00.772018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018dcb7-802c-459b-a18c-8477751dbf2d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:00.776568 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8f738-e0b2-48dc-aceb-7af5581c657a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:00.777295 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8f738-e0b2-48dc-aceb-7af5581c657a admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:00.777610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8f738-e0b2-48dc-aceb-7af5581c657a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:00.777888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8f738-e0b2-48dc-aceb-7af5581c657a admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:00.778593 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8f738-e0b2-48dc-aceb-7af5581c657a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:00.780627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8f738-e0b2-48dc-aceb-7af5581c657a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:00.848521 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a40d01-586e-4418-97a6-4134e3658326 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:00.900874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d52c1-ca70-4423-9445-a0ae8521b2fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:00.901776 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d52c1-ca70-4423-9445-a0ae8521b2fb service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:00.901885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d52c1-ca70-4423-9445-a0ae8521b2fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:00.902166 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d52c1-ca70-4423-9445-a0ae8521b2fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:00.905711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 902/1821] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:00 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:00.907412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8f738-e0b2-48dc-aceb-7af5581c657a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:00.918932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8f738-e0b2-48dc-aceb-7af5581c657a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:00.931700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00f514-2f96-4320-8719-6d7fc9521122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:00.932417 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00f514-2f96-4320-8719-6d7fc9521122 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:00.932702 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00f514-2f96-4320-8719-6d7fc9521122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:00.932982 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00f514-2f96-4320-8719-6d7fc9521122 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:00.933774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00f514-2f96-4320-8719-6d7fc9521122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:00.935398 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00f514-2f96-4320-8719-6d7fc9521122 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:00.945655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 903/1822] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:00.949877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00f514-2f96-4320-8719-6d7fc9521122 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:00.959455 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00f514-2f96-4320-8719-6d7fc9521122 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:00.964727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c5898-418e-4e7a-821d-d3a7646d4ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:00.965410 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c5898-418e-4e7a-821d-d3a7646d4ccc admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:00.965701 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c5898-418e-4e7a-821d-d3a7646d4ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:00.965983 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c5898-418e-4e7a-821d-d3a7646d4ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:00.966733 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c5898-418e-4e7a-821d-d3a7646d4ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:00.967350 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d52c1-ca70-4423-9445-a0ae8521b2fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:00.968334 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c5898-418e-4e7a-821d-d3a7646d4ccc admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:00.968796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d52c1-ca70-4423-9445-a0ae8521b2fb service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:00.979425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 920/1823] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:00.983238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 904/1824] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:00.984314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d52c1-ca70-4423-9445-a0ae8521b2fb service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:00.994629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d52c1-ca70-4423-9445-a0ae8521b2fb service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:00.999867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd99ab-197e-4a5e-a439-7952020ec211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:01.000753 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd99ab-197e-4a5e-a439-7952020ec211 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:01.001032 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd99ab-197e-4a5e-a439-7952020ec211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:01.001306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd99ab-197e-4a5e-a439-7952020ec211 admin admin] PATH_INFO: `/v3/projects/45f9205cd7544fd1b92a078ea8fedb72/users/0915bedaa3ef4fedb35a08607383dbb9/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:01.016082 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd99ab-197e-4a5e-a439-7952020ec211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f9205cd7544fd1b92a078ea8fedb72, user_id=0915bedaa3ef4fedb35a08607383dbb9, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:01.019629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd99ab-197e-4a5e-a439-7952020ec211 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:01.032152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c5898-418e-4e7a-821d-d3a7646d4ccc admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:01.033908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-067c5898-418e-4e7a-821d-d3a7646d4ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:01.047715 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c5898-418e-4e7a-821d-d3a7646d4ccc admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:01.051413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059d7c0-fd3c-406b-84fd-837c34d8ec31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:01.055977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059d7c0-fd3c-406b-84fd-837c34d8ec31 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:01.055977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059d7c0-fd3c-406b-84fd-837c34d8ec31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:01.055977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059d7c0-fd3c-406b-84fd-837c34d8ec31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:01.055977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0059d7c0-fd3c-406b-84fd-837c34d8ec31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:01.085060 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 921/1825] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:00 2022] PUT /identity/v3/projects/45f9205cd7544fd1b92a078ea8fedb72/users/0915bedaa3ef4fedb35a08607383dbb9/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:01.095817 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7ba32-a587-47f6-97f7-d60ba3f3c797 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:01.096110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7ba32-a587-47f6-97f7-d60ba3f3c797 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:01.096392 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7ba32-a587-47f6-97f7-d60ba3f3c797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:01.117027 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059d7c0-fd3c-406b-84fd-837c34d8ec31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:01.119088 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059d7c0-fd3c-406b-84fd-837c34d8ec31 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:01.129478 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-dfa7ba32-a587-47f6-97f7-d60ba3f3c797 None None] MFA Rules not processed for user `0915bedaa3ef4fedb35a08607383dbb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:01.129478 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dfa7ba32-a587-47f6-97f7-d60ba3f3c797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:01.129711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 905/1826] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:01.192858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 922/1827] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:01.197680 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059d7c0-fd3c-406b-84fd-837c34d8ec31 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:01.208595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059d7c0-fd3c-406b-84fd-837c34d8ec31 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:01.242995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:01.291213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083f0bc-3c16-4748-ad7a-4e9955667fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:01.291910 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083f0bc-3c16-4748-ad7a-4e9955667fdc admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:01.292196 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083f0bc-3c16-4748-ad7a-4e9955667fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:01.292485 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083f0bc-3c16-4748-ad7a-4e9955667fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:01.293175 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083f0bc-3c16-4748-ad7a-4e9955667fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:01.295142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083f0bc-3c16-4748-ad7a-4e9955667fdc admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:01.342969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:01.392366 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 906/1828] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:01 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:01.393863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7ba32-a587-47f6-97f7-d60ba3f3c797 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:01.406471 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7ba32-a587-47f6-97f7-d60ba3f3c797 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:01.463812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38667413-8130-4ce8-b9a8-8788c6e9299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:01.464642 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38667413-8130-4ce8-b9a8-8788c6e9299a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:01.464933 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38667413-8130-4ce8-b9a8-8788c6e9299a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:01.465217 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38667413-8130-4ce8-b9a8-8788c6e9299a admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:01.465962 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38667413-8130-4ce8-b9a8-8788c6e9299a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:01.467995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38667413-8130-4ce8-b9a8-8788c6e9299a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:01.556405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 923/1829] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:01 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:01.560991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083f0bc-3c16-4748-ad7a-4e9955667fdc admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:01.656970 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083f0bc-3c16-4748-ad7a-4e9955667fdc admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:01.656970 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73292b-4ae2-46a9-8ab5-c9cd54f52825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:01.656970 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73292b-4ae2-46a9-8ab5-c9cd54f52825 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:01.656970 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73292b-4ae2-46a9-8ab5-c9cd54f52825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:01.657255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73292b-4ae2-46a9-8ab5-c9cd54f52825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:01.657255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73292b-4ae2-46a9-8ab5-c9cd54f52825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:01.657255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73292b-4ae2-46a9-8ab5-c9cd54f52825 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:01.657255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 907/1830] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:01.657518 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38667413-8130-4ce8-b9a8-8788c6e9299a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:01.657518 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38667413-8130-4ce8-b9a8-8788c6e9299a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:01.657518 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb175f0-a47f-4430-a477-6339324b44c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:01.657980 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb175f0-a47f-4430-a477-6339324b44c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:01.658219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb175f0-a47f-4430-a477-6339324b44c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:01.658388 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb175f0-a47f-4430-a477-6339324b44c1 admin admin] PATH_INFO: `/v3/projects/27b787ca067d4d9dabc26708407147fa/users/4ac4eb4ef24d44baa68e055097fde8de/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:01.674150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb175f0-a47f-4430-a477-6339324b44c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b787ca067d4d9dabc26708407147fa, user_id=4ac4eb4ef24d44baa68e055097fde8de, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:01.677057 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb175f0-a47f-4430-a477-6339324b44c1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:01.908034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:01.942852 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 924/1831] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:01 2022] PUT /identity/v3/projects/27b787ca067d4d9dabc26708407147fa/users/4ac4eb4ef24d44baa68e055097fde8de/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:01.947169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73292b-4ae2-46a9-8ab5-c9cd54f52825 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:01.958658 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73292b-4ae2-46a9-8ab5-c9cd54f52825 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:02.018933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9beb7d-5d29-4ed2-a2f0-4e18c2c7fbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:02.019814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9beb7d-5d29-4ed2-a2f0-4e18c2c7fbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:02.020231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9beb7d-5d29-4ed2-a2f0-4e18c2c7fbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:02.020511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9beb7d-5d29-4ed2-a2f0-4e18c2c7fbf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:02.021305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9beb7d-5d29-4ed2-a2f0-4e18c2c7fbf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:02.031320 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9beb7d-5d29-4ed2-a2f0-4e18c2c7fbf4 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:02.040259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb175f0-a47f-4430-a477-6339324b44c1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:02.040797 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 908/1832] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:02.057364 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb175f0-a47f-4430-a477-6339324b44c1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:02.061082 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bbc00-59b5-4d65-9905-51d7b5350f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:02.062022 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bbc00-59b5-4d65-9905-51d7b5350f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:02.062307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bbc00-59b5-4d65-9905-51d7b5350f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:02.062587 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bbc00-59b5-4d65-9905-51d7b5350f87 admin admin] PATH_INFO: `/v3/projects/27b787ca067d4d9dabc26708407147fa/users/4ac4eb4ef24d44baa68e055097fde8de/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:02.064586 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bbc00-59b5-4d65-9905-51d7b5350f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b787ca067d4d9dabc26708407147fa, user_id=4ac4eb4ef24d44baa68e055097fde8de, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:02.067275 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bbc00-59b5-4d65-9905-51d7b5350f87 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:02.078845 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 925/1833] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:02 2022] PUT /identity/v3/projects/27b787ca067d4d9dabc26708407147fa/users/4ac4eb4ef24d44baa68e055097fde8de/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:02.091539 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b0764-16a0-4789-9894-c7263b9e0af4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:02.091837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b0764-16a0-4789-9894-c7263b9e0af4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:02.092172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b0764-16a0-4789-9894-c7263b9e0af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:02.118445 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-033b0764-16a0-4789-9894-c7263b9e0af4 None None] MFA Rules not processed for user `4ac4eb4ef24d44baa68e055097fde8de`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:02.119661 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-033b0764-16a0-4789-9894-c7263b9e0af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:02.190316 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 909/1834] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:02.202421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bbc00-59b5-4d65-9905-51d7b5350f87 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:02.260290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bbc00-59b5-4d65-9905-51d7b5350f87 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:02.264355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9d6d4-7d5f-4f3e-b4a1-2e9ed6a8ab06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:02.265155 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9d6d4-7d5f-4f3e-b4a1-2e9ed6a8ab06 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:02.265481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9d6d4-7d5f-4f3e-b4a1-2e9ed6a8ab06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:02.265764 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9d6d4-7d5f-4f3e-b4a1-2e9ed6a8ab06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:02.277286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9d6d4-7d5f-4f3e-b4a1-2e9ed6a8ab06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:02.279700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9d6d4-7d5f-4f3e-b4a1-2e9ed6a8ab06 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:02.288705 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 926/1835] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:02.324462 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:02.356115 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:02.390276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b0764-16a0-4789-9894-c7263b9e0af4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:02.400852 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b0764-16a0-4789-9894-c7263b9e0af4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:02.404607 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cad24b-7589-4da1-a147-da82951248ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:02.405416 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cad24b-7589-4da1-a147-da82951248ae service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:02.405704 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cad24b-7589-4da1-a147-da82951248ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:02.406021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cad24b-7589-4da1-a147-da82951248ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:02.467161 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cad24b-7589-4da1-a147-da82951248ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:02.468698 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cad24b-7589-4da1-a147-da82951248ae service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:02.477989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 910/1836] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:02.530455 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:02.557031 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:02.735850 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6e164-588f-45db-94e8-cddea8ff24c6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:02.736323 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6e164-588f-45db-94e8-cddea8ff24c6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:02.736849 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6e164-588f-45db-94e8-cddea8ff24c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:02.760175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-37e6e164-588f-45db-94e8-cddea8ff24c6 None None] MFA Rules not processed for user `ad436c2fecba4754875b7c7cb26852a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:02.765799 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-37e6e164-588f-45db-94e8-cddea8ff24c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:02.814413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 927/1837] 10.222.0.55 () {58 vars in 1015 bytes} [Fri Jun 17 07:35:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:03.576373 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cad24b-7589-4da1-a147-da82951248ae service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:03.583602 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-15cad24b-7589-4da1-a147-da82951248ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:03.584024 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6e164-588f-45db-94e8-cddea8ff24c6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:03.585887 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-37e6e164-588f-45db-94e8-cddea8ff24c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:03.597215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cad24b-7589-4da1-a147-da82951248ae service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:03.597814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6e164-588f-45db-94e8-cddea8ff24c6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:03.600956 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04567648-e278-4ece-bec3-dd62678abf8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:03.601690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c68b6-c41f-4c03-afe5-639835f0cf2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:03.601820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04567648-e278-4ece-bec3-dd62678abf8d service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:03.602508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04567648-e278-4ece-bec3-dd62678abf8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:03.603017 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04567648-e278-4ece-bec3-dd62678abf8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:03.603615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c68b6-c41f-4c03-afe5-639835f0cf2c service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:03.603967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c68b6-c41f-4c03-afe5-639835f0cf2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:03.604250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c68b6-c41f-4c03-afe5-639835f0cf2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:03.611848 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04567648-e278-4ece-bec3-dd62678abf8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:03.617137 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c68b6-c41f-4c03-afe5-639835f0cf2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:03.617493 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04567648-e278-4ece-bec3-dd62678abf8d service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:03.617574 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c68b6-c41f-4c03-afe5-639835f0cf2c service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:03.623274 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 911/1838] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:03.631820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04567648-e278-4ece-bec3-dd62678abf8d service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:03.635317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 928/1839] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:03.641213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04567648-e278-4ece-bec3-dd62678abf8d service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:03.645857 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e476b-4c45-44fd-ac39-3c0a3b544929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:03.646579 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e476b-4c45-44fd-ac39-3c0a3b544929 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:03.646928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e476b-4c45-44fd-ac39-3c0a3b544929 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:03.647269 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e476b-4c45-44fd-ac39-3c0a3b544929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:03.660167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e476b-4c45-44fd-ac39-3c0a3b544929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:03.661961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e476b-4c45-44fd-ac39-3c0a3b544929 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:03.672000 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 912/1840] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:04.885685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651ca25-743e-4a07-b12a-5f03b6505bd2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:04.885685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651ca25-743e-4a07-b12a-5f03b6505bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:04.885685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651ca25-743e-4a07-b12a-5f03b6505bd2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:04.888617 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 929/1841] 10.222.0.52 () {54 vars in 921 bytes} [Fri Jun 17 07:35:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:35:04.898166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e9e0a-e68f-46d4-b9ae-01b9f1908d5f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:04.898610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e9e0a-e68f-46d4-b9ae-01b9f1908d5f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:04.898732 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e9e0a-e68f-46d4-b9ae-01b9f1908d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:04.936543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f68e9e0a-e68f-46d4-b9ae-01b9f1908d5f None None] MFA Rules not processed for user `88e1572d22c048b09699a2fe50900f92`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:04.940028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f68e9e0a-e68f-46d4-b9ae-01b9f1908d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:05.158149 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651ca25-743e-4a07-b12a-5f03b6505bd2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:05.159244 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 913/1842] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Jun 17 07:35:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:05.160577 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e651ca25-743e-4a07-b12a-5f03b6505bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:05.215726 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651ca25-743e-4a07-b12a-5f03b6505bd2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:05.223587 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15af4f5-f8b3-4a59-a7f1-922512fc0c6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:05.226466 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15af4f5-f8b3-4a59-a7f1-922512fc0c6c service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:05.226758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15af4f5-f8b3-4a59-a7f1-922512fc0c6c service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:05.227339 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15af4f5-f8b3-4a59-a7f1-922512fc0c6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:05.243451 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15af4f5-f8b3-4a59-a7f1-922512fc0c6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:05.245355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15af4f5-f8b3-4a59-a7f1-922512fc0c6c service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:05.260216 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 930/1843] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:05.561273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aee33-ceb7-4460-b0e1-65011130e1ae None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:05.561968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aee33-ceb7-4460-b0e1-65011130e1ae None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:05.563063 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aee33-ceb7-4460-b0e1-65011130e1ae None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:05.576971 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 914/1844] 10.222.0.52 () {54 vars in 921 bytes} [Fri Jun 17 07:35:05 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:35:05.610769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17ba80-6c31-4c33-8af4-4779171fad89 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:05.611330 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17ba80-6c31-4c33-8af4-4779171fad89 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:05.611792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17ba80-6c31-4c33-8af4-4779171fad89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:05.645352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3c17ba80-6c31-4c33-8af4-4779171fad89 None None] MFA Rules not processed for user `88e1572d22c048b09699a2fe50900f92`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:05.646618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3c17ba80-6c31-4c33-8af4-4779171fad89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:05.669957 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 931/1845] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Jun 17 07:35:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:06.155876 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1aee33-ceb7-4460-b0e1-65011130e1ae None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:06.164477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:06.181551 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1aee33-ceb7-4460-b0e1-65011130e1ae None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:06.194331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8f30e-972a-4316-8802-177462a86871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:06.195006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8f30e-972a-4316-8802-177462a86871 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:06.195293 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8f30e-972a-4316-8802-177462a86871 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:06.195570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8f30e-972a-4316-8802-177462a86871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:06.216414 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8f30e-972a-4316-8802-177462a86871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:06.218185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8f30e-972a-4316-8802-177462a86871 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:06.237252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 915/1846] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:08.386693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17ba80-6c31-4c33-8af4-4779171fad89 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:08.394537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3c17ba80-6c31-4c33-8af4-4779171fad89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:08.405604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:08.486809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17ba80-6c31-4c33-8af4-4779171fad89 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:08.489477 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480294ce-afd2-4e75-9231-7273b31c458e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:08.490387 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480294ce-afd2-4e75-9231-7273b31c458e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:08.490824 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480294ce-afd2-4e75-9231-7273b31c458e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:08.491102 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480294ce-afd2-4e75-9231-7273b31c458e admin admin] PATH_INFO: `/v3/users/c2b13299b7624df6a80aa9895ed79165` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:08.493055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480294ce-afd2-4e75-9231-7273b31c458e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b13299b7624df6a80aa9895ed79165)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:08.495279 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480294ce-afd2-4e75-9231-7273b31c458e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:08.671359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8f30e-972a-4316-8802-177462a86871 service nova] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:08.688115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8f30e-972a-4316-8802-177462a86871 service nova] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:08.693008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab1cb5-b47b-4019-89e8-7acb953193cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:08.693919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab1cb5-b47b-4019-89e8-7acb953193cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:08.694199 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab1cb5-b47b-4019-89e8-7acb953193cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:08.694477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab1cb5-b47b-4019-89e8-7acb953193cb admin admin] PATH_INFO: `/v3/users/0915bedaa3ef4fedb35a08607383dbb9` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:08.696362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab1cb5-b47b-4019-89e8-7acb953193cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0915bedaa3ef4fedb35a08607383dbb9)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:08.698490 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab1cb5-b47b-4019-89e8-7acb953193cb admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:08.738021 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-480294ce-afd2-4e75-9231-7273b31c458e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b13299b7624df6a80aa9895ed79165'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:08.750107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-480294ce-afd2-4e75-9231-7273b31c458e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b13299b7624df6a80aa9895ed79165'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:08.759224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-480294ce-afd2-4e75-9231-7273b31c458e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b13299b7624df6a80aa9895ed79165'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:08.760077 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-480294ce-afd2-4e75-9231-7273b31c458e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b13299b7624df6a80aa9895ed79165'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:08.760687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-480294ce-afd2-4e75-9231-7273b31c458e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b13299b7624df6a80aa9895ed79165'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:08.888028 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 932/1847] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:08 2022] DELETE /identity/v3/users/c2b13299b7624df6a80aa9895ed79165 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:08.893499 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262ea00-d832-42e4-a4c6-4b1f38690470 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:08.893899 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262ea00-d832-42e4-a4c6-4b1f38690470 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:08.894171 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262ea00-d832-42e4-a4c6-4b1f38690470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:08.914879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1262ea00-d832-42e4-a4c6-4b1f38690470 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:08.916103 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1262ea00-d832-42e4-a4c6-4b1f38690470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:08.919067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-74ab1cb5-b47b-4019-89e8-7acb953193cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0915bedaa3ef4fedb35a08607383dbb9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:08.932516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-74ab1cb5-b47b-4019-89e8-7acb953193cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0915bedaa3ef4fedb35a08607383dbb9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:08.933339 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-74ab1cb5-b47b-4019-89e8-7acb953193cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0915bedaa3ef4fedb35a08607383dbb9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:08.933978 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-74ab1cb5-b47b-4019-89e8-7acb953193cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0915bedaa3ef4fedb35a08607383dbb9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:08.940806 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-74ab1cb5-b47b-4019-89e8-7acb953193cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0915bedaa3ef4fedb35a08607383dbb9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:08.977636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 933/1848] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:08.987591 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262ea00-d832-42e4-a4c6-4b1f38690470 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:08.989033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1262ea00-d832-42e4-a4c6-4b1f38690470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:09.024743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 916/1849] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:08 2022] DELETE /identity/v3/users/0915bedaa3ef4fedb35a08607383dbb9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:09.029623 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f87f0-9a6e-471c-aa7e-7b4185f8db93 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:09.030197 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f87f0-9a6e-471c-aa7e-7b4185f8db93 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:09.030845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f87f0-9a6e-471c-aa7e-7b4185f8db93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:09.050113 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262ea00-d832-42e4-a4c6-4b1f38690470 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:09.050357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-976f87f0-9a6e-471c-aa7e-7b4185f8db93 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:09.051476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-976f87f0-9a6e-471c-aa7e-7b4185f8db93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:09.104381 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8d387-bdeb-4df5-b726-71a5512ab3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:09.105858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8d387-bdeb-4df5-b726-71a5512ab3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:09.107550 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8d387-bdeb-4df5-b726-71a5512ab3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:09.107919 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8d387-bdeb-4df5-b726-71a5512ab3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:09.109028 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:09.126135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 917/1850] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:09.144805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f87f0-9a6e-471c-aa7e-7b4185f8db93 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:09.146542 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-976f87f0-9a6e-471c-aa7e-7b4185f8db93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:09.159592 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f87f0-9a6e-471c-aa7e-7b4185f8db93 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:09.163609 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9a378-e7c0-4974-bb85-50ec53fffb2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:09.164400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9a378-e7c0-4974-bb85-50ec53fffb2b service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:09.165207 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9a378-e7c0-4974-bb85-50ec53fffb2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:09.165711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9a378-e7c0-4974-bb85-50ec53fffb2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:09.176918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9a378-e7c0-4974-bb85-50ec53fffb2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:09.178444 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9a378-e7c0-4974-bb85-50ec53fffb2b service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:09.186439 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8d387-bdeb-4df5-b726-71a5512ab3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:09.188125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8d387-bdeb-4df5-b726-71a5512ab3f8 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:09.190322 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 918/1851] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:09.202246 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 934/1852] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:09.813173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9a378-e7c0-4974-bb85-50ec53fffb2b service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:09.814658 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-71f9a378-e7c0-4974-bb85-50ec53fffb2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:09.828342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9a378-e7c0-4974-bb85-50ec53fffb2b service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:09.833123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:09.834156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:09.834437 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:09.834893 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb admin admin] PATH_INFO: `/v3/projects/45f9205cd7544fd1b92a078ea8fedb72` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:09.837516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8d387-bdeb-4df5-b726-71a5512ab3f8 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:09.838569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f9205cd7544fd1b92a078ea8fedb72)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:09.839247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1da8d387-bdeb-4df5-b726-71a5512ab3f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:09.840515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:09.873125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8d387-bdeb-4df5-b726-71a5512ab3f8 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:09.884328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:09.885435 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:09.885916 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:09.886143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e admin admin] PATH_INFO: `/v3/projects/8422515ec69540b7b3de5f08dfa77cd9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:09.887447 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8422515ec69540b7b3de5f08dfa77cd9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:09.889920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:09.934265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:09.938362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f9205cd7544fd1b92a078ea8fedb72', 'request_id': 'req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:09.945309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f9205cd7544fd1b92a078ea8fedb72', 'request_id': 'req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.000036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8422515ec69540b7b3de5f08dfa77cd9', 'request_id': 'req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.004618 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f9205cd7544fd1b92a078ea8fedb72', 'request_id': 'req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.016442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb admin admin] The token cache is being invalidate because project 45f9205cd7544fd1b92a078ea8fedb72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:10.016734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.017462 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.019025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 919/1853] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:09 2022] DELETE /identity/v3/projects/45f9205cd7544fd1b92a078ea8fedb72 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:10.022895 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:10.024205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:10.088640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bc5b3-fbb0-4902-b229-9f4f140eb2fb admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:10.098420 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8422515ec69540b7b3de5f08dfa77cd9', 'request_id': 'req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.106145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8422515ec69540b7b3de5f08dfa77cd9', 'request_id': 'req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.117380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e admin admin] The token cache is being invalidate because project 8422515ec69540b7b3de5f08dfa77cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:10.117714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.118474 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.120852 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 935/1854] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:09 2022] DELETE /identity/v3/projects/8422515ec69540b7b3de5f08dfa77cd9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:10.124809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:10.126284 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:10.146089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:10.147759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0809a-dff3-4834-98e7-7e6179231739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:10.148609 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0809a-dff3-4834-98e7-7e6179231739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:10.148879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0809a-dff3-4834-98e7-7e6179231739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:10.149208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0809a-dff3-4834-98e7-7e6179231739 admin admin] PATH_INFO: `/v3/users/4ac4eb4ef24d44baa68e055097fde8de` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:10.150413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0809a-dff3-4834-98e7-7e6179231739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac4eb4ef24d44baa68e055097fde8de)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:10.152531 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0809a-dff3-4834-98e7-7e6179231739 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:10.193377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a3e9b-dcd6-4318-852d-0bf5016b437e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:10.198477 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585606c-9968-436b-9a13-29c4a5aafd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:10.199354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585606c-9968-436b-9a13-29c4a5aafd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:10.199636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585606c-9968-436b-9a13-29c4a5aafd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:10.199913 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585606c-9968-436b-9a13-29c4a5aafd4f admin admin] PATH_INFO: `/v3/users/5466cbd4909942a4b52c78f157330355` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:10.201114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585606c-9968-436b-9a13-29c4a5aafd4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5466cbd4909942a4b52c78f157330355)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:10.203169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585606c-9968-436b-9a13-29c4a5aafd4f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:10.344254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-50f0809a-dff3-4834-98e7-7e6179231739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac4eb4ef24d44baa68e055097fde8de'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.357163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-50f0809a-dff3-4834-98e7-7e6179231739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac4eb4ef24d44baa68e055097fde8de'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.357906 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-50f0809a-dff3-4834-98e7-7e6179231739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac4eb4ef24d44baa68e055097fde8de'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.358526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-50f0809a-dff3-4834-98e7-7e6179231739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac4eb4ef24d44baa68e055097fde8de'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.365399 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-50f0809a-dff3-4834-98e7-7e6179231739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac4eb4ef24d44baa68e055097fde8de'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.414013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9585606c-9968-436b-9a13-29c4a5aafd4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5466cbd4909942a4b52c78f157330355'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.427954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9585606c-9968-436b-9a13-29c4a5aafd4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5466cbd4909942a4b52c78f157330355'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.436742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9585606c-9968-436b-9a13-29c4a5aafd4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5466cbd4909942a4b52c78f157330355'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.443917 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9585606c-9968-436b-9a13-29c4a5aafd4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5466cbd4909942a4b52c78f157330355'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.443917 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9585606c-9968-436b-9a13-29c4a5aafd4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5466cbd4909942a4b52c78f157330355'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:10.462886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:10.468577 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 920/1855] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:10 2022] DELETE /identity/v3/users/4ac4eb4ef24d44baa68e055097fde8de => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:10.530903 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 936/1856] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:10 2022] DELETE /identity/v3/users/5466cbd4909942a4b52c78f157330355 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:11.018275 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0809a-dff3-4834-98e7-7e6179231739 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:11.025731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-50f0809a-dff3-4834-98e7-7e6179231739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:11.034341 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585606c-9968-436b-9a13-29c4a5aafd4f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:11.036023 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9585606c-9968-436b-9a13-29c4a5aafd4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:11.111760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0809a-dff3-4834-98e7-7e6179231739 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:11.131125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585606c-9968-436b-9a13-29c4a5aafd4f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:11.135773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96eedf2-6ecb-4d28-8092-3647d4727fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:11.136604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eedf2-6ecb-4d28-8092-3647d4727fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:11.138704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eedf2-6ecb-4d28-8092-3647d4727fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:11.138704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eedf2-6ecb-4d28-8092-3647d4727fd6 admin admin] PATH_INFO: `/v3/projects/03fc1ecd76ad4978a70eb68df7baa0e1` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:11.138704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96eedf2-6ecb-4d28-8092-3647d4727fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03fc1ecd76ad4978a70eb68df7baa0e1)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:11.140252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96eedf2-6ecb-4d28-8092-3647d4727fd6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:11.171310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cbe2b-7f03-4430-88db-eeb6e9629889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:11.172090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cbe2b-7f03-4430-88db-eeb6e9629889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:11.172367 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cbe2b-7f03-4430-88db-eeb6e9629889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:11.172639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cbe2b-7f03-4430-88db-eeb6e9629889 admin admin] PATH_INFO: `/v3/projects/27b787ca067d4d9dabc26708407147fa` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:11.173918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cbe2b-7f03-4430-88db-eeb6e9629889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b787ca067d4d9dabc26708407147fa)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:11.175857 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cbe2b-7f03-4430-88db-eeb6e9629889 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:11.244706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:11.251918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f96eedf2-6ecb-4d28-8092-3647d4727fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03fc1ecd76ad4978a70eb68df7baa0e1', 'request_id': 'req-f96eedf2-6ecb-4d28-8092-3647d4727fd6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:11.279769 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2b3cbe2b-7f03-4430-88db-eeb6e9629889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b787ca067d4d9dabc26708407147fa', 'request_id': 'req-2b3cbe2b-7f03-4430-88db-eeb6e9629889'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:11.286179 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2b3cbe2b-7f03-4430-88db-eeb6e9629889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b787ca067d4d9dabc26708407147fa', 'request_id': 'req-2b3cbe2b-7f03-4430-88db-eeb6e9629889'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:11.323906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f96eedf2-6ecb-4d28-8092-3647d4727fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03fc1ecd76ad4978a70eb68df7baa0e1', 'request_id': 'req-f96eedf2-6ecb-4d28-8092-3647d4727fd6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:11.334083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f96eedf2-6ecb-4d28-8092-3647d4727fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03fc1ecd76ad4978a70eb68df7baa0e1', 'request_id': 'req-f96eedf2-6ecb-4d28-8092-3647d4727fd6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:11.342866 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f96eedf2-6ecb-4d28-8092-3647d4727fd6 admin admin] The token cache is being invalidate because project 03fc1ecd76ad4978a70eb68df7baa0e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:11.343165 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f96eedf2-6ecb-4d28-8092-3647d4727fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:11.343834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f96eedf2-6ecb-4d28-8092-3647d4727fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:11.345674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 937/1857] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:11 2022] DELETE /identity/v3/projects/03fc1ecd76ad4978a70eb68df7baa0e1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:11.350130 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e76ad-f407-4639-8116-80f3af60d895 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:11.350419 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e76ad-f407-4639-8116-80f3af60d895 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:11.350825 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e76ad-f407-4639-8116-80f3af60d895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:11.370698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d58e76ad-f407-4639-8116-80f3af60d895 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:11.371926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d58e76ad-f407-4639-8116-80f3af60d895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:11.403619 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2b3cbe2b-7f03-4430-88db-eeb6e9629889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b787ca067d4d9dabc26708407147fa', 'request_id': 'req-2b3cbe2b-7f03-4430-88db-eeb6e9629889'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:11.415574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2b3cbe2b-7f03-4430-88db-eeb6e9629889 admin admin] The token cache is being invalidate because project 27b787ca067d4d9dabc26708407147fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:11.415970 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2b3cbe2b-7f03-4430-88db-eeb6e9629889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:11.416616 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2b3cbe2b-7f03-4430-88db-eeb6e9629889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:11.418340 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 921/1858] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:11 2022] DELETE /identity/v3/projects/27b787ca067d4d9dabc26708407147fa => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:11.423181 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9f812-ee66-486a-9a93-b8d51f8fab25 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:11.423417 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9f812-ee66-486a-9a93-b8d51f8fab25 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:11.423696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9f812-ee66-486a-9a93-b8d51f8fab25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:11.433084 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 938/1859] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:11.440755 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090cd7-03fc-4605-98f2-4d8f75b059fc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:11.441036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090cd7-03fc-4605-98f2-4d8f75b059fc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:11.441314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090cd7-03fc-4605-98f2-4d8f75b059fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:11.451389 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-63d9f812-ee66-486a-9a93-b8d51f8fab25 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:11.451389 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-63d9f812-ee66-486a-9a93-b8d51f8fab25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:11.459275 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 922/1860] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:11.461837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c4090cd7-03fc-4605-98f2-4d8f75b059fc None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:11.463228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c4090cd7-03fc-4605-98f2-4d8f75b059fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:11.467859 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd74e1e-2d70-4c5b-83ae-6a15e748a652 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:11.468159 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd74e1e-2d70-4c5b-83ae-6a15e748a652 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:11.468491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd74e1e-2d70-4c5b-83ae-6a15e748a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:11.471473 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 939/1861] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:11.478284 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4090cd7-03fc-4605-98f2-4d8f75b059fc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:11.488055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4090cd7-03fc-4605-98f2-4d8f75b059fc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:11.488497 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-dbd74e1e-2d70-4c5b-83ae-6a15e748a652 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:11.489755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dbd74e1e-2d70-4c5b-83ae-6a15e748a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:11.493387 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff08f5-f261-4dae-a04d-e191f4b24bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:11.494064 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff08f5-f261-4dae-a04d-e191f4b24bbc admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:11.494344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff08f5-f261-4dae-a04d-e191f4b24bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:11.494758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff08f5-f261-4dae-a04d-e191f4b24bbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:11.495484 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff08f5-f261-4dae-a04d-e191f4b24bbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:11.495784 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff08f5-f261-4dae-a04d-e191f4b24bbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:11.497398 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff08f5-f261-4dae-a04d-e191f4b24bbc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:11.497850 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 923/1862] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:11.502237 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd74e1e-2d70-4c5b-83ae-6a15e748a652 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:11.513205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 940/1863] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:35:11.513418 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd74e1e-2d70-4c5b-83ae-6a15e748a652 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:11.514213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff08f5-f261-4dae-a04d-e191f4b24bbc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:11.516622 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e624d7-1810-49fa-a13b-dd57ab7f15a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:11.517310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e624d7-1810-49fa-a13b-dd57ab7f15a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:11.520095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e624d7-1810-49fa-a13b-dd57ab7f15a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:11.520095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e624d7-1810-49fa-a13b-dd57ab7f15a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:11.520095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e624d7-1810-49fa-a13b-dd57ab7f15a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:11.520095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e624d7-1810-49fa-a13b-dd57ab7f15a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:11.520571 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e624d7-1810-49fa-a13b-dd57ab7f15a1 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:11.526116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff08f5-f261-4dae-a04d-e191f4b24bbc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:11.530758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda1033-54fa-4f83-9bb1-a123a555b82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:11.531462 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1033-54fa-4f83-9bb1-a123a555b82a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:11.531749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1033-54fa-4f83-9bb1-a123a555b82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:11.532033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1033-54fa-4f83-9bb1-a123a555b82a admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:11.532725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda1033-54fa-4f83-9bb1-a123a555b82a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:11.533833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 924/1864] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:35:11.534767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda1033-54fa-4f83-9bb1-a123a555b82a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:11.538150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e624d7-1810-49fa-a13b-dd57ab7f15a1 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:11.548814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e624d7-1810-49fa-a13b-dd57ab7f15a1 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:11.553656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e070f8-38bb-4264-bad4-953b643d4aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:11.554313 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e070f8-38bb-4264-bad4-953b643d4aaa admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:11.554603 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e070f8-38bb-4264-bad4-953b643d4aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:11.554908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e070f8-38bb-4264-bad4-953b643d4aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:11.555605 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e070f8-38bb-4264-bad4-953b643d4aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:11.557762 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e070f8-38bb-4264-bad4-953b643d4aaa admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:11.562059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:11.635500 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 941/1865] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:11 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:11.639628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda1033-54fa-4f83-9bb1-a123a555b82a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:11.662060 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 925/1866] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:11 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:11.663066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e070f8-38bb-4264-bad4-953b643d4aaa admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:11.712316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda1033-54fa-4f83-9bb1-a123a555b82a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:11.732662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e070f8-38bb-4264-bad4-953b643d4aaa admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:11.737489 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566608db-85b5-4d9b-9fd7-1272936f0bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:11.738468 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566608db-85b5-4d9b-9fd7-1272936f0bed admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:11.738757 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566608db-85b5-4d9b-9fd7-1272936f0bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:11.739038 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566608db-85b5-4d9b-9fd7-1272936f0bed admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:11.740018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566608db-85b5-4d9b-9fd7-1272936f0bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:11.742171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566608db-85b5-4d9b-9fd7-1272936f0bed admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:11.744385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:11.774509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf61f55-7069-4648-ba50-2e2f6b2e760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:11.775792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf61f55-7069-4648-ba50-2e2f6b2e760f admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:11.776042 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf61f55-7069-4648-ba50-2e2f6b2e760f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:11.776480 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf61f55-7069-4648-ba50-2e2f6b2e760f admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:11.777198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf61f55-7069-4648-ba50-2e2f6b2e760f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:11.779274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf61f55-7069-4648-ba50-2e2f6b2e760f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:11.818942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 926/1867] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:11 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:11.820326 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566608db-85b5-4d9b-9fd7-1272936f0bed admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:11.831161 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566608db-85b5-4d9b-9fd7-1272936f0bed admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:11.835995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3776878-b21a-417d-90cb-551c889857ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:11.837233 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3776878-b21a-417d-90cb-551c889857ef admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:11.837552 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3776878-b21a-417d-90cb-551c889857ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:11.837826 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3776878-b21a-417d-90cb-551c889857ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:11.838559 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3776878-b21a-417d-90cb-551c889857ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:11.840171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3776878-b21a-417d-90cb-551c889857ef admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:11.854415 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 927/1868] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:11.855526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3776878-b21a-417d-90cb-551c889857ef admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:11.865608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3776878-b21a-417d-90cb-551c889857ef admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:11.870352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e9c52-dece-4baa-ab9e-90a505e61d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:11.871117 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e9c52-dece-4baa-ab9e-90a505e61d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:11.871339 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e9c52-dece-4baa-ab9e-90a505e61d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:11.871614 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e9c52-dece-4baa-ab9e-90a505e61d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:11.872333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e9c52-dece-4baa-ab9e-90a505e61d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:11.874255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e9c52-dece-4baa-ab9e-90a505e61d27 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:11.886049 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 928/1869] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:11.890216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e9c52-dece-4baa-ab9e-90a505e61d27 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:11.901113 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e9c52-dece-4baa-ab9e-90a505e61d27 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:11.906224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6fbd5-b466-46f5-92dc-f20d8434112c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:11.907139 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fbd5-b466-46f5-92dc-f20d8434112c admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:11.907404 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fbd5-b466-46f5-92dc-f20d8434112c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:11.907678 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fbd5-b466-46f5-92dc-f20d8434112c admin admin] PATH_INFO: `/v3/projects/8f4c87a3b48548729e3e51d8698cfca6/users/6ee246cf73f447d59210674e1a27c1f2/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:11.909377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 942/1870] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:11 2022] POST /identity/v3/users => generated 290 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:11.912211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf61f55-7069-4648-ba50-2e2f6b2e760f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:11.923743 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf61f55-7069-4648-ba50-2e2f6b2e760f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:11.924392 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6fbd5-b466-46f5-92dc-f20d8434112c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4c87a3b48548729e3e51d8698cfca6, user_id=6ee246cf73f447d59210674e1a27c1f2, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:11.927193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6fbd5-b466-46f5-92dc-f20d8434112c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:11.929591 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e52367-5b6e-458b-a814-fbc285e941bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:11.931679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e52367-5b6e-458b-a814-fbc285e941bc admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:11.931679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e52367-5b6e-458b-a814-fbc285e941bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:11.931998 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e52367-5b6e-458b-a814-fbc285e941bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:11.932940 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e52367-5b6e-458b-a814-fbc285e941bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:11.934745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e52367-5b6e-458b-a814-fbc285e941bc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:11.949535 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 943/1871] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:11.950513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e52367-5b6e-458b-a814-fbc285e941bc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:11.960634 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e52367-5b6e-458b-a814-fbc285e941bc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:11.969525 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45756b3-bd8d-4f59-af5d-0e7a352a5878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:11.969525 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45756b3-bd8d-4f59-af5d-0e7a352a5878 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:11.969525 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45756b3-bd8d-4f59-af5d-0e7a352a5878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:11.969525 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45756b3-bd8d-4f59-af5d-0e7a352a5878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:11.969842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45756b3-bd8d-4f59-af5d-0e7a352a5878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:11.970196 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45756b3-bd8d-4f59-af5d-0e7a352a5878 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:11.989364 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 944/1872] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:11.991534 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45756b3-bd8d-4f59-af5d-0e7a352a5878 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:11.996981 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 929/1873] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:11 2022] PUT /identity/v3/projects/8f4c87a3b48548729e3e51d8698cfca6/users/6ee246cf73f447d59210674e1a27c1f2/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:12.004676 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45756b3-bd8d-4f59-af5d-0e7a352a5878 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:12.013183 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dffa98-e5ef-4866-9960-9536779c8338 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:12.013517 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dffa98-e5ef-4866-9960-9536779c8338 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:12.013807 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dffa98-e5ef-4866-9960-9536779c8338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:12.042683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f0dffa98-e5ef-4866-9960-9536779c8338 None None] MFA Rules not processed for user `6ee246cf73f447d59210674e1a27c1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:12.043918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f0dffa98-e5ef-4866-9960-9536779c8338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:12.069734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c95915-ed47-4af1-9c4c-892e06f57563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:12.071373 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c95915-ed47-4af1-9c4c-892e06f57563 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:12.071658 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c95915-ed47-4af1-9c4c-892e06f57563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:12.071957 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c95915-ed47-4af1-9c4c-892e06f57563 admin admin] PATH_INFO: `/v3/projects/cdb85fc1b08242b6bfd178e4e8683695/users/fa843e7738a94f64997f28028c716830/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:12.088477 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c95915-ed47-4af1-9c4c-892e06f57563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb85fc1b08242b6bfd178e4e8683695, user_id=fa843e7738a94f64997f28028c716830, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:12.091246 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c95915-ed47-4af1-9c4c-892e06f57563 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:12.124834 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 930/1874] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:12.137487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dffa98-e5ef-4866-9960-9536779c8338 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:12.141499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f0dffa98-e5ef-4866-9960-9536779c8338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:12.160801 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:12.169542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 945/1875] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:11 2022] PUT /identity/v3/projects/cdb85fc1b08242b6bfd178e4e8683695/users/fa843e7738a94f64997f28028c716830/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:12.180403 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe336-8a0b-45b4-962b-3abbb8611e1e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:12.180730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe336-8a0b-45b4-962b-3abbb8611e1e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:12.181146 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe336-8a0b-45b4-962b-3abbb8611e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:12.206973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dffa98-e5ef-4866-9960-9536779c8338 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:12.212407 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8defe336-8a0b-45b4-962b-3abbb8611e1e None None] MFA Rules not processed for user `fa843e7738a94f64997f28028c716830`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:12.213735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8defe336-8a0b-45b4-962b-3abbb8611e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:12.267734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed6e28-b11c-4104-85f3-de15ce19b822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:12.268399 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed6e28-b11c-4104-85f3-de15ce19b822 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:12.268687 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed6e28-b11c-4104-85f3-de15ce19b822 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:12.269353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed6e28-b11c-4104-85f3-de15ce19b822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:12.292263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 946/1876] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:12.296655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defe336-8a0b-45b4-962b-3abbb8611e1e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:12.310881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:12.332069 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed6e28-b11c-4104-85f3-de15ce19b822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:12.333559 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed6e28-b11c-4104-85f3-de15ce19b822 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:12.343714 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 931/1877] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:12.363466 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed6e28-b11c-4104-85f3-de15ce19b822 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:12.365318 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defe336-8a0b-45b4-962b-3abbb8611e1e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:12.370672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97416c-52e5-4549-baee-bf0c7d3d295a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:12.371953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97416c-52e5-4549-baee-bf0c7d3d295a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:12.371953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97416c-52e5-4549-baee-bf0c7d3d295a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:12.371953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97416c-52e5-4549-baee-bf0c7d3d295a admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:12.372587 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97416c-52e5-4549-baee-bf0c7d3d295a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:12.374840 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97416c-52e5-4549-baee-bf0c7d3d295a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:12.376533 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed6e28-b11c-4104-85f3-de15ce19b822 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:12.382677 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230b906-1d1c-45ad-a6a2-8fb68d65c0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:12.384433 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230b906-1d1c-45ad-a6a2-8fb68d65c0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:12.384551 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230b906-1d1c-45ad-a6a2-8fb68d65c0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:12.384786 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230b906-1d1c-45ad-a6a2-8fb68d65c0eb admin admin] PATH_INFO: `/v3/users/6ee246cf73f447d59210674e1a27c1f2` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:12.386087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230b906-1d1c-45ad-a6a2-8fb68d65c0eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee246cf73f447d59210674e1a27c1f2)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:12.388023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230b906-1d1c-45ad-a6a2-8fb68d65c0eb admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:12.497741 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 947/1878] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:12 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:12.502440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97416c-52e5-4549-baee-bf0c7d3d295a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:12.567141 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97416c-52e5-4549-baee-bf0c7d3d295a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:12.572437 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eecb20-8434-475c-8098-a16372b99fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:12.573133 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eecb20-8434-475c-8098-a16372b99fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:12.573451 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eecb20-8434-475c-8098-a16372b99fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:12.573726 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eecb20-8434-475c-8098-a16372b99fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:12.574427 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eecb20-8434-475c-8098-a16372b99fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:12.576357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eecb20-8434-475c-8098-a16372b99fc1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:12.599054 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d230b906-1d1c-45ad-a6a2-8fb68d65c0eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee246cf73f447d59210674e1a27c1f2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:12.611156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d230b906-1d1c-45ad-a6a2-8fb68d65c0eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee246cf73f447d59210674e1a27c1f2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:12.611925 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d230b906-1d1c-45ad-a6a2-8fb68d65c0eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee246cf73f447d59210674e1a27c1f2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:12.616184 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d230b906-1d1c-45ad-a6a2-8fb68d65c0eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee246cf73f447d59210674e1a27c1f2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:12.619588 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d230b906-1d1c-45ad-a6a2-8fb68d65c0eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee246cf73f447d59210674e1a27c1f2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:12.696458 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 948/1879] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:12 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:12.700339 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eecb20-8434-475c-8098-a16372b99fc1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:12.702012 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-33eecb20-8434-475c-8098-a16372b99fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:12.714639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eecb20-8434-475c-8098-a16372b99fc1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:12.718356 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 932/1880] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:12 2022] DELETE /identity/v3/users/6ee246cf73f447d59210674e1a27c1f2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:12.721311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca82bd-aa01-4328-9fe6-7fc58c853d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:12.721311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca82bd-aa01-4328-9fe6-7fc58c853d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:12.721311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca82bd-aa01-4328-9fe6-7fc58c853d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:12.721311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca82bd-aa01-4328-9fe6-7fc58c853d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:12.721685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca82bd-aa01-4328-9fe6-7fc58c853d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:12.722726 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca82bd-aa01-4328-9fe6-7fc58c853d80 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:12.722846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eece67-b362-4c79-afe2-7dad4a79aff1 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:12.723076 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eece67-b362-4c79-afe2-7dad4a79aff1 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:12.723382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eece67-b362-4c79-afe2-7dad4a79aff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:12.729738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:12.735130 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 949/1881] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:12.739255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca82bd-aa01-4328-9fe6-7fc58c853d80 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:12.743382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-14eece67-b362-4c79-afe2-7dad4a79aff1 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:12.744594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-14eece67-b362-4c79-afe2-7dad4a79aff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:12.750863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca82bd-aa01-4328-9fe6-7fc58c853d80 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:12.810902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 933/1882] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:12.811353 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f2b81-c18f-4d99-ac79-57c38630d442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:12.812274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f2b81-c18f-4d99-ac79-57c38630d442 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:12.812557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f2b81-c18f-4d99-ac79-57c38630d442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:12.812832 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f2b81-c18f-4d99-ac79-57c38630d442 admin admin] PATH_INFO: `/v3/projects/2d0f0a76cacc4b36a75455ed20e520c5/users/7763561147ee46a2b3840147d95df281/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:12.819157 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eece67-b362-4c79-afe2-7dad4a79aff1 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:12.821853 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-14eece67-b362-4c79-afe2-7dad4a79aff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:12.830010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f2b81-c18f-4d99-ac79-57c38630d442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0f0a76cacc4b36a75455ed20e520c5, user_id=7763561147ee46a2b3840147d95df281, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:12.832731 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f2b81-c18f-4d99-ac79-57c38630d442 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:12.881838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eece67-b362-4c79-afe2-7dad4a79aff1 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:12.886390 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e667f-b140-4ecf-b099-15aaad85ddb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:12.887050 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e667f-b140-4ecf-b099-15aaad85ddb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:12.887342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e667f-b140-4ecf-b099-15aaad85ddb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:12.887619 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e667f-b140-4ecf-b099-15aaad85ddb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:12.897271 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e667f-b140-4ecf-b099-15aaad85ddb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:12.898845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e667f-b140-4ecf-b099-15aaad85ddb1 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:12.913038 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 934/1883] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:12.943097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:12.949102 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 950/1884] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:12 2022] PUT /identity/v3/projects/2d0f0a76cacc4b36a75455ed20e520c5/users/7763561147ee46a2b3840147d95df281/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:12.952992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e667f-b140-4ecf-b099-15aaad85ddb1 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:12.963041 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e667f-b140-4ecf-b099-15aaad85ddb1 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:13.036579 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc63a55-3737-4548-80fd-4876e6419356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:13.037455 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc63a55-3737-4548-80fd-4876e6419356 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:13.037840 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc63a55-3737-4548-80fd-4876e6419356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:13.038214 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc63a55-3737-4548-80fd-4876e6419356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:13.039073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc63a55-3737-4548-80fd-4876e6419356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:13.041528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc63a55-3737-4548-80fd-4876e6419356 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:13.053406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 935/1885] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:13.057408 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f2b81-c18f-4d99-ac79-57c38630d442 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:13.069376 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f2b81-c18f-4d99-ac79-57c38630d442 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:13.074238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a8800-14f2-4273-b7c1-fd427622a7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:13.075144 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a8800-14f2-4273-b7c1-fd427622a7ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:13.075451 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a8800-14f2-4273-b7c1-fd427622a7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:13.075727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a8800-14f2-4273-b7c1-fd427622a7ee admin admin] PATH_INFO: `/v3/projects/2d0f0a76cacc4b36a75455ed20e520c5/users/7763561147ee46a2b3840147d95df281/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:13.078044 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a8800-14f2-4273-b7c1-fd427622a7ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0f0a76cacc4b36a75455ed20e520c5, user_id=7763561147ee46a2b3840147d95df281, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:13.081082 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a8800-14f2-4273-b7c1-fd427622a7ee admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:13.092988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 951/1886] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:13 2022] PUT /identity/v3/projects/2d0f0a76cacc4b36a75455ed20e520c5/users/7763561147ee46a2b3840147d95df281/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:13.104400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe95c2e-4594-4778-ab98-99fe270967d4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:13.104692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe95c2e-4594-4778-ab98-99fe270967d4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:13.104972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe95c2e-4594-4778-ab98-99fe270967d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:13.176850 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3fe95c2e-4594-4778-ab98-99fe270967d4 None None] MFA Rules not processed for user `7763561147ee46a2b3840147d95df281`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:13.179640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3fe95c2e-4594-4778-ab98-99fe270967d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:13.228667 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:13.278760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 936/1887] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:13.287188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a8800-14f2-4273-b7c1-fd427622a7ee admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:13.291434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-749a8800-14f2-4273-b7c1-fd427622a7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:13.373804 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a8800-14f2-4273-b7c1-fd427622a7ee admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:13.389093 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d59324-bfce-4c79-baaa-d6714c0dbfd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:13.394241 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d59324-bfce-4c79-baaa-d6714c0dbfd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:13.394639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d59324-bfce-4c79-baaa-d6714c0dbfd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:13.395002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d59324-bfce-4c79-baaa-d6714c0dbfd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:13.413865 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d59324-bfce-4c79-baaa-d6714c0dbfd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:13.415844 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d59324-bfce-4c79-baaa-d6714c0dbfd6 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:13.426563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 952/1888] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:13.522440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe95c2e-4594-4778-ab98-99fe270967d4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:13.523923 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3fe95c2e-4594-4778-ab98-99fe270967d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:13.598006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe95c2e-4594-4778-ab98-99fe270967d4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:13.603171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f9e95-228a-4434-9e56-bc839f516a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:13.604274 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f9e95-228a-4434-9e56-bc839f516a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:13.604558 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f9e95-228a-4434-9e56-bc839f516a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:13.604832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f9e95-228a-4434-9e56-bc839f516a1c admin admin] PATH_INFO: `/v3/projects/8f4c87a3b48548729e3e51d8698cfca6` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:13.606077 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f9e95-228a-4434-9e56-bc839f516a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f4c87a3b48548729e3e51d8698cfca6)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:13.607990 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f9e95-228a-4434-9e56-bc839f516a1c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:13.760892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1d1f9e95-228a-4434-9e56-bc839f516a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f4c87a3b48548729e3e51d8698cfca6', 'request_id': 'req-1d1f9e95-228a-4434-9e56-bc839f516a1c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:13.767393 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1d1f9e95-228a-4434-9e56-bc839f516a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f4c87a3b48548729e3e51d8698cfca6', 'request_id': 'req-1d1f9e95-228a-4434-9e56-bc839f516a1c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:13.878394 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1d1f9e95-228a-4434-9e56-bc839f516a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f4c87a3b48548729e3e51d8698cfca6', 'request_id': 'req-1d1f9e95-228a-4434-9e56-bc839f516a1c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:13.890365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1d1f9e95-228a-4434-9e56-bc839f516a1c admin admin] The token cache is being invalidate because project 8f4c87a3b48548729e3e51d8698cfca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:13.890712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1d1f9e95-228a-4434-9e56-bc839f516a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:13.891399 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1d1f9e95-228a-4434-9e56-bc839f516a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:13.892931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 937/1889] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:13 2022] DELETE /identity/v3/projects/8f4c87a3b48548729e3e51d8698cfca6 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:13.897805 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df0e61-e0ce-4998-bff2-f20b0f71d54c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:13.898091 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df0e61-e0ce-4998-bff2-f20b0f71d54c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:13.898366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df0e61-e0ce-4998-bff2-f20b0f71d54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:13.917828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a2df0e61-e0ce-4998-bff2-f20b0f71d54c None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:13.919054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a2df0e61-e0ce-4998-bff2-f20b0f71d54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:13.980928 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 953/1890] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:13.989998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cece2-c65f-4b09-bd23-178ab1bf8ed6 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:13.990546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cece2-c65f-4b09-bd23-178ab1bf8ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:13.990927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cece2-c65f-4b09-bd23-178ab1bf8ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:14.023664 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f26cece2-c65f-4b09-bd23-178ab1bf8ed6 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:14.024815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f26cece2-c65f-4b09-bd23-178ab1bf8ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:14.033128 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 938/1891] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:14.037446 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df0e61-e0ce-4998-bff2-f20b0f71d54c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:14.047977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df0e61-e0ce-4998-bff2-f20b0f71d54c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:14.052723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff282a-59c7-4f6e-9c63-c742f239f216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:14.053423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff282a-59c7-4f6e-9c63-c742f239f216 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:14.053705 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff282a-59c7-4f6e-9c63-c742f239f216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:14.054044 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff282a-59c7-4f6e-9c63-c742f239f216 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:14.055441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff282a-59c7-4f6e-9c63-c742f239f216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:14.055743 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff282a-59c7-4f6e-9c63-c742f239f216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:14.057355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff282a-59c7-4f6e-9c63-c742f239f216 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:14.069211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 954/1892] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:35:14.073877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cece2-c65f-4b09-bd23-178ab1bf8ed6 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:14.083383 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cece2-c65f-4b09-bd23-178ab1bf8ed6 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:14.088502 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6e006-90cc-4231-b266-3289730de3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:14.093928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6e006-90cc-4231-b266-3289730de3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:14.093928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6e006-90cc-4231-b266-3289730de3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:14.093928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6e006-90cc-4231-b266-3289730de3c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:14.093928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6e006-90cc-4231-b266-3289730de3c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:14.093928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6e006-90cc-4231-b266-3289730de3c2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:14.208841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 939/1893] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:14 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:14.213637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff282a-59c7-4f6e-9c63-c742f239f216 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:14.223891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff282a-59c7-4f6e-9c63-c742f239f216 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:14.285430 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed01850-fe04-41c1-a259-74bc6a6ba636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:14.286203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed01850-fe04-41c1-a259-74bc6a6ba636 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:14.286639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed01850-fe04-41c1-a259-74bc6a6ba636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:14.286920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed01850-fe04-41c1-a259-74bc6a6ba636 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:14.287631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed01850-fe04-41c1-a259-74bc6a6ba636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:14.291305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed01850-fe04-41c1-a259-74bc6a6ba636 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:14.385438 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 955/1894] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:14 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:14.387142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6e006-90cc-4231-b266-3289730de3c2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:14.397700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6e006-90cc-4231-b266-3289730de3c2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:14.404728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b262c-da60-48ad-90b7-7a548136b247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:14.405943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b262c-da60-48ad-90b7-7a548136b247 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:14.405943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b262c-da60-48ad-90b7-7a548136b247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:14.405943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b262c-da60-48ad-90b7-7a548136b247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:14.406887 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b262c-da60-48ad-90b7-7a548136b247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:14.408495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b262c-da60-48ad-90b7-7a548136b247 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:14.425312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 940/1895] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:14.426733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed01850-fe04-41c1-a259-74bc6a6ba636 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:14.437956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed01850-fe04-41c1-a259-74bc6a6ba636 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:14.443964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26622dc6-0263-4d04-9fcf-13a43498b3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:14.444805 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26622dc6-0263-4d04-9fcf-13a43498b3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:14.445090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26622dc6-0263-4d04-9fcf-13a43498b3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:14.445697 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26622dc6-0263-4d04-9fcf-13a43498b3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:14.446344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26622dc6-0263-4d04-9fcf-13a43498b3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:14.448021 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26622dc6-0263-4d04-9fcf-13a43498b3d2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:14.449671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:14.462208 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 956/1896] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:14.466896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b262c-da60-48ad-90b7-7a548136b247 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:14.483458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b262c-da60-48ad-90b7-7a548136b247 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:14.488755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a6189-ff39-43e1-bce2-0b3f69f63cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:14.489716 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a6189-ff39-43e1-bce2-0b3f69f63cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:14.489993 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a6189-ff39-43e1-bce2-0b3f69f63cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:14.490274 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a6189-ff39-43e1-bce2-0b3f69f63cc3 admin admin] PATH_INFO: `/v3/projects/acee507a7cb64a14b21fcedc7669fc11/users/54d759c03b1b41f0b9023b12cb470da6/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:14.528314 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a6189-ff39-43e1-bce2-0b3f69f63cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acee507a7cb64a14b21fcedc7669fc11, user_id=54d759c03b1b41f0b9023b12cb470da6, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:14.534113 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a6189-ff39-43e1-bce2-0b3f69f63cc3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:14.541311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:14.635254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26622dc6-0263-4d04-9fcf-13a43498b3d2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:14.638598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-26622dc6-0263-4d04-9fcf-13a43498b3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:14.660253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 941/1897] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:14 2022] PUT /identity/v3/projects/acee507a7cb64a14b21fcedc7669fc11/users/54d759c03b1b41f0b9023b12cb470da6/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:14.661982 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdf36f-ff59-4622-8ff3-5e5e7c1fe9a8 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:14.662351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdf36f-ff59-4622-8ff3-5e5e7c1fe9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:14.662592 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdf36f-ff59-4622-8ff3-5e5e7c1fe9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:14.738410 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-fbbdf36f-ff59-4622-8ff3-5e5e7c1fe9a8 None None] MFA Rules not processed for user `54d759c03b1b41f0b9023b12cb470da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:14.739811 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fbbdf36f-ff59-4622-8ff3-5e5e7c1fe9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:14.806644 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26622dc6-0263-4d04-9fcf-13a43498b3d2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:14.857580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 942/1898] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:14.862360 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdf36f-ff59-4622-8ff3-5e5e7c1fe9a8 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:14.879842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add7912-0fc5-455d-935c-3a2fe2bbb2c4 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7763561147ee46a2b3840147d95df281', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d0f0a76cacc4b36a75455ed20e520c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:14.880626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add7912-0fc5-455d-935c-3a2fe2bbb2c4 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:14.881045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add7912-0fc5-455d-935c-3a2fe2bbb2c4 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:14.881580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add7912-0fc5-455d-935c-3a2fe2bbb2c4 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:14.882403 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add7912-0fc5-455d-935c-3a2fe2bbb2c4 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:14.882793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add7912-0fc5-455d-935c-3a2fe2bbb2c4 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:14.884771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add7912-0fc5-455d-935c-3a2fe2bbb2c4 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:14.897310 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 957/1899] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:35:14.901688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add7912-0fc5-455d-935c-3a2fe2bbb2c4 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:14.912381 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add7912-0fc5-455d-935c-3a2fe2bbb2c4 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:14.918093 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d0400-d843-4b6a-8e1c-1520cf57ac40 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7763561147ee46a2b3840147d95df281', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d0f0a76cacc4b36a75455ed20e520c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:14.918766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d0400-d843-4b6a-8e1c-1520cf57ac40 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:14.919048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d0400-d843-4b6a-8e1c-1520cf57ac40 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:14.919325 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d0400-d843-4b6a-8e1c-1520cf57ac40 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:14.920021 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d0400-d843-4b6a-8e1c-1520cf57ac40 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:14.921985 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d0400-d843-4b6a-8e1c-1520cf57ac40 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:14.940383 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdf36f-ff59-4622-8ff3-5e5e7c1fe9a8 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:14.945206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc35b6-eaa3-4fee-a931-3f0cb7aad9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:14.945998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc35b6-eaa3-4fee-a931-3f0cb7aad9fb admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:14.946290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc35b6-eaa3-4fee-a931-3f0cb7aad9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:14.947296 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc35b6-eaa3-4fee-a931-3f0cb7aad9fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:14.947468 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc35b6-eaa3-4fee-a931-3f0cb7aad9fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:14.949466 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc35b6-eaa3-4fee-a931-3f0cb7aad9fb admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:15.038034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 958/1900] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:14 2022] POST /identity/v3/projects => generated 354 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:15.038990 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d0400-d843-4b6a-8e1c-1520cf57ac40 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:15.047487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 943/1901] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:14 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:15.049627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc35b6-eaa3-4fee-a931-3f0cb7aad9fb admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:15.122223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc35b6-eaa3-4fee-a931-3f0cb7aad9fb admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:15.127162 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d0400-d843-4b6a-8e1c-1520cf57ac40 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:15.127332 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8f11c-9e84-495d-b9c0-93eeb72be7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:15.128017 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8f11c-9e84-495d-b9c0-93eeb72be7ef admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:15.128410 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8f11c-9e84-495d-b9c0-93eeb72be7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:15.128700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8f11c-9e84-495d-b9c0-93eeb72be7ef admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:15.129467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8f11c-9e84-495d-b9c0-93eeb72be7ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:15.131569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8f11c-9e84-495d-b9c0-93eeb72be7ef admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:15.149519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:15.190004 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222f72f-bc06-46f8-b6b2-e14e25d902ce tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7763561147ee46a2b3840147d95df281', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d0f0a76cacc4b36a75455ed20e520c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:15.190686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222f72f-bc06-46f8-b6b2-e14e25d902ce tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:15.193550 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222f72f-bc06-46f8-b6b2-e14e25d902ce tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:15.193550 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222f72f-bc06-46f8-b6b2-e14e25d902ce tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:15.193550 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222f72f-bc06-46f8-b6b2-e14e25d902ce tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:15.193550 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222f72f-bc06-46f8-b6b2-e14e25d902ce tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:15.193867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222f72f-bc06-46f8-b6b2-e14e25d902ce tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:15.205567 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 959/1902] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:35:15.213683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:15.219773 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 944/1903] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:15 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:15.225011 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222f72f-bc06-46f8-b6b2-e14e25d902ce tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:15.236311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222f72f-bc06-46f8-b6b2-e14e25d902ce tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:15.243047 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a03217-7462-47d2-8428-50924c71c0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:15.243732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a03217-7462-47d2-8428-50924c71c0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:15.244021 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a03217-7462-47d2-8428-50924c71c0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:15.244299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a03217-7462-47d2-8428-50924c71c0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:15.245027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a03217-7462-47d2-8428-50924c71c0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:15.246848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a03217-7462-47d2-8428-50924c71c0a2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:15.259852 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 960/1904] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:15.264620 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8f11c-9e84-495d-b9c0-93eeb72be7ef admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:15.275556 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8f11c-9e84-495d-b9c0-93eeb72be7ef admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:15.280395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed5e40-7108-4423-91d9-e401298f117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:15.281299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed5e40-7108-4423-91d9-e401298f117f admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:15.281612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed5e40-7108-4423-91d9-e401298f117f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:15.281889 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed5e40-7108-4423-91d9-e401298f117f admin admin] PATH_INFO: `/v3/projects/6f70714d52c34674a2ffa0a91fafed0b/users/9a6db57e80c74edcab50ee1d17973327/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:15.297804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed5e40-7108-4423-91d9-e401298f117f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f70714d52c34674a2ffa0a91fafed0b, user_id=9a6db57e80c74edcab50ee1d17973327, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:15.300432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed5e40-7108-4423-91d9-e401298f117f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:15.394342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 945/1905] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:15 2022] PUT /identity/v3/projects/6f70714d52c34674a2ffa0a91fafed0b/users/9a6db57e80c74edcab50ee1d17973327/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:15.396778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a03217-7462-47d2-8428-50924c71c0a2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:15.407876 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a03217-7462-47d2-8428-50924c71c0a2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:15.467281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bbeeb-b5ef-48cb-9170-4b586690a87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:15.467976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bbeeb-b5ef-48cb-9170-4b586690a87f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:15.468263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bbeeb-b5ef-48cb-9170-4b586690a87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:15.468540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bbeeb-b5ef-48cb-9170-4b586690a87f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:15.469268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bbeeb-b5ef-48cb-9170-4b586690a87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:15.470967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bbeeb-b5ef-48cb-9170-4b586690a87f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:15.481770 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 961/1906] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:15.485867 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed5e40-7108-4423-91d9-e401298f117f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:15.503391 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed5e40-7108-4423-91d9-e401298f117f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:15.509131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecca8a9-4b5c-436d-992f-dfb6893c3687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:15.510968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecca8a9-4b5c-436d-992f-dfb6893c3687 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:15.511283 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecca8a9-4b5c-436d-992f-dfb6893c3687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:15.511565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecca8a9-4b5c-436d-992f-dfb6893c3687 admin admin] PATH_INFO: `/v3/projects/6f70714d52c34674a2ffa0a91fafed0b/users/9a6db57e80c74edcab50ee1d17973327/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:15.513757 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecca8a9-4b5c-436d-992f-dfb6893c3687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f70714d52c34674a2ffa0a91fafed0b, user_id=9a6db57e80c74edcab50ee1d17973327, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:15.516883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecca8a9-4b5c-436d-992f-dfb6893c3687 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:15.537882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 946/1907] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:15 2022] PUT /identity/v3/projects/6f70714d52c34674a2ffa0a91fafed0b/users/9a6db57e80c74edcab50ee1d17973327/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:15.557461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eae5f-e42a-4135-a784-b5245e41d6fb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:15.557461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eae5f-e42a-4135-a784-b5245e41d6fb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:15.557461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eae5f-e42a-4135-a784-b5245e41d6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:15.563477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecca8a9-4b5c-436d-992f-dfb6893c3687 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:15.584759 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0e6eae5f-e42a-4135-a784-b5245e41d6fb None None] MFA Rules not processed for user `9a6db57e80c74edcab50ee1d17973327`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:15.587315 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0e6eae5f-e42a-4135-a784-b5245e41d6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:15.655092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecca8a9-4b5c-436d-992f-dfb6893c3687 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:15.662042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfa901-8557-4059-b7d7-9c35e72e05a3 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7763561147ee46a2b3840147d95df281', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d0f0a76cacc4b36a75455ed20e520c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:15.669413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfa901-8557-4059-b7d7-9c35e72e05a3 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:15.669413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfa901-8557-4059-b7d7-9c35e72e05a3 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:15.669413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfa901-8557-4059-b7d7-9c35e72e05a3 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] PATH_INFO: `/v3/projects/fdd07ce3c4ec4e86added2c9c5c738c8` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:15.669413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfa901-8557-4059-b7d7-9c35e72e05a3 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fdd07ce3c4ec4e86added2c9c5c738c8)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:15.669858 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfa901-8557-4059-b7d7-9c35e72e05a3 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:15.708655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 962/1908] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:15 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:15.709544 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6eae5f-e42a-4135-a784-b5245e41d6fb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:15.710799 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0e6eae5f-e42a-4135-a784-b5245e41d6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:15.741265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:15.777765 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6eae5f-e42a-4135-a784-b5245e41d6fb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:15.782507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6bcaf-c271-4165-98b1-cd82b70d55a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:15.783389 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6bcaf-c271-4165-98b1-cd82b70d55a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:15.783673 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6bcaf-c271-4165-98b1-cd82b70d55a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:15.783948 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6bcaf-c271-4165-98b1-cd82b70d55a3 admin admin] PATH_INFO: `/v3/users/4c9fb5f5cdd74a69b856bde0d61c65bb` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:15.785263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6bcaf-c271-4165-98b1-cd82b70d55a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c9fb5f5cdd74a69b856bde0d61c65bb)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:15.787360 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6bcaf-c271-4165-98b1-cd82b70d55a3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:15.864271 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f1bfa901-8557-4059-b7d7-9c35e72e05a3 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdd07ce3c4ec4e86added2c9c5c738c8', 'request_id': 'req-f1bfa901-8557-4059-b7d7-9c35e72e05a3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:15.873940 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f1bfa901-8557-4059-b7d7-9c35e72e05a3 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdd07ce3c4ec4e86added2c9c5c738c8', 'request_id': 'req-f1bfa901-8557-4059-b7d7-9c35e72e05a3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:15.947533 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f1bfa901-8557-4059-b7d7-9c35e72e05a3 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdd07ce3c4ec4e86added2c9c5c738c8', 'request_id': 'req-f1bfa901-8557-4059-b7d7-9c35e72e05a3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:15.958791 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f1bfa901-8557-4059-b7d7-9c35e72e05a3 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] The token cache is being invalidate because project fdd07ce3c4ec4e86added2c9c5c738c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:15.959081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f1bfa901-8557-4059-b7d7-9c35e72e05a3 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:15.959745 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f1bfa901-8557-4059-b7d7-9c35e72e05a3 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:15.961476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 947/1909] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:15 2022] DELETE /identity/v3/projects/fdd07ce3c4ec4e86added2c9c5c738c8 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:15.962291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfa901-8557-4059-b7d7-9c35e72e05a3 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:15.963597 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f1bfa901-8557-4059-b7d7-9c35e72e05a3 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:16.033899 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfa901-8557-4059-b7d7-9c35e72e05a3 tempest-VolumeQuotaClassesTest-1873339009 tempest-VolumeQuotaClassesTest-1873339009-project-admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:16.037584 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e07a1-acab-4ade-8e26-1ac23f8c6597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:16.038238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e07a1-acab-4ade-8e26-1ac23f8c6597 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:16.038521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e07a1-acab-4ade-8e26-1ac23f8c6597 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:16.038796 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e07a1-acab-4ade-8e26-1ac23f8c6597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:16.041303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-417e07a1-acab-4ade-8e26-1ac23f8c6597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:16.046677 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:16.069518 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0ef6bcaf-c271-4165-98b1-cd82b70d55a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c9fb5f5cdd74a69b856bde0d61c65bb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:16.084526 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0ef6bcaf-c271-4165-98b1-cd82b70d55a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c9fb5f5cdd74a69b856bde0d61c65bb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:16.091881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0ef6bcaf-c271-4165-98b1-cd82b70d55a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c9fb5f5cdd74a69b856bde0d61c65bb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:16.092610 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0ef6bcaf-c271-4165-98b1-cd82b70d55a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c9fb5f5cdd74a69b856bde0d61c65bb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:16.093340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0ef6bcaf-c271-4165-98b1-cd82b70d55a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c9fb5f5cdd74a69b856bde0d61c65bb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:16.103496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e07a1-acab-4ade-8e26-1ac23f8c6597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:16.104961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e07a1-acab-4ade-8e26-1ac23f8c6597 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:16.114065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 948/1910] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:16.186744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 963/1911] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:15 2022] DELETE /identity/v3/users/4c9fb5f5cdd74a69b856bde0d61c65bb => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:16.191566 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc262b7-e824-4e00-918f-4386a1aa3396 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:16.192060 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc262b7-e824-4e00-918f-4386a1aa3396 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:16.192141 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc262b7-e824-4e00-918f-4386a1aa3396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:16.215710 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-abc262b7-e824-4e00-918f-4386a1aa3396 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:16.216989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-abc262b7-e824-4e00-918f-4386a1aa3396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:16.281523 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 949/1912] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:16.293188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6bcaf-c271-4165-98b1-cd82b70d55a3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:16.294674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0ef6bcaf-c271-4165-98b1-cd82b70d55a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:16.350619 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d73dd-4620-467e-9d86-ee248ff79ee9 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:16.350923 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d73dd-4620-467e-9d86-ee248ff79ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:16.351103 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d73dd-4620-467e-9d86-ee248ff79ee9 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:16.353727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 950/1913] 10.222.0.52 () {54 vars in 921 bytes} [Fri Jun 17 07:35:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:35:16.355055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6bcaf-c271-4165-98b1-cd82b70d55a3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:16.358765 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c029e4-e281-4e90-af8d-604c08a9a607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:16.359441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c029e4-e281-4e90-af8d-604c08a9a607 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:16.359711 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c029e4-e281-4e90-af8d-604c08a9a607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:16.359989 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c029e4-e281-4e90-af8d-604c08a9a607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:16.363537 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773869db-d17d-4a7b-91b6-6b5b0a7bbdd9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:16.364177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773869db-d17d-4a7b-91b6-6b5b0a7bbdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:16.364403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773869db-d17d-4a7b-91b6-6b5b0a7bbdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:16.370522 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c029e4-e281-4e90-af8d-604c08a9a607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:16.372108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c029e4-e281-4e90-af8d-604c08a9a607 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:16.384818 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 964/1914] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:16.385524 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-773869db-d17d-4a7b-91b6-6b5b0a7bbdd9 None None] MFA Rules not processed for user `88e1572d22c048b09699a2fe50900f92`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:16.386739 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-773869db-d17d-4a7b-91b6-6b5b0a7bbdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:16.457866 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 951/1915] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Jun 17 07:35:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:16.473477 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c029e4-e281-4e90-af8d-604c08a9a607 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:16.476673 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-69c029e4-e281-4e90-af8d-604c08a9a607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:16.498698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c029e4-e281-4e90-af8d-604c08a9a607 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:16.505105 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b8fa5-4947-422d-9554-3c5f9bde41f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:16.505835 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b8fa5-4947-422d-9554-3c5f9bde41f5 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:16.506267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b8fa5-4947-422d-9554-3c5f9bde41f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:16.506725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b8fa5-4947-422d-9554-3c5f9bde41f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:16.518537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b8fa5-4947-422d-9554-3c5f9bde41f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:16.520642 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b8fa5-4947-422d-9554-3c5f9bde41f5 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:16.535264 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 965/1916] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:16.866191 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773869db-d17d-4a7b-91b6-6b5b0a7bbdd9 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:16.867755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-773869db-d17d-4a7b-91b6-6b5b0a7bbdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:16.881722 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773869db-d17d-4a7b-91b6-6b5b0a7bbdd9 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:16.887182 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c7b63-afb6-4180-accb-3a4c67348d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:16.888130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c7b63-afb6-4180-accb-3a4c67348d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:16.888413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c7b63-afb6-4180-accb-3a4c67348d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:16.888694 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c7b63-afb6-4180-accb-3a4c67348d83 admin admin] PATH_INFO: `/v3/users/fa843e7738a94f64997f28028c716830` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:16.890178 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c7b63-afb6-4180-accb-3a4c67348d83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa843e7738a94f64997f28028c716830)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:16.892168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c7b63-afb6-4180-accb-3a4c67348d83 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:17.043024 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b8fa5-4947-422d-9554-3c5f9bde41f5 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:17.044744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-922b8fa5-4947-422d-9554-3c5f9bde41f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:17.092251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b8fa5-4947-422d-9554-3c5f9bde41f5 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:17.112504 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:17.113160 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:17.118572 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:17.125703 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:17.125703 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39 admin admin] PATH_INFO: `/v3/projects/d1752235e1664d719ed3186aba3167ca` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:17.125703 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1752235e1664d719ed3186aba3167ca)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:17.130424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:17.138179 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3d1c7b63-afb6-4180-accb-3a4c67348d83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa843e7738a94f64997f28028c716830'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:17.160566 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3d1c7b63-afb6-4180-accb-3a4c67348d83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa843e7738a94f64997f28028c716830'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:17.161070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3d1c7b63-afb6-4180-accb-3a4c67348d83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa843e7738a94f64997f28028c716830'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:17.161699 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3d1c7b63-afb6-4180-accb-3a4c67348d83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa843e7738a94f64997f28028c716830'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:17.181151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3d1c7b63-afb6-4180-accb-3a4c67348d83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa843e7738a94f64997f28028c716830'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:17.271020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:17.312218 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 952/1917] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:16 2022] DELETE /identity/v3/users/fa843e7738a94f64997f28028c716830 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:17.314004 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877a94f-566d-47b1-89b9-a98c91567eca None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:17.314293 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877a94f-566d-47b1-89b9-a98c91567eca None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:17.314575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877a94f-566d-47b1-89b9-a98c91567eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:17.322367 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1752235e1664d719ed3186aba3167ca', 'request_id': 'req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:17.346884 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8877a94f-566d-47b1-89b9-a98c91567eca None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:17.348129 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8877a94f-566d-47b1-89b9-a98c91567eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:17.420766 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 953/1918] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:17.455636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1752235e1664d719ed3186aba3167ca', 'request_id': 'req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:17.470557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1752235e1664d719ed3186aba3167ca', 'request_id': 'req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:17.478059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877a94f-566d-47b1-89b9-a98c91567eca None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:17.479644 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8877a94f-566d-47b1-89b9-a98c91567eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:17.499628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39 admin admin] The token cache is being invalidate because project d1752235e1664d719ed3186aba3167ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:17.499628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:17.501882 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:17.508731 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 966/1919] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:17 2022] DELETE /identity/v3/projects/d1752235e1664d719ed3186aba3167ca => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:17.510117 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:17.512262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:17.585855 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877a94f-566d-47b1-89b9-a98c91567eca None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:17.591813 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df08c4f-e3a0-4558-bbfd-b8984ff0513c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:17.592711 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df08c4f-e3a0-4558-bbfd-b8984ff0513c service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:17.592989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df08c4f-e3a0-4558-bbfd-b8984ff0513c service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:17.593264 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df08c4f-e3a0-4558-bbfd-b8984ff0513c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:17.595624 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8df08c4f-e3a0-4558-bbfd-b8984ff0513c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:17.599734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9c5c6-71ef-4885-ad2d-30e2ed2e0f39 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:17.606297 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92819624-893a-4f6c-aec3-5dedac1ab719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:17.607405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92819624-893a-4f6c-aec3-5dedac1ab719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:17.607838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92819624-893a-4f6c-aec3-5dedac1ab719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:17.608451 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92819624-893a-4f6c-aec3-5dedac1ab719 admin admin] PATH_INFO: `/v3/users/79ab10c83b594f15b5ee91c9a99889d9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:17.609960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92819624-893a-4f6c-aec3-5dedac1ab719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ab10c83b594f15b5ee91c9a99889d9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:17.611113 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df08c4f-e3a0-4558-bbfd-b8984ff0513c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:17.613380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df08c4f-e3a0-4558-bbfd-b8984ff0513c service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:17.614304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92819624-893a-4f6c-aec3-5dedac1ab719 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:17.625601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 954/1920] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:17.903358 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-92819624-893a-4f6c-aec3-5dedac1ab719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ab10c83b594f15b5ee91c9a99889d9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:17.922068 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-92819624-893a-4f6c-aec3-5dedac1ab719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ab10c83b594f15b5ee91c9a99889d9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:17.933939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-92819624-893a-4f6c-aec3-5dedac1ab719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ab10c83b594f15b5ee91c9a99889d9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:17.934835 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-92819624-893a-4f6c-aec3-5dedac1ab719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ab10c83b594f15b5ee91c9a99889d9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:17.935571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-92819624-893a-4f6c-aec3-5dedac1ab719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ab10c83b594f15b5ee91c9a99889d9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:18.052287 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 967/1921] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:17 2022] DELETE /identity/v3/users/79ab10c83b594f15b5ee91c9a99889d9 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:19.061605 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df08c4f-e3a0-4558-bbfd-b8984ff0513c service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:19.063780 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8df08c4f-e3a0-4558-bbfd-b8984ff0513c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:19.075638 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df08c4f-e3a0-4558-bbfd-b8984ff0513c service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:19.102986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92819624-893a-4f6c-aec3-5dedac1ab719 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:19.106145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-92819624-893a-4f6c-aec3-5dedac1ab719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:19.143108 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:19.153969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:19.155381 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:19.155744 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:19.156280 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671 admin admin] PATH_INFO: `/v3/projects/cdb85fc1b08242b6bfd178e4e8683695` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:19.157685 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb85fc1b08242b6bfd178e4e8683695)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:19.160370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:19.218060 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:19.245543 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92819624-893a-4f6c-aec3-5dedac1ab719 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:19.251110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6e1cb-8042-4362-b53a-834bdd10c401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:19.252373 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6e1cb-8042-4362-b53a-834bdd10c401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:19.252836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6e1cb-8042-4362-b53a-834bdd10c401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:19.253253 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6e1cb-8042-4362-b53a-834bdd10c401 admin admin] PATH_INFO: `/v3/projects/d6fda8e192d84ea38ce090a8e722be27` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:19.254727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6e1cb-8042-4362-b53a-834bdd10c401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6fda8e192d84ea38ce090a8e722be27)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:19.261339 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6e1cb-8042-4362-b53a-834bdd10c401 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:19.269162 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb85fc1b08242b6bfd178e4e8683695', 'request_id': 'req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:19.276906 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb85fc1b08242b6bfd178e4e8683695', 'request_id': 'req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:19.378082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb85fc1b08242b6bfd178e4e8683695', 'request_id': 'req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:19.390193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671 admin admin] The token cache is being invalidate because project cdb85fc1b08242b6bfd178e4e8683695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:19.390482 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:19.391199 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:19.392796 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 955/1922] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:19 2022] DELETE /identity/v3/projects/cdb85fc1b08242b6bfd178e4e8683695 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:19.396639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:19.397985 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:19.433024 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-80b6e1cb-8042-4362-b53a-834bdd10c401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6fda8e192d84ea38ce090a8e722be27', 'request_id': 'req-80b6e1cb-8042-4362-b53a-834bdd10c401'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:19.462852 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3fc7b-1f00-4462-84cb-a3a7e8c9c671 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:19.498222 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-80b6e1cb-8042-4362-b53a-834bdd10c401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6fda8e192d84ea38ce090a8e722be27', 'request_id': 'req-80b6e1cb-8042-4362-b53a-834bdd10c401'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:19.509031 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-80b6e1cb-8042-4362-b53a-834bdd10c401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6fda8e192d84ea38ce090a8e722be27', 'request_id': 'req-80b6e1cb-8042-4362-b53a-834bdd10c401'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:19.526901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc486b5-b88f-4e2a-8e41-1ecd9b49a58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:19.527804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc486b5-b88f-4e2a-8e41-1ecd9b49a58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:19.528143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc486b5-b88f-4e2a-8e41-1ecd9b49a58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:19.528429 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc486b5-b88f-4e2a-8e41-1ecd9b49a58e admin admin] PATH_INFO: `/v3/users/7763561147ee46a2b3840147d95df281` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:19.528846 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-80b6e1cb-8042-4362-b53a-834bdd10c401 admin admin] The token cache is being invalidate because project d6fda8e192d84ea38ce090a8e722be27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:19.529363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-80b6e1cb-8042-4362-b53a-834bdd10c401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:19.529774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc486b5-b88f-4e2a-8e41-1ecd9b49a58e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7763561147ee46a2b3840147d95df281)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:19.530284 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-80b6e1cb-8042-4362-b53a-834bdd10c401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:19.531760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc486b5-b88f-4e2a-8e41-1ecd9b49a58e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:19.532278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 968/1923] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:19 2022] DELETE /identity/v3/projects/d6fda8e192d84ea38ce090a8e722be27 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:19.543397 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b93ee-1c75-41f1-a9a1-d0fb9cd7981b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:19.543397 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b93ee-1c75-41f1-a9a1-d0fb9cd7981b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:19.543397 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b93ee-1c75-41f1-a9a1-d0fb9cd7981b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:19.566726 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c70b93ee-1c75-41f1-a9a1-d0fb9cd7981b None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:19.570600 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c70b93ee-1c75-41f1-a9a1-d0fb9cd7981b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:19.580014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 969/1924] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:19.590482 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51379f77-37ea-4f97-94ed-ed2f16cd3032 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:19.592443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51379f77-37ea-4f97-94ed-ed2f16cd3032 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:19.592443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51379f77-37ea-4f97-94ed-ed2f16cd3032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:19.611060 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-51379f77-37ea-4f97-94ed-ed2f16cd3032 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:19.612449 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-51379f77-37ea-4f97-94ed-ed2f16cd3032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:19.622152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 970/1925] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:19.626639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51379f77-37ea-4f97-94ed-ed2f16cd3032 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:19.637084 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51379f77-37ea-4f97-94ed-ed2f16cd3032 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:19.645019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0062f-7552-4808-8392-d6f4104dd48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:19.645904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0062f-7552-4808-8392-d6f4104dd48a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:19.646184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0062f-7552-4808-8392-d6f4104dd48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:19.646463 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0062f-7552-4808-8392-d6f4104dd48a admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:19.647230 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0062f-7552-4808-8392-d6f4104dd48a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:19.647537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0062f-7552-4808-8392-d6f4104dd48a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:19.649666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0062f-7552-4808-8392-d6f4104dd48a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:19.661962 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 971/1926] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:35:19.666314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0062f-7552-4808-8392-d6f4104dd48a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:19.676288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0062f-7552-4808-8392-d6f4104dd48a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:19.681790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96618a9f-a831-492d-946c-5977e53c4293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:19.682464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96618a9f-a831-492d-946c-5977e53c4293 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:19.682751 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96618a9f-a831-492d-946c-5977e53c4293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:19.683030 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96618a9f-a831-492d-946c-5977e53c4293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:19.683734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96618a9f-a831-492d-946c-5977e53c4293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:19.686254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96618a9f-a831-492d-946c-5977e53c4293 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:19.810467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8dc486b5-b88f-4e2a-8e41-1ecd9b49a58e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7763561147ee46a2b3840147d95df281'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:19.824662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8dc486b5-b88f-4e2a-8e41-1ecd9b49a58e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7763561147ee46a2b3840147d95df281'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:19.828780 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 972/1927] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:19 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:19.828928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8dc486b5-b88f-4e2a-8e41-1ecd9b49a58e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7763561147ee46a2b3840147d95df281'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:19.828928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8dc486b5-b88f-4e2a-8e41-1ecd9b49a58e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7763561147ee46a2b3840147d95df281'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:19.829496 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96618a9f-a831-492d-946c-5977e53c4293 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:19.832685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-96618a9f-a831-492d-946c-5977e53c4293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:19.835531 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8dc486b5-b88f-4e2a-8e41-1ecd9b49a58e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7763561147ee46a2b3840147d95df281'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:19.914762 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96618a9f-a831-492d-946c-5977e53c4293 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:19.920035 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938cecd-9c3a-47a0-b819-4c1c5d5a115c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:19.920751 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938cecd-9c3a-47a0-b819-4c1c5d5a115c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:19.921855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938cecd-9c3a-47a0-b819-4c1c5d5a115c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:19.921855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938cecd-9c3a-47a0-b819-4c1c5d5a115c admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:19.922049 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938cecd-9c3a-47a0-b819-4c1c5d5a115c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:19.923927 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938cecd-9c3a-47a0-b819-4c1c5d5a115c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:19.946185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 956/1928] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:19 2022] DELETE /identity/v3/users/7763561147ee46a2b3840147d95df281 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:20.000000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 973/1929] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:19 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:20.004155 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc486b5-b88f-4e2a-8e41-1ecd9b49a58e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:20.083045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc486b5-b88f-4e2a-8e41-1ecd9b49a58e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:20.088195 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb34af7-4477-4e26-aa49-ef9d588e7d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:20.088871 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb34af7-4477-4e26-aa49-ef9d588e7d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:20.089152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb34af7-4477-4e26-aa49-ef9d588e7d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:20.089456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb34af7-4477-4e26-aa49-ef9d588e7d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:20.090186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb34af7-4477-4e26-aa49-ef9d588e7d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:20.091819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb34af7-4477-4e26-aa49-ef9d588e7d1b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:20.102915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 957/1930] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:20.107007 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938cecd-9c3a-47a0-b819-4c1c5d5a115c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:20.117850 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938cecd-9c3a-47a0-b819-4c1c5d5a115c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:20.122986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f58744-01d9-4ae2-bc8b-3402888ea72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:20.123934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f58744-01d9-4ae2-bc8b-3402888ea72f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:20.124221 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f58744-01d9-4ae2-bc8b-3402888ea72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:20.124504 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f58744-01d9-4ae2-bc8b-3402888ea72f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:20.125380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f58744-01d9-4ae2-bc8b-3402888ea72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:20.129958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f58744-01d9-4ae2-bc8b-3402888ea72f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:20.138065 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 974/1931] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:20.143919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb34af7-4477-4e26-aa49-ef9d588e7d1b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:20.158149 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb34af7-4477-4e26-aa49-ef9d588e7d1b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:20.165828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7545b6d-2ca1-402b-aa2f-86c3622a14e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:20.166844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7545b6d-2ca1-402b-aa2f-86c3622a14e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:20.167324 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7545b6d-2ca1-402b-aa2f-86c3622a14e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:20.168089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7545b6d-2ca1-402b-aa2f-86c3622a14e1 admin admin] PATH_INFO: `/v3/projects/0630f1bc055d408b84337213de3c767b/users/72e2d9053a994afab567b3c4a478ddc7/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:20.188764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7545b6d-2ca1-402b-aa2f-86c3622a14e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0630f1bc055d408b84337213de3c767b, user_id=72e2d9053a994afab567b3c4a478ddc7, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:20.191588 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7545b6d-2ca1-402b-aa2f-86c3622a14e1 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:20.292583 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 958/1932] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:20 2022] PUT /identity/v3/projects/0630f1bc055d408b84337213de3c767b/users/72e2d9053a994afab567b3c4a478ddc7/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:20.302967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2616b8d-2dd0-42d2-95e5-6b565b3cfea1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:20.303517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2616b8d-2dd0-42d2-95e5-6b565b3cfea1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:20.303815 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2616b8d-2dd0-42d2-95e5-6b565b3cfea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:20.334440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a2616b8d-2dd0-42d2-95e5-6b565b3cfea1 None None] MFA Rules not processed for user `72e2d9053a994afab567b3c4a478ddc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:20.335861 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a2616b8d-2dd0-42d2-95e5-6b565b3cfea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:20.413399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 975/1933] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:20.416188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7545b6d-2ca1-402b-aa2f-86c3622a14e1 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:20.483614 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7545b6d-2ca1-402b-aa2f-86c3622a14e1 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:20.488452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3347f5-609c-4ec5-a29d-1a3bf43e8a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:20.489135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3347f5-609c-4ec5-a29d-1a3bf43e8a5f admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:20.489441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3347f5-609c-4ec5-a29d-1a3bf43e8a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:20.489721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3347f5-609c-4ec5-a29d-1a3bf43e8a5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:20.490433 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3347f5-609c-4ec5-a29d-1a3bf43e8a5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:20.492961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3347f5-609c-4ec5-a29d-1a3bf43e8a5f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:20.513507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2616b8d-2dd0-42d2-95e5-6b565b3cfea1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:20.515223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a2616b8d-2dd0-42d2-95e5-6b565b3cfea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:20.530479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2616b8d-2dd0-42d2-95e5-6b565b3cfea1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:20.535785 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6af5f-4974-4901-a5d5-5be50ccfb37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:20.536693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6af5f-4974-4901-a5d5-5be50ccfb37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:20.537006 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6af5f-4974-4901-a5d5-5be50ccfb37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:20.546364 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6af5f-4974-4901-a5d5-5be50ccfb37b admin admin] PATH_INFO: `/v3/projects/2d0f0a76cacc4b36a75455ed20e520c5` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:20.546364 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6af5f-4974-4901-a5d5-5be50ccfb37b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d0f0a76cacc4b36a75455ed20e520c5)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:20.546364 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6af5f-4974-4901-a5d5-5be50ccfb37b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:20.594615 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 959/1934] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:20 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:20.598947 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3347f5-609c-4ec5-a29d-1a3bf43e8a5f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:20.658120 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b4c6af5f-4974-4901-a5d5-5be50ccfb37b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d0f0a76cacc4b36a75455ed20e520c5', 'request_id': 'req-b4c6af5f-4974-4901-a5d5-5be50ccfb37b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:20.663609 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3347f5-609c-4ec5-a29d-1a3bf43e8a5f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:20.667392 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:20.712427 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b4c6af5f-4974-4901-a5d5-5be50ccfb37b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d0f0a76cacc4b36a75455ed20e520c5', 'request_id': 'req-b4c6af5f-4974-4901-a5d5-5be50ccfb37b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:20.722379 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b4c6af5f-4974-4901-a5d5-5be50ccfb37b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d0f0a76cacc4b36a75455ed20e520c5', 'request_id': 'req-b4c6af5f-4974-4901-a5d5-5be50ccfb37b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:20.725257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:20.732734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343180da-666f-42cf-8ed4-2a0e7862895f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:20.733448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343180da-666f-42cf-8ed4-2a0e7862895f admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:20.733946 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343180da-666f-42cf-8ed4-2a0e7862895f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:20.734137 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343180da-666f-42cf-8ed4-2a0e7862895f admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:20.734818 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343180da-666f-42cf-8ed4-2a0e7862895f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:20.736892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343180da-666f-42cf-8ed4-2a0e7862895f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:20.738099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b4c6af5f-4974-4901-a5d5-5be50ccfb37b admin admin] The token cache is being invalidate because project 2d0f0a76cacc4b36a75455ed20e520c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:20.738352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b4c6af5f-4974-4901-a5d5-5be50ccfb37b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:20.739576 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b4c6af5f-4974-4901-a5d5-5be50ccfb37b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:20.746660 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 976/1935] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:20 2022] DELETE /identity/v3/projects/2d0f0a76cacc4b36a75455ed20e520c5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:20.748843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bda8d-22fa-4129-9072-6fee0576fca1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:20.749116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bda8d-22fa-4129-9072-6fee0576fca1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:20.749433 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bda8d-22fa-4129-9072-6fee0576fca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:20.768272 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-799bda8d-22fa-4129-9072-6fee0576fca1 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:20.769540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-799bda8d-22fa-4129-9072-6fee0576fca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:20.780928 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 977/1936] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:20.785907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8101a-e522-4c9b-a0b9-a1074e56fbb8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:20.786236 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8101a-e522-4c9b-a0b9-a1074e56fbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:20.786521 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8101a-e522-4c9b-a0b9-a1074e56fbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:20.803412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 960/1937] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:20 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:20.808287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343180da-666f-42cf-8ed4-2a0e7862895f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:20.810135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-343180da-666f-42cf-8ed4-2a0e7862895f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:20.813909 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-14b8101a-e522-4c9b-a0b9-a1074e56fbb8 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:20.815388 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-14b8101a-e522-4c9b-a0b9-a1074e56fbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:20.823295 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343180da-666f-42cf-8ed4-2a0e7862895f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:20.826556 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 978/1938] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:20.828750 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa2354-baa5-4316-bce9-7fbccb9540f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:20.829496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa2354-baa5-4316-bce9-7fbccb9540f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:20.829850 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa2354-baa5-4316-bce9-7fbccb9540f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:20.830122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa2354-baa5-4316-bce9-7fbccb9540f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:20.830847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa2354-baa5-4316-bce9-7fbccb9540f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:20.830951 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8101a-e522-4c9b-a0b9-a1074e56fbb8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:20.832451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa2354-baa5-4316-bce9-7fbccb9540f8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:20.841404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8101a-e522-4c9b-a0b9-a1074e56fbb8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:20.847542 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 961/1939] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:20.847740 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76b550-b336-4b1c-9160-da761ef49360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:20.848480 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76b550-b336-4b1c-9160-da761ef49360 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:20.848699 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa2354-baa5-4316-bce9-7fbccb9540f8 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:20.848817 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76b550-b336-4b1c-9160-da761ef49360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:20.849063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76b550-b336-4b1c-9160-da761ef49360 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:20.849920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76b550-b336-4b1c-9160-da761ef49360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:20.850253 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76b550-b336-4b1c-9160-da761ef49360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:20.852370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76b550-b336-4b1c-9160-da761ef49360 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:20.859540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa2354-baa5-4316-bce9-7fbccb9540f8 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:20.865224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65df2e-3cf9-47f4-9e8d-e0943f93b1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:20.866057 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 979/1940] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:35:20.866424 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65df2e-3cf9-47f4-9e8d-e0943f93b1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:20.866891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65df2e-3cf9-47f4-9e8d-e0943f93b1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:20.867270 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65df2e-3cf9-47f4-9e8d-e0943f93b1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:20.868243 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65df2e-3cf9-47f4-9e8d-e0943f93b1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:20.869904 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65df2e-3cf9-47f4-9e8d-e0943f93b1c6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:20.875552 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76b550-b336-4b1c-9160-da761ef49360 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:20.883583 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 962/1941] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:20.887627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65df2e-3cf9-47f4-9e8d-e0943f93b1c6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:20.888299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76b550-b336-4b1c-9160-da761ef49360 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:20.892882 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86577a62-47f9-4533-afab-002f8540f0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:20.893591 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86577a62-47f9-4533-afab-002f8540f0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:20.893878 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86577a62-47f9-4533-afab-002f8540f0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:20.894155 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86577a62-47f9-4533-afab-002f8540f0f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:20.894864 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86577a62-47f9-4533-afab-002f8540f0f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:20.896797 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86577a62-47f9-4533-afab-002f8540f0f6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:20.900525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65df2e-3cf9-47f4-9e8d-e0943f93b1c6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:20.905807 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f868b-025e-4618-9d70-6ac76bb1e282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:20.906712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f868b-025e-4618-9d70-6ac76bb1e282 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:20.907099 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f868b-025e-4618-9d70-6ac76bb1e282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:20.907380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f868b-025e-4618-9d70-6ac76bb1e282 admin admin] PATH_INFO: `/v3/projects/44aaa3ff42444f09816532b00acc718b/users/68d8e345c8014e7e8a2edf1ec26a7035/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:20.923756 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f868b-025e-4618-9d70-6ac76bb1e282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44aaa3ff42444f09816532b00acc718b, user_id=68d8e345c8014e7e8a2edf1ec26a7035, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:20.927023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f868b-025e-4618-9d70-6ac76bb1e282 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:20.976939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 980/1942] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:20 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:20.978814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86577a62-47f9-4533-afab-002f8540f0f6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:21.002899 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 963/1943] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:20 2022] PUT /identity/v3/projects/44aaa3ff42444f09816532b00acc718b/users/68d8e345c8014e7e8a2edf1ec26a7035/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:21.015486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c2bb-322b-4dbc-b94c-733086c05fe9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:21.015928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c2bb-322b-4dbc-b94c-733086c05fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:21.016289 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c2bb-322b-4dbc-b94c-733086c05fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:21.046656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-56a1c2bb-322b-4dbc-b94c-733086c05fe9 None None] MFA Rules not processed for user `68d8e345c8014e7e8a2edf1ec26a7035`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:21.047377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86577a62-47f9-4533-afab-002f8540f0f6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:21.047802 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-56a1c2bb-322b-4dbc-b94c-733086c05fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:21.113303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dd171-7514-4a48-bb1c-bf6c24920c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:21.114014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dd171-7514-4a48-bb1c-bf6c24920c21 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:21.114336 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dd171-7514-4a48-bb1c-bf6c24920c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:21.114645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dd171-7514-4a48-bb1c-bf6c24920c21 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:21.115544 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dd171-7514-4a48-bb1c-bf6c24920c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:21.118163 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dd171-7514-4a48-bb1c-bf6c24920c21 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:21.126567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 964/1944] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:21.130854 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1c2bb-322b-4dbc-b94c-733086c05fe9 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:21.142604 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1c2bb-322b-4dbc-b94c-733086c05fe9 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:21.147421 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d88d8-2b2b-4c99-af67-ca9b7b252c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:21.148220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d88d8-2b2b-4c99-af67-ca9b7b252c2c admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:21.148642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d88d8-2b2b-4c99-af67-ca9b7b252c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:21.148976 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d88d8-2b2b-4c99-af67-ca9b7b252c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:21.149954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d88d8-2b2b-4c99-af67-ca9b7b252c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:21.152023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d88d8-2b2b-4c99-af67-ca9b7b252c2c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:21.223965 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 981/1945] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:20 2022] POST /identity/v3/users => generated 295 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:21.227883 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dd171-7514-4a48-bb1c-bf6c24920c21 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:21.237677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dd171-7514-4a48-bb1c-bf6c24920c21 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:21.243065 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30cd8d-9333-428d-a533-13c04adf9955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:21.243720 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30cd8d-9333-428d-a533-13c04adf9955 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:21.244005 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30cd8d-9333-428d-a533-13c04adf9955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:21.244285 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30cd8d-9333-428d-a533-13c04adf9955 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:21.245406 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30cd8d-9333-428d-a533-13c04adf9955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:21.247036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30cd8d-9333-428d-a533-13c04adf9955 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:21.256296 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 965/1946] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:21 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:21.261415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 982/1947] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:21.261563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d88d8-2b2b-4c99-af67-ca9b7b252c2c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:21.262410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30cd8d-9333-428d-a533-13c04adf9955 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:21.272134 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30cd8d-9333-428d-a533-13c04adf9955 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:21.324403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d88d8-2b2b-4c99-af67-ca9b7b252c2c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:21.329585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240de89c-b5d0-4b23-909d-d620d379c3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:21.330127 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca49a5d-d5cc-453e-b982-2e67a3070954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:21.330300 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240de89c-b5d0-4b23-909d-d620d379c3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:21.330573 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240de89c-b5d0-4b23-909d-d620d379c3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:21.330797 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca49a5d-d5cc-453e-b982-2e67a3070954 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:21.330891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240de89c-b5d0-4b23-909d-d620d379c3f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:21.331081 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca49a5d-d5cc-453e-b982-2e67a3070954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:21.331359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca49a5d-d5cc-453e-b982-2e67a3070954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:21.331551 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240de89c-b5d0-4b23-909d-d620d379c3f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:21.332081 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca49a5d-d5cc-453e-b982-2e67a3070954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:21.333539 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240de89c-b5d0-4b23-909d-d620d379c3f7 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:21.333704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca49a5d-d5cc-453e-b982-2e67a3070954 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:21.344374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 983/1948] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:21.344563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:21.348523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca49a5d-d5cc-453e-b982-2e67a3070954 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:21.358950 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca49a5d-d5cc-453e-b982-2e67a3070954 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:21.363650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5c9c2-e255-40dd-b99e-337cf0c062c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:21.364533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5c9c2-e255-40dd-b99e-337cf0c062c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:21.364814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5c9c2-e255-40dd-b99e-337cf0c062c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:21.365094 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5c9c2-e255-40dd-b99e-337cf0c062c7 admin admin] PATH_INFO: `/v3/projects/da6fb5274a7e467ba288d5648be41475/users/28ff626deced43d88698a70b88550325/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:21.380814 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5c9c2-e255-40dd-b99e-337cf0c062c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6fb5274a7e467ba288d5648be41475, user_id=28ff626deced43d88698a70b88550325, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:21.383907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5c9c2-e255-40dd-b99e-337cf0c062c7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:21.431150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:21.470670 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 984/1950] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:21 2022] PUT /identity/v3/projects/da6fb5274a7e467ba288d5648be41475/users/28ff626deced43d88698a70b88550325/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:21.470917 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 966/1950] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:21 2022] POST /identity/v3/users => generated 296 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:21.479285 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5c9c2-e255-40dd-b99e-337cf0c062c7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:21.481993 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885a876-3255-4ddf-bbf9-b17222d34d6a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:21.482422 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885a876-3255-4ddf-bbf9-b17222d34d6a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:21.482729 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885a876-3255-4ddf-bbf9-b17222d34d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:21.545135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a885a876-3255-4ddf-bbf9-b17222d34d6a None None] MFA Rules not processed for user `28ff626deced43d88698a70b88550325`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:21.546621 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a885a876-3255-4ddf-bbf9-b17222d34d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:21.582304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5c9c2-e255-40dd-b99e-337cf0c062c7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:21.588017 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82886762-057e-4ae6-a6d2-398132d1f372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:21.588607 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82886762-057e-4ae6-a6d2-398132d1f372 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:21.588890 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82886762-057e-4ae6-a6d2-398132d1f372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:21.589170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82886762-057e-4ae6-a6d2-398132d1f372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:21.589960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82886762-057e-4ae6-a6d2-398132d1f372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:21.591618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82886762-057e-4ae6-a6d2-398132d1f372 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:21.606754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 985/1951] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:21.607800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82886762-057e-4ae6-a6d2-398132d1f372 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:21.618454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82886762-057e-4ae6-a6d2-398132d1f372 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:21.623119 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfd934-ec51-470b-afb4-d474ec4cb11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:21.624274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfd934-ec51-470b-afb4-d474ec4cb11b admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:21.624563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfd934-ec51-470b-afb4-d474ec4cb11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:21.624846 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfd934-ec51-470b-afb4-d474ec4cb11b admin admin] PATH_INFO: `/v3/projects/eb00d19943ee42ea8baac2a76ee00a63/users/b1b7596404794e4682182fe5935b4676/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:21.630327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 967/1952] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:21.631102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885a876-3255-4ddf-bbf9-b17222d34d6a None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:21.641020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfd934-ec51-470b-afb4-d474ec4cb11b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb00d19943ee42ea8baac2a76ee00a63, user_id=b1b7596404794e4682182fe5935b4676, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:21.642397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885a876-3255-4ddf-bbf9-b17222d34d6a None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:21.643923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfd934-ec51-470b-afb4-d474ec4cb11b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:21.647828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eca7af-840b-4352-85c3-180b33bad234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:21.648580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eca7af-840b-4352-85c3-180b33bad234 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:21.648877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eca7af-840b-4352-85c3-180b33bad234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:21.649303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eca7af-840b-4352-85c3-180b33bad234 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:21.649899 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eca7af-840b-4352-85c3-180b33bad234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:21.651831 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eca7af-840b-4352-85c3-180b33bad234 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:21.704370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 986/1953] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:21 2022] PUT /identity/v3/projects/eb00d19943ee42ea8baac2a76ee00a63/users/b1b7596404794e4682182fe5935b4676/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:21.708278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfd934-ec51-470b-afb4-d474ec4cb11b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:21.709787 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:21.769422 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfd934-ec51-470b-afb4-d474ec4cb11b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:21.774984 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 968/1954] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:21 2022] POST /identity/v3/projects => generated 389 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:21.775132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a66fb-cf8b-4c2d-a9ce-8a9b2866f72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:21.775457 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a66fb-cf8b-4c2d-a9ce-8a9b2866f72b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:21.775742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a66fb-cf8b-4c2d-a9ce-8a9b2866f72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:21.776070 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a66fb-cf8b-4c2d-a9ce-8a9b2866f72b admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:21.776862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a66fb-cf8b-4c2d-a9ce-8a9b2866f72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:21.778535 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a66fb-cf8b-4c2d-a9ce-8a9b2866f72b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:21.778872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eca7af-840b-4352-85c3-180b33bad234 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:21.789698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 987/1955] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:21.795759 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a66fb-cf8b-4c2d-a9ce-8a9b2866f72b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:21.798517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:21.807866 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a66fb-cf8b-4c2d-a9ce-8a9b2866f72b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:21.845906 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eca7af-840b-4352-85c3-180b33bad234 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:21.854737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e405216-3801-4659-8df8-3def21b5b756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:21.855501 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e405216-3801-4659-8df8-3def21b5b756 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:21.855841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e405216-3801-4659-8df8-3def21b5b756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:21.856169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e405216-3801-4659-8df8-3def21b5b756 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:21.856921 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e405216-3801-4659-8df8-3def21b5b756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:21.862347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e405216-3801-4659-8df8-3def21b5b756 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:21.865523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115dedc-5c86-4296-a151-2366670d2a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:21.866435 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115dedc-5c86-4296-a151-2366670d2a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:21.866717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115dedc-5c86-4296-a151-2366670d2a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:21.867036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115dedc-5c86-4296-a151-2366670d2a30 admin admin] PATH_INFO: `/v3/projects/eb00d19943ee42ea8baac2a76ee00a63/users/b1b7596404794e4682182fe5935b4676/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:21.869193 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115dedc-5c86-4296-a151-2366670d2a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb00d19943ee42ea8baac2a76ee00a63, user_id=b1b7596404794e4682182fe5935b4676, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:21.871944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115dedc-5c86-4296-a151-2366670d2a30 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:21.885317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 988/1956] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:21 2022] PUT /identity/v3/projects/eb00d19943ee42ea8baac2a76ee00a63/users/b1b7596404794e4682182fe5935b4676/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:21.895243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2a6a6-1dc9-4213-92de-e474df10fae6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:21.895535 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2a6a6-1dc9-4213-92de-e474df10fae6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:21.895817 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2a6a6-1dc9-4213-92de-e474df10fae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:21.928277 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a3c2a6a6-1dc9-4213-92de-e474df10fae6 None None] MFA Rules not processed for user `b1b7596404794e4682182fe5935b4676`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:21.930061 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a3c2a6a6-1dc9-4213-92de-e474df10fae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:21.939572 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 969/1957] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:21 2022] POST /identity/v3/users => generated 301 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:21.944709 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:21.946706 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e405216-3801-4659-8df8-3def21b5b756 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:21.958605 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e405216-3801-4659-8df8-3def21b5b756 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:22.017586 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 989/1958] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:22.019178 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:22.022167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0d244-6703-47e2-b1c0-6efc92b3fef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:22.022927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0d244-6703-47e2-b1c0-6efc92b3fef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:22.027050 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0d244-6703-47e2-b1c0-6efc92b3fef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:22.027050 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0d244-6703-47e2-b1c0-6efc92b3fef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:22.027050 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0d244-6703-47e2-b1c0-6efc92b3fef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:22.027050 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0d244-6703-47e2-b1c0-6efc92b3fef8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:22.029503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2a6a6-1dc9-4213-92de-e474df10fae6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:22.030976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a3c2a6a6-1dc9-4213-92de-e474df10fae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:22.037369 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 970/1959] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:22.041993 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0d244-6703-47e2-b1c0-6efc92b3fef8 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:22.052444 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0d244-6703-47e2-b1c0-6efc92b3fef8 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:22.057217 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177fd5b-6db6-4e54-9bfb-711025391ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:22.058128 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177fd5b-6db6-4e54-9bfb-711025391ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:22.058406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177fd5b-6db6-4e54-9bfb-711025391ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:22.058677 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177fd5b-6db6-4e54-9bfb-711025391ba1 admin admin] PATH_INFO: `/v3/projects/df9bb657639041b0b7a41f96b04f1660/users/7a63ee6da424468d882afa672bb0b488/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:22.074774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177fd5b-6db6-4e54-9bfb-711025391ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9bb657639041b0b7a41f96b04f1660, user_id=7a63ee6da424468d882afa672bb0b488, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:22.077787 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177fd5b-6db6-4e54-9bfb-711025391ba1 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:22.093664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2a6a6-1dc9-4213-92de-e474df10fae6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:22.097183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7af5a-b330-4309-951f-8ac8a13b68fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:22.097893 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7af5a-b330-4309-951f-8ac8a13b68fe service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:22.098173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7af5a-b330-4309-951f-8ac8a13b68fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:22.098447 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7af5a-b330-4309-951f-8ac8a13b68fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:22.107551 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7af5a-b330-4309-951f-8ac8a13b68fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:22.108991 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7af5a-b330-4309-951f-8ac8a13b68fe service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:22.118668 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 990/1960] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:22.144110 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 971/1961] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:22 2022] PUT /identity/v3/projects/df9bb657639041b0b7a41f96b04f1660/users/7a63ee6da424468d882afa672bb0b488/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:22.148034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7af5a-b330-4309-951f-8ac8a13b68fe service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:22.159015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7af5a-b330-4309-951f-8ac8a13b68fe service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:22.219579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740e2b0-c850-4ca1-bd89-0b9a55d266a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:22.220270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740e2b0-c850-4ca1-bd89-0b9a55d266a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:22.220554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740e2b0-c850-4ca1-bd89-0b9a55d266a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:22.220833 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740e2b0-c850-4ca1-bd89-0b9a55d266a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:22.221588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740e2b0-c850-4ca1-bd89-0b9a55d266a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:22.223350 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740e2b0-c850-4ca1-bd89-0b9a55d266a3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:22.240568 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 991/1962] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:22.241629 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177fd5b-6db6-4e54-9bfb-711025391ba1 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:22.244818 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740e2b0-c850-4ca1-bd89-0b9a55d266a3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:22.247283 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4740e2b0-c850-4ca1-bd89-0b9a55d266a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:22.252908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177fd5b-6db6-4e54-9bfb-711025391ba1 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:22.258464 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639aa67-49fb-43cb-9a7c-cb9fe11873f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:22.259367 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639aa67-49fb-43cb-9a7c-cb9fe11873f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:22.259756 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639aa67-49fb-43cb-9a7c-cb9fe11873f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:22.260029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639aa67-49fb-43cb-9a7c-cb9fe11873f0 admin admin] PATH_INFO: `/v3/projects/df9bb657639041b0b7a41f96b04f1660/users/7a63ee6da424468d882afa672bb0b488/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:22.262192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639aa67-49fb-43cb-9a7c-cb9fe11873f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9bb657639041b0b7a41f96b04f1660, user_id=7a63ee6da424468d882afa672bb0b488, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:22.265154 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639aa67-49fb-43cb-9a7c-cb9fe11873f0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:22.281023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 972/1963] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:22 2022] PUT /identity/v3/projects/df9bb657639041b0b7a41f96b04f1660/users/7a63ee6da424468d882afa672bb0b488/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:22.291919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e587a-71df-4321-89c0-f56340eccab7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:22.292226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e587a-71df-4321-89c0-f56340eccab7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:22.292478 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e587a-71df-4321-89c0-f56340eccab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:22.313856 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:22.322922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-223e587a-71df-4321-89c0-f56340eccab7 None None] MFA Rules not processed for user `7a63ee6da424468d882afa672bb0b488`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:22.323158 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740e2b0-c850-4ca1-bd89-0b9a55d266a3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:22.324356 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-223e587a-71df-4321-89c0-f56340eccab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:22.376235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7ca2f-45f2-490e-86c2-dca208ce9aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:22.376799 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7ca2f-45f2-490e-86c2-dca208ce9aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:22.377109 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7ca2f-45f2-490e-86c2-dca208ce9aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:22.377413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7ca2f-45f2-490e-86c2-dca208ce9aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:22.379219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b4b7ca2f-45f2-490e-86c2-dca208ce9aa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:22.403871 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:22.415197 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 973/1964] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:22.428847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e587a-71df-4321-89c0-f56340eccab7 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:22.439625 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e587a-71df-4321-89c0-f56340eccab7 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:22.444015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d8e0c-4907-4a22-b32e-f78d0baccf2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:22.444984 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d8e0c-4907-4a22-b32e-f78d0baccf2b service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:22.445888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d8e0c-4907-4a22-b32e-f78d0baccf2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:22.446193 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7ca2f-45f2-490e-86c2-dca208ce9aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:22.446297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d8e0c-4907-4a22-b32e-f78d0baccf2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:22.448007 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7ca2f-45f2-490e-86c2-dca208ce9aa7 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:22.456171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d8e0c-4907-4a22-b32e-f78d0baccf2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:22.457820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d8e0c-4907-4a22-b32e-f78d0baccf2b service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:22.458656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 992/1965] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:22.469964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 974/1966] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:22.633276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7ca2f-45f2-490e-86c2-dca208ce9aa7 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:22.748942 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7ca2f-45f2-490e-86c2-dca208ce9aa7 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:22.754003 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7fd71-065a-45f9-9d88-e35355dbacea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:22.754896 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7fd71-065a-45f9-9d88-e35355dbacea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:22.755181 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7fd71-065a-45f9-9d88-e35355dbacea admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:22.755532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7fd71-065a-45f9-9d88-e35355dbacea admin admin] PATH_INFO: `/v3/users/28ff626deced43d88698a70b88550325` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:22.756771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7fd71-065a-45f9-9d88-e35355dbacea admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ff626deced43d88698a70b88550325)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:22.759510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7fd71-065a-45f9-9d88-e35355dbacea admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:22.992988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-72a7fd71-065a-45f9-9d88-e35355dbacea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ff626deced43d88698a70b88550325'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:23.001137 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:23.005589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-72a7fd71-065a-45f9-9d88-e35355dbacea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ff626deced43d88698a70b88550325'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:23.014628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-72a7fd71-065a-45f9-9d88-e35355dbacea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ff626deced43d88698a70b88550325'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:23.014628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-72a7fd71-065a-45f9-9d88-e35355dbacea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ff626deced43d88698a70b88550325'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:23.014628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-72a7fd71-065a-45f9-9d88-e35355dbacea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ff626deced43d88698a70b88550325'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:23.109036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 993/1967] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:22 2022] DELETE /identity/v3/users/28ff626deced43d88698a70b88550325 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:23.113236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667eb53-e602-48c2-b601-e2addb4dd074 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:23.113567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667eb53-e602-48c2-b601-e2addb4dd074 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:23.113859 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667eb53-e602-48c2-b601-e2addb4dd074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:23.133601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-7667eb53-e602-48c2-b601-e2addb4dd074 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:23.134695 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7667eb53-e602-48c2-b601-e2addb4dd074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:23.196351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 975/1968] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:23.212273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7fd71-065a-45f9-9d88-e35355dbacea admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:23.213747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-72a7fd71-065a-45f9-9d88-e35355dbacea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:23.273824 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7fd71-065a-45f9-9d88-e35355dbacea admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:23.277665 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f962c66-1656-42e9-98ff-4496d10300f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:23.278468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f962c66-1656-42e9-98ff-4496d10300f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:23.278753 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f962c66-1656-42e9-98ff-4496d10300f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:23.279116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f962c66-1656-42e9-98ff-4496d10300f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:23.294388 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f962c66-1656-42e9-98ff-4496d10300f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:23.295879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f962c66-1656-42e9-98ff-4496d10300f5 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:23.307854 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 994/1969] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:23.830950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667eb53-e602-48c2-b601-e2addb4dd074 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:23.832444 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7667eb53-e602-48c2-b601-e2addb4dd074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:23.855061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667eb53-e602-48c2-b601-e2addb4dd074 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:23.867516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78baf14-5849-424d-9205-b8093c6ccc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:23.868335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78baf14-5849-424d-9205-b8093c6ccc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:23.868685 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78baf14-5849-424d-9205-b8093c6ccc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:23.868968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78baf14-5849-424d-9205-b8093c6ccc93 admin admin] PATH_INFO: `/v3/projects/da6fb5274a7e467ba288d5648be41475` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:23.870318 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78baf14-5849-424d-9205-b8093c6ccc93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da6fb5274a7e467ba288d5648be41475)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:23.872436 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78baf14-5849-424d-9205-b8093c6ccc93 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:23.988606 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d78baf14-5849-424d-9205-b8093c6ccc93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da6fb5274a7e467ba288d5648be41475', 'request_id': 'req-d78baf14-5849-424d-9205-b8093c6ccc93'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:23.997254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d78baf14-5849-424d-9205-b8093c6ccc93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da6fb5274a7e467ba288d5648be41475', 'request_id': 'req-d78baf14-5849-424d-9205-b8093c6ccc93'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:24.069798 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d78baf14-5849-424d-9205-b8093c6ccc93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da6fb5274a7e467ba288d5648be41475', 'request_id': 'req-d78baf14-5849-424d-9205-b8093c6ccc93'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:24.081798 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d78baf14-5849-424d-9205-b8093c6ccc93 admin admin] The token cache is being invalidate because project da6fb5274a7e467ba288d5648be41475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:24.082078 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d78baf14-5849-424d-9205-b8093c6ccc93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:24.082737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d78baf14-5849-424d-9205-b8093c6ccc93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:24.084295 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 976/1970] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:23 2022] DELETE /identity/v3/projects/da6fb5274a7e467ba288d5648be41475 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:24.089537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f962c66-1656-42e9-98ff-4496d10300f5 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:24.101111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f962c66-1656-42e9-98ff-4496d10300f5 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:24.167328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dec06b-8148-4537-ad10-9990a1654021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:24.168212 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dec06b-8148-4537-ad10-9990a1654021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:24.168493 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dec06b-8148-4537-ad10-9990a1654021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:24.168768 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dec06b-8148-4537-ad10-9990a1654021 admin admin] PATH_INFO: `/v3/users/7a63ee6da424468d882afa672bb0b488` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:24.169962 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dec06b-8148-4537-ad10-9990a1654021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a63ee6da424468d882afa672bb0b488)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:24.171888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dec06b-8148-4537-ad10-9990a1654021 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:24.371649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-52dec06b-8148-4537-ad10-9990a1654021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a63ee6da424468d882afa672bb0b488'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:24.385947 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-52dec06b-8148-4537-ad10-9990a1654021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a63ee6da424468d882afa672bb0b488'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:24.393052 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-52dec06b-8148-4537-ad10-9990a1654021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a63ee6da424468d882afa672bb0b488'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:24.393981 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-52dec06b-8148-4537-ad10-9990a1654021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a63ee6da424468d882afa672bb0b488'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:24.394607 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-52dec06b-8148-4537-ad10-9990a1654021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a63ee6da424468d882afa672bb0b488'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:24.485187 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:24.491446 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 995/1971] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:24 2022] DELETE /identity/v3/users/7a63ee6da424468d882afa672bb0b488 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:24.824572 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78baf14-5849-424d-9205-b8093c6ccc93 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:24.826075 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d78baf14-5849-424d-9205-b8093c6ccc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:24.840826 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78baf14-5849-424d-9205-b8093c6ccc93 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:24.907774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46842e-e045-461a-af24-b8fadab43d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:24.908663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46842e-e045-461a-af24-b8fadab43d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:24.908946 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46842e-e045-461a-af24-b8fadab43d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:24.909220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46842e-e045-461a-af24-b8fadab43d2f admin admin] PATH_INFO: `/v3/users/54d759c03b1b41f0b9023b12cb470da6` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:24.910466 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46842e-e045-461a-af24-b8fadab43d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d759c03b1b41f0b9023b12cb470da6)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:24.912413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46842e-e045-461a-af24-b8fadab43d2f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:24.918522 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:24.954933 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dec06b-8148-4537-ad10-9990a1654021 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:24.956482 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-52dec06b-8148-4537-ad10-9990a1654021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:24.976837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dec06b-8148-4537-ad10-9990a1654021 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:24.983134 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af146695-43f2-4874-aad1-13824f649de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:24.984393 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af146695-43f2-4874-aad1-13824f649de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:24.985206 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af146695-43f2-4874-aad1-13824f649de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:24.985614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af146695-43f2-4874-aad1-13824f649de9 admin admin] PATH_INFO: `/v3/projects/df9bb657639041b0b7a41f96b04f1660` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:24.987109 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af146695-43f2-4874-aad1-13824f649de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9bb657639041b0b7a41f96b04f1660)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:24.989254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af146695-43f2-4874-aad1-13824f649de9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:25.092447 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-da46842e-e045-461a-af24-b8fadab43d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d759c03b1b41f0b9023b12cb470da6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:25.113176 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-da46842e-e045-461a-af24-b8fadab43d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d759c03b1b41f0b9023b12cb470da6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:25.114081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-da46842e-e045-461a-af24-b8fadab43d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d759c03b1b41f0b9023b12cb470da6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:25.114998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-da46842e-e045-461a-af24-b8fadab43d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d759c03b1b41f0b9023b12cb470da6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:25.130316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-af146695-43f2-4874-aad1-13824f649de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9bb657639041b0b7a41f96b04f1660', 'request_id': 'req-af146695-43f2-4874-aad1-13824f649de9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:25.135649 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-da46842e-e045-461a-af24-b8fadab43d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d759c03b1b41f0b9023b12cb470da6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:25.201513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-af146695-43f2-4874-aad1-13824f649de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9bb657639041b0b7a41f96b04f1660', 'request_id': 'req-af146695-43f2-4874-aad1-13824f649de9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:25.208437 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-af146695-43f2-4874-aad1-13824f649de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9bb657639041b0b7a41f96b04f1660', 'request_id': 'req-af146695-43f2-4874-aad1-13824f649de9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:25.223978 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-af146695-43f2-4874-aad1-13824f649de9 admin admin] The token cache is being invalidate because project df9bb657639041b0b7a41f96b04f1660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:25.224499 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-af146695-43f2-4874-aad1-13824f649de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:25.225661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-af146695-43f2-4874-aad1-13824f649de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:25.228935 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 996/1972] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:24 2022] DELETE /identity/v3/projects/df9bb657639041b0b7a41f96b04f1660 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:25.234816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded14d3f-4f53-4244-bb70-cf6d2fb6d603 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:25.235107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded14d3f-4f53-4244-bb70-cf6d2fb6d603 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:25.235388 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded14d3f-4f53-4244-bb70-cf6d2fb6d603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:25.255805 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ded14d3f-4f53-4244-bb70-cf6d2fb6d603 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:25.257032 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ded14d3f-4f53-4244-bb70-cf6d2fb6d603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:25.311389 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 977/1973] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:24 2022] DELETE /identity/v3/users/54d759c03b1b41f0b9023b12cb470da6 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:25.312872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96446f63-6e02-4f22-ac35-50f6c42403d8 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:25.313169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96446f63-6e02-4f22-ac35-50f6c42403d8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:25.313562 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96446f63-6e02-4f22-ac35-50f6c42403d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:25.336922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 997/1974] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:25.345061 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7de4b7-e7ca-4231-ab43-39087198d366 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:25.345391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7de4b7-e7ca-4231-ab43-39087198d366 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:25.345674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7de4b7-e7ca-4231-ab43-39087198d366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:25.354028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-96446f63-6e02-4f22-ac35-50f6c42403d8 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:25.356410 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-96446f63-6e02-4f22-ac35-50f6c42403d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:25.366827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-be7de4b7-e7ca-4231-ab43-39087198d366 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:25.368700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-be7de4b7-e7ca-4231-ab43-39087198d366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:25.464758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 998/1975] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:25.471103 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7de4b7-e7ca-4231-ab43-39087198d366 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:25.479335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 978/1976] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:25.488959 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96446f63-6e02-4f22-ac35-50f6c42403d8 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:25.490560 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-96446f63-6e02-4f22-ac35-50f6c42403d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:25.496897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7de4b7-e7ca-4231-ab43-39087198d366 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:25.509159 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c80e9a-1a16-4336-a9b2-e8fe8ae3795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:25.510094 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c80e9a-1a16-4336-a9b2-e8fe8ae3795e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:25.510381 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c80e9a-1a16-4336-a9b2-e8fe8ae3795e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:25.510659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c80e9a-1a16-4336-a9b2-e8fe8ae3795e admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:25.511663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c80e9a-1a16-4336-a9b2-e8fe8ae3795e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:25.512229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c80e9a-1a16-4336-a9b2-e8fe8ae3795e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:25.514321 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c80e9a-1a16-4336-a9b2-e8fe8ae3795e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:25.533963 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 999/1977] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:35:25.539674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c80e9a-1a16-4336-a9b2-e8fe8ae3795e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:25.559453 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c80e9a-1a16-4336-a9b2-e8fe8ae3795e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:25.566703 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a0883-43bc-4861-8f2f-a7686545bbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:25.567383 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a0883-43bc-4861-8f2f-a7686545bbcc admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:25.567712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a0883-43bc-4861-8f2f-a7686545bbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:25.568463 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a0883-43bc-4861-8f2f-a7686545bbcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:25.569223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a0883-43bc-4861-8f2f-a7686545bbcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:25.571905 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a0883-43bc-4861-8f2f-a7686545bbcc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:25.577935 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:25.595296 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96446f63-6e02-4f22-ac35-50f6c42403d8 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:25.599098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812db17-c267-42b2-94ea-b674759f1a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:25.599803 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812db17-c267-42b2-94ea-b674759f1a14 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:25.600088 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812db17-c267-42b2-94ea-b674759f1a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:25.605431 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812db17-c267-42b2-94ea-b674759f1a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:25.611043 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812db17-c267-42b2-94ea-b674759f1a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:25.612536 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812db17-c267-42b2-94ea-b674759f1a14 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:25.624576 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 979/1978] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:25.677776 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1000/1979] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:25 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:25.683261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812db17-c267-42b2-94ea-b674759f1a14 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:25.699192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812db17-c267-42b2-94ea-b674759f1a14 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:25.730127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:25.766495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895e4ba-12fa-4314-af7d-4a1fefc6b5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:25.767218 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895e4ba-12fa-4314-af7d-4a1fefc6b5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:25.767497 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895e4ba-12fa-4314-af7d-4a1fefc6b5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:25.767767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895e4ba-12fa-4314-af7d-4a1fefc6b5b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:25.768505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895e4ba-12fa-4314-af7d-4a1fefc6b5b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:25.771396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895e4ba-12fa-4314-af7d-4a1fefc6b5b2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:25.921846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 980/1980] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:25 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:25.926078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a0883-43bc-4861-8f2f-a7686545bbcc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:25.937459 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a0883-43bc-4861-8f2f-a7686545bbcc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:25.942171 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc644aa-5cbe-41de-be81-b508407b1844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:25.942852 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc644aa-5cbe-41de-be81-b508407b1844 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:25.943136 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc644aa-5cbe-41de-be81-b508407b1844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:25.943412 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc644aa-5cbe-41de-be81-b508407b1844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:25.944297 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc644aa-5cbe-41de-be81-b508407b1844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:25.946517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc644aa-5cbe-41de-be81-b508407b1844 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:25.957826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1001/1981] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:25.974367 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895e4ba-12fa-4314-af7d-4a1fefc6b5b2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:25.989558 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895e4ba-12fa-4314-af7d-4a1fefc6b5b2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:25.994856 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95d26f-7653-494a-8998-703244b03089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:25.995616 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95d26f-7653-494a-8998-703244b03089 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:25.995894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95d26f-7653-494a-8998-703244b03089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:25.996169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95d26f-7653-494a-8998-703244b03089 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:25.996897 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95d26f-7653-494a-8998-703244b03089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:25.998819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95d26f-7653-494a-8998-703244b03089 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:26.013745 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 981/1982] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:26.023331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc644aa-5cbe-41de-be81-b508407b1844 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:26.035127 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc644aa-5cbe-41de-be81-b508407b1844 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:26.042370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7540d88-342e-4e6a-9538-8fdbdd7be906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:26.043790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7540d88-342e-4e6a-9538-8fdbdd7be906 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:26.051078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7540d88-342e-4e6a-9538-8fdbdd7be906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:26.051577 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7540d88-342e-4e6a-9538-8fdbdd7be906 admin admin] PATH_INFO: `/v3/projects/66b7a3b22a594bc693a47e8889a78d1d/users/cc3de78fc738433ba86bf20041ef5f57/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:26.076071 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7540d88-342e-4e6a-9538-8fdbdd7be906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b7a3b22a594bc693a47e8889a78d1d, user_id=cc3de78fc738433ba86bf20041ef5f57, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:26.082092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7540d88-342e-4e6a-9538-8fdbdd7be906 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:26.209385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1002/1983] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:26 2022] PUT /identity/v3/projects/66b7a3b22a594bc693a47e8889a78d1d/users/cc3de78fc738433ba86bf20041ef5f57/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:26.221588 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ada33-075e-4beb-9548-3e0cc489eae5 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:26.222115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ada33-075e-4beb-9548-3e0cc489eae5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:26.222707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ada33-075e-4beb-9548-3e0cc489eae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:26.257926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7540d88-342e-4e6a-9538-8fdbdd7be906 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:26.266854 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a7540d88-342e-4e6a-9538-8fdbdd7be906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:26.287762 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-9d4ada33-075e-4beb-9548-3e0cc489eae5 None None] MFA Rules not processed for user `cc3de78fc738433ba86bf20041ef5f57`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:26.300145 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9d4ada33-075e-4beb-9548-3e0cc489eae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:26.414401 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 982/1984] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:26.417444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7540d88-342e-4e6a-9538-8fdbdd7be906 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:26.425457 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41eb501-19d9-40fa-883e-bbf2b6009870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:26.425457 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eb501-19d9-40fa-883e-bbf2b6009870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:26.425457 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eb501-19d9-40fa-883e-bbf2b6009870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:26.425457 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eb501-19d9-40fa-883e-bbf2b6009870 admin admin] PATH_INFO: `/v3/projects/acee507a7cb64a14b21fcedc7669fc11` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:26.426427 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41eb501-19d9-40fa-883e-bbf2b6009870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acee507a7cb64a14b21fcedc7669fc11)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:26.427909 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41eb501-19d9-40fa-883e-bbf2b6009870 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:26.429933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ada33-075e-4beb-9548-3e0cc489eae5 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:26.444288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ada33-075e-4beb-9548-3e0cc489eae5 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:26.452102 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7decf6-6771-4387-a4d3-086fb56e3c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:26.452795 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7decf6-6771-4387-a4d3-086fb56e3c5d admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:26.453141 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7decf6-6771-4387-a4d3-086fb56e3c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:26.453457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7decf6-6771-4387-a4d3-086fb56e3c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:26.454864 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7decf6-6771-4387-a4d3-086fb56e3c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:26.457316 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7decf6-6771-4387-a4d3-086fb56e3c5d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:26.602677 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 983/1985] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:26 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:26.606815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7decf6-6771-4387-a4d3-086fb56e3c5d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:26.615843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b41eb501-19d9-40fa-883e-bbf2b6009870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acee507a7cb64a14b21fcedc7669fc11', 'request_id': 'req-b41eb501-19d9-40fa-883e-bbf2b6009870'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:26.695804 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b41eb501-19d9-40fa-883e-bbf2b6009870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acee507a7cb64a14b21fcedc7669fc11', 'request_id': 'req-b41eb501-19d9-40fa-883e-bbf2b6009870'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:26.701499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7decf6-6771-4387-a4d3-086fb56e3c5d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:26.703400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b41eb501-19d9-40fa-883e-bbf2b6009870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acee507a7cb64a14b21fcedc7669fc11', 'request_id': 'req-b41eb501-19d9-40fa-883e-bbf2b6009870'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:26.707787 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a1841-f816-410f-a055-4362f8bde34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:26.709098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a1841-f816-410f-a055-4362f8bde34b admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:26.709404 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a1841-f816-410f-a055-4362f8bde34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:26.709679 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a1841-f816-410f-a055-4362f8bde34b admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:26.710383 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a1841-f816-410f-a055-4362f8bde34b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:26.713560 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a1841-f816-410f-a055-4362f8bde34b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:26.716139 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b41eb501-19d9-40fa-883e-bbf2b6009870 admin admin] The token cache is being invalidate because project acee507a7cb64a14b21fcedc7669fc11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:26.716516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b41eb501-19d9-40fa-883e-bbf2b6009870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:26.717359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b41eb501-19d9-40fa-883e-bbf2b6009870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:26.723061 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1003/1986] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:26 2022] DELETE /identity/v3/projects/acee507a7cb64a14b21fcedc7669fc11 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:26.723724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41eb501-19d9-40fa-883e-bbf2b6009870 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:26.725634 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b41eb501-19d9-40fa-883e-bbf2b6009870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:26.786830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:26.806727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41eb501-19d9-40fa-883e-bbf2b6009870 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:26.811477 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57719c5-d7fc-4c96-9900-a3c0a471e119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:26.812364 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57719c5-d7fc-4c96-9900-a3c0a471e119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:26.812649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57719c5-d7fc-4c96-9900-a3c0a471e119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:26.812925 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57719c5-d7fc-4c96-9900-a3c0a471e119 admin admin] PATH_INFO: `/v3/users/9a6db57e80c74edcab50ee1d17973327` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:26.814202 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57719c5-d7fc-4c96-9900-a3c0a471e119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a6db57e80c74edcab50ee1d17973327)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:26.816168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57719c5-d7fc-4c96-9900-a3c0a471e119 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:26.821465 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 984/1987] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:26 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:26.821465 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a1841-f816-410f-a055-4362f8bde34b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:26.822756 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8f5a1841-f816-410f-a055-4362f8bde34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:26.831572 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:26.836222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a1841-f816-410f-a055-4362f8bde34b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:26.849784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778adfd-d14a-453e-ac8e-472bc1536ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:26.850383 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778adfd-d14a-453e-ac8e-472bc1536ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:26.850656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778adfd-d14a-453e-ac8e-472bc1536ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:26.851020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778adfd-d14a-453e-ac8e-472bc1536ecd admin admin] PATH_INFO: `/v3/users/c3817f338c1d4d9788e08519c0b4f748` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:26.852277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778adfd-d14a-453e-ac8e-472bc1536ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3817f338c1d4d9788e08519c0b4f748)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:26.854254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778adfd-d14a-453e-ac8e-472bc1536ecd admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:27.020037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c57719c5-d7fc-4c96-9900-a3c0a471e119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a6db57e80c74edcab50ee1d17973327'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:27.037215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c57719c5-d7fc-4c96-9900-a3c0a471e119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a6db57e80c74edcab50ee1d17973327'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:27.044980 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c57719c5-d7fc-4c96-9900-a3c0a471e119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a6db57e80c74edcab50ee1d17973327'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:27.045855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c57719c5-d7fc-4c96-9900-a3c0a471e119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a6db57e80c74edcab50ee1d17973327'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:27.046557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c57719c5-d7fc-4c96-9900-a3c0a471e119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a6db57e80c74edcab50ee1d17973327'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:27.112058 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e778adfd-d14a-453e-ac8e-472bc1536ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3817f338c1d4d9788e08519c0b4f748'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:27.127186 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1004/1988] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:26 2022] DELETE /identity/v3/users/9a6db57e80c74edcab50ee1d17973327 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:27.130419 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57719c5-d7fc-4c96-9900-a3c0a471e119 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:27.130701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c57719c5-d7fc-4c96-9900-a3c0a471e119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:27.142219 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e778adfd-d14a-453e-ac8e-472bc1536ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3817f338c1d4d9788e08519c0b4f748'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:27.143462 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e778adfd-d14a-453e-ac8e-472bc1536ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3817f338c1d4d9788e08519c0b4f748'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:27.144863 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e778adfd-d14a-453e-ac8e-472bc1536ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3817f338c1d4d9788e08519c0b4f748'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:27.162503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e778adfd-d14a-453e-ac8e-472bc1536ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3817f338c1d4d9788e08519c0b4f748'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:27.264606 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57719c5-d7fc-4c96-9900-a3c0a471e119 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:27.291731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 985/1989] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:26 2022] DELETE /identity/v3/users/c3817f338c1d4d9788e08519c0b4f748 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:27.293830 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb4ffd-a435-4aba-942d-8a75b3e7d3f4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:27.294444 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb4ffd-a435-4aba-942d-8a75b3e7d3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:27.295686 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb4ffd-a435-4aba-942d-8a75b3e7d3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:27.300879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4ea6a-7fd1-4576-8c0d-12e14bc40d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:27.301919 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4ea6a-7fd1-4576-8c0d-12e14bc40d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:27.302390 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4ea6a-7fd1-4576-8c0d-12e14bc40d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:27.302724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4ea6a-7fd1-4576-8c0d-12e14bc40d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:27.303946 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4ea6a-7fd1-4576-8c0d-12e14bc40d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:27.305317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4ea6a-7fd1-4576-8c0d-12e14bc40d12 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:27.315925 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1005/1990] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:27.318537 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-98fb4ffd-a435-4aba-942d-8a75b3e7d3f4 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:27.320964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-98fb4ffd-a435-4aba-942d-8a75b3e7d3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:27.321638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4ea6a-7fd1-4576-8c0d-12e14bc40d12 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:27.323704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0dd4ea6a-7fd1-4576-8c0d-12e14bc40d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:27.338301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4ea6a-7fd1-4576-8c0d-12e14bc40d12 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:27.405384 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 986/1991] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:27.423140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e7cac-69af-4bec-b3db-75697d9cd954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:27.423828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e7cac-69af-4bec-b3db-75697d9cd954 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:27.424108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e7cac-69af-4bec-b3db-75697d9cd954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:27.427996 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e7cac-69af-4bec-b3db-75697d9cd954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:27.427996 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e7cac-69af-4bec-b3db-75697d9cd954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:27.427996 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e7cac-69af-4bec-b3db-75697d9cd954 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:27.442741 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1006/1992] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:27.448578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb4ffd-a435-4aba-942d-8a75b3e7d3f4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:27.458631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e7cac-69af-4bec-b3db-75697d9cd954 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:27.462422 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb4ffd-a435-4aba-942d-8a75b3e7d3f4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:27.462861 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-785e7cac-69af-4bec-b3db-75697d9cd954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:27.474572 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f536e2-fa0a-46ff-a9c2-a14bcb70ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:27.475494 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f536e2-fa0a-46ff-a9c2-a14bcb70ed5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:27.475783 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f536e2-fa0a-46ff-a9c2-a14bcb70ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:27.476042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f536e2-fa0a-46ff-a9c2-a14bcb70ed5c admin admin] PATH_INFO: `/v3/projects/648d8ede8a84461cabb1dc3d4a702af8/users/a1f24e03b1ff4cc3ad4d0a8367328918/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:27.515311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f536e2-fa0a-46ff-a9c2-a14bcb70ed5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=648d8ede8a84461cabb1dc3d4a702af8, user_id=a1f24e03b1ff4cc3ad4d0a8367328918, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:27.518133 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f536e2-fa0a-46ff-a9c2-a14bcb70ed5c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:27.566132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e7cac-69af-4bec-b3db-75697d9cd954 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:27.566132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24290a6c-a002-4c05-b04c-37c51c929651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:27.566132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24290a6c-a002-4c05-b04c-37c51c929651 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:27.566132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24290a6c-a002-4c05-b04c-37c51c929651 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:27.566539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24290a6c-a002-4c05-b04c-37c51c929651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:27.566609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24290a6c-a002-4c05-b04c-37c51c929651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:27.568394 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24290a6c-a002-4c05-b04c-37c51c929651 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:27.581291 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1007/1993] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:27.636351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 987/1994] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:27 2022] PUT /identity/v3/projects/648d8ede8a84461cabb1dc3d4a702af8/users/a1f24e03b1ff4cc3ad4d0a8367328918/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:27.652263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bb867-3c50-4c86-a81f-1afdda72ed4d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:27.652263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bb867-3c50-4c86-a81f-1afdda72ed4d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:27.652263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bb867-3c50-4c86-a81f-1afdda72ed4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:27.704113 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b23bb867-3c50-4c86-a81f-1afdda72ed4d None None] MFA Rules not processed for user `a1f24e03b1ff4cc3ad4d0a8367328918`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:27.707237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b23bb867-3c50-4c86-a81f-1afdda72ed4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:27.797718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1008/1995] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:27.799673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f536e2-fa0a-46ff-a9c2-a14bcb70ed5c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:27.890145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:27.915930 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:27.932258 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f536e2-fa0a-46ff-a9c2-a14bcb70ed5c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:27.951484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49856cbc-ae98-46a6-b383-a8c21aac109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:27.953449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49856cbc-ae98-46a6-b383-a8c21aac109d admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:27.953740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49856cbc-ae98-46a6-b383-a8c21aac109d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:27.955203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49856cbc-ae98-46a6-b383-a8c21aac109d admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:27.955941 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49856cbc-ae98-46a6-b383-a8c21aac109d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:27.963002 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49856cbc-ae98-46a6-b383-a8c21aac109d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:28.037893 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bb867-3c50-4c86-a81f-1afdda72ed4d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:28.041503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b23bb867-3c50-4c86-a81f-1afdda72ed4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:28.066734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bb867-3c50-4c86-a81f-1afdda72ed4d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:28.076632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 988/1996] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:27 2022] POST /identity/v3/projects => generated 385 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:28.076749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:28.078136 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:28.078517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:28.079128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9 admin admin] PATH_INFO: `/v3/projects/6f70714d52c34674a2ffa0a91fafed0b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:28.081002 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49856cbc-ae98-46a6-b383-a8c21aac109d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:28.089552 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f70714d52c34674a2ffa0a91fafed0b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:28.093576 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:28.191089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49856cbc-ae98-46a6-b383-a8c21aac109d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:28.197361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04535b-7a5b-4954-8ba6-9fda089579ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:28.198143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04535b-7a5b-4954-8ba6-9fda089579ed admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:28.198433 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04535b-7a5b-4954-8ba6-9fda089579ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:28.198714 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04535b-7a5b-4954-8ba6-9fda089579ed admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:28.199422 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04535b-7a5b-4954-8ba6-9fda089579ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:28.201485 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04535b-7a5b-4954-8ba6-9fda089579ed admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:28.282226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f70714d52c34674a2ffa0a91fafed0b', 'request_id': 'req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:28.310084 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 989/1997] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:28 2022] POST /identity/v3/users => generated 299 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:28.310734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04535b-7a5b-4954-8ba6-9fda089579ed admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:28.312314 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fb04535b-7a5b-4954-8ba6-9fda089579ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:28.325268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04535b-7a5b-4954-8ba6-9fda089579ed admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:28.386388 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa6e0e-9089-455c-ac02-3e7c5ae072e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:28.387356 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa6e0e-9089-455c-ac02-3e7c5ae072e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:28.387652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa6e0e-9089-455c-ac02-3e7c5ae072e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:28.387960 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa6e0e-9089-455c-ac02-3e7c5ae072e0 admin admin] PATH_INFO: `/v3/users/72e2d9053a994afab567b3c4a478ddc7` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:28.389314 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa6e0e-9089-455c-ac02-3e7c5ae072e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e2d9053a994afab567b3c4a478ddc7)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:28.391363 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa6e0e-9089-455c-ac02-3e7c5ae072e0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:28.440864 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f70714d52c34674a2ffa0a91fafed0b', 'request_id': 'req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:28.448973 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f70714d52c34674a2ffa0a91fafed0b', 'request_id': 'req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:28.461601 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9 admin admin] The token cache is being invalidate because project 6f70714d52c34674a2ffa0a91fafed0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:28.462016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:28.462785 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:28.464710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1009/1998] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:28 2022] DELETE /identity/v3/projects/6f70714d52c34674a2ffa0a91fafed0b => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:28.469091 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:28.470636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:28.485012 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b7aa6-bb2d-408d-9a28-556bf741f2a9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:28.493161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe1551-5d75-49e1-a56c-7b3350c51aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:28.494394 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1551-5d75-49e1-a56c-7b3350c51aab admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:28.494394 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1551-5d75-49e1-a56c-7b3350c51aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:28.494565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1551-5d75-49e1-a56c-7b3350c51aab admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:28.495746 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe1551-5d75-49e1-a56c-7b3350c51aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:28.497612 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe1551-5d75-49e1-a56c-7b3350c51aab admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:28.508723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1010/1999] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:28.509386 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe1551-5d75-49e1-a56c-7b3350c51aab admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:28.511500 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5cfe1551-5d75-49e1-a56c-7b3350c51aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:28.525579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe1551-5d75-49e1-a56c-7b3350c51aab admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:28.530996 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251362a-b121-40f7-978e-3c67eb2c8e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:28.531907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251362a-b121-40f7-978e-3c67eb2c8e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:28.532167 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251362a-b121-40f7-978e-3c67eb2c8e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:28.532450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251362a-b121-40f7-978e-3c67eb2c8e28 admin admin] PATH_INFO: `/v3/projects/3a322a806a1242778840c9301a77ad79` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:28.533801 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251362a-b121-40f7-978e-3c67eb2c8e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a322a806a1242778840c9301a77ad79)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:28.536932 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251362a-b121-40f7-978e-3c67eb2c8e28 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:28.625523 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0aaa6e0e-9089-455c-ac02-3e7c5ae072e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e2d9053a994afab567b3c4a478ddc7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:28.638352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0aaa6e0e-9089-455c-ac02-3e7c5ae072e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e2d9053a994afab567b3c4a478ddc7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:28.639070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0aaa6e0e-9089-455c-ac02-3e7c5ae072e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e2d9053a994afab567b3c4a478ddc7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:28.639678 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0aaa6e0e-9089-455c-ac02-3e7c5ae072e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e2d9053a994afab567b3c4a478ddc7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:28.646825 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0aaa6e0e-9089-455c-ac02-3e7c5ae072e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e2d9053a994afab567b3c4a478ddc7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:28.654075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e251362a-b121-40f7-978e-3c67eb2c8e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a322a806a1242778840c9301a77ad79', 'request_id': 'req-e251362a-b121-40f7-978e-3c67eb2c8e28'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:28.769514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 990/2000] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:28 2022] DELETE /identity/v3/users/72e2d9053a994afab567b3c4a478ddc7 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:28.770937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f649f6-3bf9-4553-ab90-e0b143de2f48 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:28.771228 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f649f6-3bf9-4553-ab90-e0b143de2f48 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:28.771549 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f649f6-3bf9-4553-ab90-e0b143de2f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:28.790366 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e6f649f6-3bf9-4553-ab90-e0b143de2f48 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:28.791572 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e6f649f6-3bf9-4553-ab90-e0b143de2f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:28.851769 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 991/2001] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:28.852691 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f649f6-3bf9-4553-ab90-e0b143de2f48 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:28.854502 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e6f649f6-3bf9-4553-ab90-e0b143de2f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:28.866185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f649f6-3bf9-4553-ab90-e0b143de2f48 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:28.871459 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457eb9ac-bc16-4229-b187-417ba6e62092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:28.872346 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457eb9ac-bc16-4229-b187-417ba6e62092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:28.872625 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457eb9ac-bc16-4229-b187-417ba6e62092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:28.873569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457eb9ac-bc16-4229-b187-417ba6e62092 admin admin] PATH_INFO: `/v3/projects/54f34ff234ab410588ffeff12c09c352/users/8efc5cbfc2294746a48457fef794e6c3/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:28.883366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e251362a-b121-40f7-978e-3c67eb2c8e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a322a806a1242778840c9301a77ad79', 'request_id': 'req-e251362a-b121-40f7-978e-3c67eb2c8e28'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:28.889028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457eb9ac-bc16-4229-b187-417ba6e62092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54f34ff234ab410588ffeff12c09c352, user_id=8efc5cbfc2294746a48457fef794e6c3, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:28.891671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e251362a-b121-40f7-978e-3c67eb2c8e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a322a806a1242778840c9301a77ad79', 'request_id': 'req-e251362a-b121-40f7-978e-3c67eb2c8e28'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:28.891815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457eb9ac-bc16-4229-b187-417ba6e62092 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:28.904609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e251362a-b121-40f7-978e-3c67eb2c8e28 admin admin] The token cache is being invalidate because project 3a322a806a1242778840c9301a77ad79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:28.904921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e251362a-b121-40f7-978e-3c67eb2c8e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:28.905613 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e251362a-b121-40f7-978e-3c67eb2c8e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:28.907159 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1011/2002] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:28 2022] DELETE /identity/v3/projects/3a322a806a1242778840c9301a77ad79 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:28.908407 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ac61a-f0cc-42c9-82e9-036983c85da6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:28.908677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ac61a-f0cc-42c9-82e9-036983c85da6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:28.908950 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ac61a-f0cc-42c9-82e9-036983c85da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:28.928430 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-855ac61a-f0cc-42c9-82e9-036983c85da6 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:28.930452 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-855ac61a-f0cc-42c9-82e9-036983c85da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:28.938786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1012/2003] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:28.940043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2028701-7e34-4287-89e6-ba38efdb442a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:28.940329 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2028701-7e34-4287-89e6-ba38efdb442a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:28.940596 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2028701-7e34-4287-89e6-ba38efdb442a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:28.956314 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 992/2004] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:28 2022] PUT /identity/v3/projects/54f34ff234ab410588ffeff12c09c352/users/8efc5cbfc2294746a48457fef794e6c3/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:28.957167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457eb9ac-bc16-4229-b187-417ba6e62092 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:28.960508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-457eb9ac-bc16-4229-b187-417ba6e62092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:28.965678 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b2028701-7e34-4287-89e6-ba38efdb442a None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:28.967055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b2028701-7e34-4287-89e6-ba38efdb442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:29.035747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457eb9ac-bc16-4229-b187-417ba6e62092 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:29.042025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42880965-2aff-467b-bcc3-c19d787c2fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:29.044897 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42880965-2aff-467b-bcc3-c19d787c2fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:29.044897 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42880965-2aff-467b-bcc3-c19d787c2fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:29.044897 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42880965-2aff-467b-bcc3-c19d787c2fcf admin admin] PATH_INFO: `/v3/users/fe17cf51afe34d0f85e8bae64ca23bab` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:29.049474 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42880965-2aff-467b-bcc3-c19d787c2fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe17cf51afe34d0f85e8bae64ca23bab)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:29.051457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42880965-2aff-467b-bcc3-c19d787c2fcf admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:29.053601 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1013/2005] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:29.053601 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2028701-7e34-4287-89e6-ba38efdb442a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:29.055709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b2028701-7e34-4287-89e6-ba38efdb442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:29.113472 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2028701-7e34-4287-89e6-ba38efdb442a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:29.117840 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248bdf8-73d5-41f5-b19e-85ed1b0969ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:29.118505 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248bdf8-73d5-41f5-b19e-85ed1b0969ae service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:29.118793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248bdf8-73d5-41f5-b19e-85ed1b0969ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:29.119072 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248bdf8-73d5-41f5-b19e-85ed1b0969ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:29.129498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248bdf8-73d5-41f5-b19e-85ed1b0969ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:29.136493 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248bdf8-73d5-41f5-b19e-85ed1b0969ae service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:29.142181 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1014/2006] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:29.143128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248bdf8-73d5-41f5-b19e-85ed1b0969ae service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:29.144542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b248bdf8-73d5-41f5-b19e-85ed1b0969ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:29.158258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248bdf8-73d5-41f5-b19e-85ed1b0969ae service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:29.165227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ed18b-a58c-4a0f-9c5b-8986e152d34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:29.165958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ed18b-a58c-4a0f-9c5b-8986e152d34f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:29.166391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ed18b-a58c-4a0f-9c5b-8986e152d34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:29.166677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ed18b-a58c-4a0f-9c5b-8986e152d34f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:29.167429 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ed18b-a58c-4a0f-9c5b-8986e152d34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:29.169065 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ed18b-a58c-4a0f-9c5b-8986e152d34f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:29.185542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1015/2007] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:29.187077 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ed18b-a58c-4a0f-9c5b-8986e152d34f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:29.189762 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cb4ed18b-a58c-4a0f-9c5b-8986e152d34f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:29.204938 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ed18b-a58c-4a0f-9c5b-8986e152d34f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:29.210809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff34dbb-b480-4ea1-8c05-52633dc1ae28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:29.211850 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff34dbb-b480-4ea1-8c05-52633dc1ae28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:29.212132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff34dbb-b480-4ea1-8c05-52633dc1ae28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:29.212442 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff34dbb-b480-4ea1-8c05-52633dc1ae28 admin admin] PATH_INFO: `/v3/users/649130e099984798ad661159bb2aa2fb` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:29.213711 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff34dbb-b480-4ea1-8c05-52633dc1ae28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=649130e099984798ad661159bb2aa2fb)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:29.215659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff34dbb-b480-4ea1-8c05-52633dc1ae28 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:29.322949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-42880965-2aff-467b-bcc3-c19d787c2fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe17cf51afe34d0f85e8bae64ca23bab'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:29.336961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-42880965-2aff-467b-bcc3-c19d787c2fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe17cf51afe34d0f85e8bae64ca23bab'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:29.341772 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-42880965-2aff-467b-bcc3-c19d787c2fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe17cf51afe34d0f85e8bae64ca23bab'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:29.341772 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-42880965-2aff-467b-bcc3-c19d787c2fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe17cf51afe34d0f85e8bae64ca23bab'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:29.346728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-42880965-2aff-467b-bcc3-c19d787c2fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe17cf51afe34d0f85e8bae64ca23bab'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:29.440994 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6ff34dbb-b480-4ea1-8c05-52633dc1ae28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '649130e099984798ad661159bb2aa2fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:29.472809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 993/2008] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:28 2022] DELETE /identity/v3/users/fe17cf51afe34d0f85e8bae64ca23bab => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:29.479523 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42880965-2aff-467b-bcc3-c19d787c2fcf admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:29.479523 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-42880965-2aff-467b-bcc3-c19d787c2fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:29.487466 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6ff34dbb-b480-4ea1-8c05-52633dc1ae28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '649130e099984798ad661159bb2aa2fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:29.510252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6ff34dbb-b480-4ea1-8c05-52633dc1ae28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '649130e099984798ad661159bb2aa2fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:29.514616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6ff34dbb-b480-4ea1-8c05-52633dc1ae28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '649130e099984798ad661159bb2aa2fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:29.516319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6ff34dbb-b480-4ea1-8c05-52633dc1ae28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '649130e099984798ad661159bb2aa2fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:29.579184 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42880965-2aff-467b-bcc3-c19d787c2fcf admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:29.587420 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb590dad-8b22-4039-9e54-1539c56d1f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:29.588233 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb590dad-8b22-4039-9e54-1539c56d1f61 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:29.588455 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb590dad-8b22-4039-9e54-1539c56d1f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:29.588735 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb590dad-8b22-4039-9e54-1539c56d1f61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:29.589516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb590dad-8b22-4039-9e54-1539c56d1f61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:29.589831 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb590dad-8b22-4039-9e54-1539c56d1f61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:29.591575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb590dad-8b22-4039-9e54-1539c56d1f61 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:29.605477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 994/2009] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:35:29.616623 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb590dad-8b22-4039-9e54-1539c56d1f61 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:29.620062 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-bb590dad-8b22-4039-9e54-1539c56d1f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:29.637442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb590dad-8b22-4039-9e54-1539c56d1f61 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:29.639966 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1016/2010] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:29 2022] DELETE /identity/v3/users/649130e099984798ad661159bb2aa2fb => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:29.640537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff34dbb-b480-4ea1-8c05-52633dc1ae28 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:29.642822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6ff34dbb-b480-4ea1-8c05-52633dc1ae28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:29.649144 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb4ff1-f265-47b8-8dce-cdbe3b980496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:29.651075 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb4ff1-f265-47b8-8dce-cdbe3b980496 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:29.651392 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb4ff1-f265-47b8-8dce-cdbe3b980496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:29.651671 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb4ff1-f265-47b8-8dce-cdbe3b980496 admin admin] PATH_INFO: `/v3/projects/54f34ff234ab410588ffeff12c09c352/users/8efc5cbfc2294746a48457fef794e6c3/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:29.656598 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb4ff1-f265-47b8-8dce-cdbe3b980496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54f34ff234ab410588ffeff12c09c352, user_id=8efc5cbfc2294746a48457fef794e6c3, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:29.659974 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb4ff1-f265-47b8-8dce-cdbe3b980496 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:29.682639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 995/2011] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:29 2022] PUT /identity/v3/projects/54f34ff234ab410588ffeff12c09c352/users/8efc5cbfc2294746a48457fef794e6c3/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:29.684266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0686a70-49f9-44db-affd-4c2456db947a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:29.685062 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0686a70-49f9-44db-affd-4c2456db947a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:29.685062 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0686a70-49f9-44db-affd-4c2456db947a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:29.710138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c0686a70-49f9-44db-affd-4c2456db947a None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:29.711975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c0686a70-49f9-44db-affd-4c2456db947a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:29.714455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:29.735767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff34dbb-b480-4ea1-8c05-52633dc1ae28 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:29.735885 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:29.808215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 996/2012] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:29.808215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f87b3-bcfa-4c33-a965-9def42798ebc None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:29.808215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f87b3-bcfa-4c33-a965-9def42798ebc None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:29.808215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f87b3-bcfa-4c33-a965-9def42798ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:29.838044 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-9f5f87b3-bcfa-4c33-a965-9def42798ebc None None] MFA Rules not processed for user `8efc5cbfc2294746a48457fef794e6c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:29.839646 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9f5f87b3-bcfa-4c33-a965-9def42798ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:29.853840 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d22b0a-357d-4a0a-8afd-b954227e1bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:29.854604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d22b0a-357d-4a0a-8afd-b954227e1bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:29.854960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d22b0a-357d-4a0a-8afd-b954227e1bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:29.855312 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d22b0a-357d-4a0a-8afd-b954227e1bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:29.856080 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d22b0a-357d-4a0a-8afd-b954227e1bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:29.859301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d22b0a-357d-4a0a-8afd-b954227e1bb0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:29.915404 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 997/2013] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:29.916205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f87b3-bcfa-4c33-a965-9def42798ebc None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:29.917563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9f5f87b3-bcfa-4c33-a965-9def42798ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:29.934192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f87b3-bcfa-4c33-a965-9def42798ebc None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:29.942642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:29.943607 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:29.943970 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:29.944164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9 admin admin] PATH_INFO: `/v3/projects/0630f1bc055d408b84337213de3c767b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:29.945460 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0630f1bc055d408b84337213de3c767b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:29.947448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:29.968618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1017/2014] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:29 2022] POST /identity/v3/projects => generated 383 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:29.972038 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d22b0a-357d-4a0a-8afd-b954227e1bb0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:29.972038 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c7d22b0a-357d-4a0a-8afd-b954227e1bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:30.058017 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d22b0a-357d-4a0a-8afd-b954227e1bb0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:30.061762 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd567fc9-bd1b-4069-879d-072a27010ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:30.062420 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd567fc9-bd1b-4069-879d-072a27010ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:30.062698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd567fc9-bd1b-4069-879d-072a27010ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:30.062974 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd567fc9-bd1b-4069-879d-072a27010ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:30.097001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0630f1bc055d408b84337213de3c767b', 'request_id': 'req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:30.107648 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0630f1bc055d408b84337213de3c767b', 'request_id': 'req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:30.150250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd567fc9-bd1b-4069-879d-072a27010ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:30.151802 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd567fc9-bd1b-4069-879d-072a27010ff5 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:30.164535 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1018/2015] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:30.165595 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd567fc9-bd1b-4069-879d-072a27010ff5 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:30.167031 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bd567fc9-bd1b-4069-879d-072a27010ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:30.180849 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0630f1bc055d408b84337213de3c767b', 'request_id': 'req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:30.197987 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9 admin admin] The token cache is being invalidate because project 0630f1bc055d408b84337213de3c767b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:30.198271 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:30.199107 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:30.211393 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 998/2016] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:29 2022] DELETE /identity/v3/projects/0630f1bc055d408b84337213de3c767b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:30.212260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:30.213705 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:30.274736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd567fc9-bd1b-4069-879d-072a27010ff5 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:30.325705 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f9ebc-6560-41e1-88ad-a182d8f191a9 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:30.333224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a264b-1fee-40ff-8bc5-b54138a1d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:30.334506 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a264b-1fee-40ff-8bc5-b54138a1d800 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:30.336350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a264b-1fee-40ff-8bc5-b54138a1d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:30.337053 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a264b-1fee-40ff-8bc5-b54138a1d800 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:30.337979 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a264b-1fee-40ff-8bc5-b54138a1d800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:30.340709 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a264b-1fee-40ff-8bc5-b54138a1d800 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:30.342974 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbfd12-da3b-48bd-919c-de54a4f2849a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:30.343812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbfd12-da3b-48bd-919c-de54a4f2849a service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:30.344189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbfd12-da3b-48bd-919c-de54a4f2849a service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:30.344704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbfd12-da3b-48bd-919c-de54a4f2849a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:30.346655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cecbfd12-da3b-48bd-919c-de54a4f2849a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:30.408005 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbfd12-da3b-48bd-919c-de54a4f2849a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:30.409538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbfd12-da3b-48bd-919c-de54a4f2849a service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:30.419706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1019/2017] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:30.430377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbfd12-da3b-48bd-919c-de54a4f2849a service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:30.432563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cecbfd12-da3b-48bd-919c-de54a4f2849a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:30.457760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 999/2018] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:30 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:30.458918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a264b-1fee-40ff-8bc5-b54138a1d800 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:30.462566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbfd12-da3b-48bd-919c-de54a4f2849a service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:30.463344 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cf1a264b-1fee-40ff-8bc5-b54138a1d800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:30.468084 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f225c9-fdea-48fb-abff-24626d8590dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:30.469136 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f225c9-fdea-48fb-abff-24626d8590dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:30.469348 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f225c9-fdea-48fb-abff-24626d8590dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:30.469593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f225c9-fdea-48fb-abff-24626d8590dd admin admin] PATH_INFO: `/v3/projects/21948635eb8e451daccd579ea0a119e0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:30.471327 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f225c9-fdea-48fb-abff-24626d8590dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=21948635eb8e451daccd579ea0a119e0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:30.473739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f225c9-fdea-48fb-abff-24626d8590dd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:30.482032 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a264b-1fee-40ff-8bc5-b54138a1d800 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:30.488195 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e11836-a1cd-4ea9-89c4-579d172ba163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:30.489483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e11836-a1cd-4ea9-89c4-579d172ba163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:30.489840 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e11836-a1cd-4ea9-89c4-579d172ba163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:30.490751 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e11836-a1cd-4ea9-89c4-579d172ba163 admin admin] PATH_INFO: `/v3/users/68d8e345c8014e7e8a2edf1ec26a7035` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:30.492170 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e11836-a1cd-4ea9-89c4-579d172ba163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d8e345c8014e7e8a2edf1ec26a7035)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:30.494742 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e11836-a1cd-4ea9-89c4-579d172ba163 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:30.579301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a4f225c9-fdea-48fb-abff-24626d8590dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21948635eb8e451daccd579ea0a119e0', 'request_id': 'req-a4f225c9-fdea-48fb-abff-24626d8590dd'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:30.656761 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a4f225c9-fdea-48fb-abff-24626d8590dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21948635eb8e451daccd579ea0a119e0', 'request_id': 'req-a4f225c9-fdea-48fb-abff-24626d8590dd'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:30.675463 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a4f225c9-fdea-48fb-abff-24626d8590dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21948635eb8e451daccd579ea0a119e0', 'request_id': 'req-a4f225c9-fdea-48fb-abff-24626d8590dd'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:30.694085 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b7e11836-a1cd-4ea9-89c4-579d172ba163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d8e345c8014e7e8a2edf1ec26a7035'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:30.698038 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a4f225c9-fdea-48fb-abff-24626d8590dd admin admin] The token cache is being invalidate because project 21948635eb8e451daccd579ea0a119e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:30.698328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a4f225c9-fdea-48fb-abff-24626d8590dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:30.699006 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a4f225c9-fdea-48fb-abff-24626d8590dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:30.701045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1020/2019] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:30 2022] DELETE /identity/v3/projects/21948635eb8e451daccd579ea0a119e0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:30.701955 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f225c9-fdea-48fb-abff-24626d8590dd admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:30.703405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a4f225c9-fdea-48fb-abff-24626d8590dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:30.716424 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b7e11836-a1cd-4ea9-89c4-579d172ba163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d8e345c8014e7e8a2edf1ec26a7035'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:30.717190 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b7e11836-a1cd-4ea9-89c4-579d172ba163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d8e345c8014e7e8a2edf1ec26a7035'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:30.717992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b7e11836-a1cd-4ea9-89c4-579d172ba163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d8e345c8014e7e8a2edf1ec26a7035'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:30.730740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b7e11836-a1cd-4ea9-89c4-579d172ba163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d8e345c8014e7e8a2edf1ec26a7035'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:30.770670 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f225c9-fdea-48fb-abff-24626d8590dd admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:30.776025 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e7673-10d5-4709-9807-0f36bb78cd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:30.776700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e7673-10d5-4709-9807-0f36bb78cd5b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:30.776979 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e7673-10d5-4709-9807-0f36bb78cd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:30.777252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e7673-10d5-4709-9807-0f36bb78cd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:30.778038 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e7673-10d5-4709-9807-0f36bb78cd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:30.779656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e7673-10d5-4709-9807-0f36bb78cd5b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:30.794200 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1021/2020] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:30.795695 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e7673-10d5-4709-9807-0f36bb78cd5b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:30.799693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b83e7673-10d5-4709-9807-0f36bb78cd5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:30.814581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e7673-10d5-4709-9807-0f36bb78cd5b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:30.819723 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1000/2021] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:30 2022] DELETE /identity/v3/users/68d8e345c8014e7e8a2edf1ec26a7035 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:30.821658 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42d864-db87-4efb-a358-a4d604a56e6a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:30.822473 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42d864-db87-4efb-a358-a4d604a56e6a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:30.822473 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42d864-db87-4efb-a358-a4d604a56e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:30.822913 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e5299-1a63-47b4-a13b-45a00322127a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:30.823905 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e5299-1a63-47b4-a13b-45a00322127a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:30.824196 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e5299-1a63-47b4-a13b-45a00322127a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:30.824476 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e5299-1a63-47b4-a13b-45a00322127a admin admin] PATH_INFO: `/v3/projects/1b8dbf8c649346188c219769309679d6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:30.825975 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e5299-1a63-47b4-a13b-45a00322127a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8dbf8c649346188c219769309679d6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:30.827916 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e5299-1a63-47b4-a13b-45a00322127a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:30.848916 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4a42d864-db87-4efb-a358-a4d604a56e6a None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:30.853219 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4a42d864-db87-4efb-a358-a4d604a56e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:30.936307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bf7e5299-1a63-47b4-a13b-45a00322127a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8dbf8c649346188c219769309679d6', 'request_id': 'req-bf7e5299-1a63-47b4-a13b-45a00322127a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:30.939649 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1001/2022] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:30.940612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42d864-db87-4efb-a358-a4d604a56e6a None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:30.941977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4a42d864-db87-4efb-a358-a4d604a56e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:30.956221 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42d864-db87-4efb-a358-a4d604a56e6a None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:31.047564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9c7ca-5aec-4d85-92bc-9adba24c089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:31.048323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9c7ca-5aec-4d85-92bc-9adba24c089b admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:31.049047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9c7ca-5aec-4d85-92bc-9adba24c089b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:31.049447 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9c7ca-5aec-4d85-92bc-9adba24c089b admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:31.051215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9c7ca-5aec-4d85-92bc-9adba24c089b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:31.053480 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9c7ca-5aec-4d85-92bc-9adba24c089b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:31.060774 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bf7e5299-1a63-47b4-a13b-45a00322127a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8dbf8c649346188c219769309679d6', 'request_id': 'req-bf7e5299-1a63-47b4-a13b-45a00322127a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:31.066660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1002/2023] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:31.068049 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445e638-84ed-45c7-bf8e-d973238e1d3f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:31.068345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445e638-84ed-45c7-bf8e-d973238e1d3f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:31.068838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445e638-84ed-45c7-bf8e-d973238e1d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:31.074687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bf7e5299-1a63-47b4-a13b-45a00322127a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8dbf8c649346188c219769309679d6', 'request_id': 'req-bf7e5299-1a63-47b4-a13b-45a00322127a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:31.090420 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bf7e5299-1a63-47b4-a13b-45a00322127a admin admin] The token cache is being invalidate because project 1b8dbf8c649346188c219769309679d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:31.090837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bf7e5299-1a63-47b4-a13b-45a00322127a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:31.092052 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bf7e5299-1a63-47b4-a13b-45a00322127a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:31.092560 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8445e638-84ed-45c7-bf8e-d973238e1d3f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:31.093863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1022/2024] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:30 2022] DELETE /identity/v3/projects/1b8dbf8c649346188c219769309679d6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:31.094481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8445e638-84ed-45c7-bf8e-d973238e1d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:31.094898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e5299-1a63-47b4-a13b-45a00322127a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:31.096884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bf7e5299-1a63-47b4-a13b-45a00322127a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:31.105667 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1003/2025] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:31.106873 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445e638-84ed-45c7-bf8e-d973238e1d3f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:31.108596 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8445e638-84ed-45c7-bf8e-d973238e1d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:31.114250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e5299-1a63-47b4-a13b-45a00322127a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:31.122010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bf3e7-786b-4034-a3ae-a7e6e762a7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:31.123494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bf3e7-786b-4034-a3ae-a7e6e762a7ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:31.123813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bf3e7-786b-4034-a3ae-a7e6e762a7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:31.124097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bf3e7-786b-4034-a3ae-a7e6e762a7ac admin admin] PATH_INFO: `/v3/projects/9e64e39b616246e6974808d3d435e8ea/users/d4eeb8684c1e4c8da065e92fc5f04c01/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:31.124518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445e638-84ed-45c7-bf8e-d973238e1d3f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:31.131696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd2542-047e-44ce-8eaa-b13710c2cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:31.132145 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd2542-047e-44ce-8eaa-b13710c2cabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:31.132806 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd2542-047e-44ce-8eaa-b13710c2cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:31.133086 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd2542-047e-44ce-8eaa-b13710c2cabe admin admin] PATH_INFO: `/v3/users/cfa6c65151ca448a90cf37e38491a3d8` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:31.134464 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd2542-047e-44ce-8eaa-b13710c2cabe admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfa6c65151ca448a90cf37e38491a3d8)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:31.137383 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd2542-047e-44ce-8eaa-b13710c2cabe admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:31.165588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bf3e7-786b-4034-a3ae-a7e6e762a7ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e64e39b616246e6974808d3d435e8ea, user_id=d4eeb8684c1e4c8da065e92fc5f04c01, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:31.169484 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bf3e7-786b-4034-a3ae-a7e6e762a7ac admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:31.230745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1023/2026] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:31 2022] PUT /identity/v3/projects/9e64e39b616246e6974808d3d435e8ea/users/d4eeb8684c1e4c8da065e92fc5f04c01/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:31.231747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bf3e7-786b-4034-a3ae-a7e6e762a7ac admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:31.266049 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:31.327804 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bf3e7-786b-4034-a3ae-a7e6e762a7ac admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:31.341362 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af5e58-9896-4141-a014-434d114d9e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:31.342194 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af5e58-9896-4141-a014-434d114d9e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:31.342545 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af5e58-9896-4141-a014-434d114d9e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:31.342887 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af5e58-9896-4141-a014-434d114d9e1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:31.343700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af5e58-9896-4141-a014-434d114d9e1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:31.344075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af5e58-9896-4141-a014-434d114d9e1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:31.345842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af5e58-9896-4141-a014-434d114d9e1d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:31.368143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1024/2027] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:35:31.370338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a68bc-f210-4979-92bb-adf0a66525fe None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:31.370598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a68bc-f210-4979-92bb-adf0a66525fe None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:31.371207 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a68bc-f210-4979-92bb-adf0a66525fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:31.376402 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-28cd2542-047e-44ce-8eaa-b13710c2cabe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfa6c65151ca448a90cf37e38491a3d8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:31.387122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:31.393976 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-28cd2542-047e-44ce-8eaa-b13710c2cabe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfa6c65151ca448a90cf37e38491a3d8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:31.395244 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-28cd2542-047e-44ce-8eaa-b13710c2cabe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfa6c65151ca448a90cf37e38491a3d8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:31.397019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-28cd2542-047e-44ce-8eaa-b13710c2cabe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfa6c65151ca448a90cf37e38491a3d8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:31.397498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0a0a68bc-f210-4979-92bb-adf0a66525fe None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:31.400160 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0a0a68bc-f210-4979-92bb-adf0a66525fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:31.411452 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1025/2028] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:31.412557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a68bc-f210-4979-92bb-adf0a66525fe None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:31.418463 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0a0a68bc-f210-4979-92bb-adf0a66525fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:31.428529 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-28cd2542-047e-44ce-8eaa-b13710c2cabe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfa6c65151ca448a90cf37e38491a3d8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:31.434864 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a68bc-f210-4979-92bb-adf0a66525fe None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:31.440746 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f833da8-473d-4aea-a1d6-f9451ce3ff1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:31.441478 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f833da8-473d-4aea-a1d6-f9451ce3ff1a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:31.441763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f833da8-473d-4aea-a1d6-f9451ce3ff1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:31.444318 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f833da8-473d-4aea-a1d6-f9451ce3ff1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:31.444318 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f833da8-473d-4aea-a1d6-f9451ce3ff1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:31.445505 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f833da8-473d-4aea-a1d6-f9451ce3ff1a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:31.526906 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1004/2029] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:31 2022] DELETE /identity/v3/users/cfa6c65151ca448a90cf37e38491a3d8 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:31.528176 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd2542-047e-44ce-8eaa-b13710c2cabe admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:31.530785 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-28cd2542-047e-44ce-8eaa-b13710c2cabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:31.576787 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1026/2030] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:31 2022] POST /identity/v3/projects => generated 369 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:31.585985 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f833da8-473d-4aea-a1d6-f9451ce3ff1a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:31.656692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd2542-047e-44ce-8eaa-b13710c2cabe admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:31.673677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f833da8-473d-4aea-a1d6-f9451ce3ff1a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:31.680389 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01efc7-d65f-43ae-bed6-860ebc176711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:31.680993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01efc7-d65f-43ae-bed6-860ebc176711 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:31.681413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01efc7-d65f-43ae-bed6-860ebc176711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:31.681881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01efc7-d65f-43ae-bed6-860ebc176711 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:31.682693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01efc7-d65f-43ae-bed6-860ebc176711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:31.685175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01efc7-d65f-43ae-bed6-860ebc176711 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:31.737101 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8699614-bae8-4a1a-8ec4-498749fa2db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:31.737817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8699614-bae8-4a1a-8ec4-498749fa2db0 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:31.738103 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8699614-bae8-4a1a-8ec4-498749fa2db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:31.738386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8699614-bae8-4a1a-8ec4-498749fa2db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:31.749309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8699614-bae8-4a1a-8ec4-498749fa2db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:31.751334 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8699614-bae8-4a1a-8ec4-498749fa2db0 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:31.762056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1005/2031] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:31.762945 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8699614-bae8-4a1a-8ec4-498749fa2db0 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:31.764547 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f8699614-bae8-4a1a-8ec4-498749fa2db0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:31.778927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8699614-bae8-4a1a-8ec4-498749fa2db0 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:31.783684 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ad836-244c-49e3-98c1-e53520aac3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:31.785224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ad836-244c-49e3-98c1-e53520aac3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:31.790850 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ad836-244c-49e3-98c1-e53520aac3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:31.790850 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ad836-244c-49e3-98c1-e53520aac3c8 admin admin] PATH_INFO: `/v3/projects/44aaa3ff42444f09816532b00acc718b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:31.791030 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1027/2032] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:31 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:31.791438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ad836-244c-49e3-98c1-e53520aac3c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44aaa3ff42444f09816532b00acc718b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:31.791438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ad836-244c-49e3-98c1-e53520aac3c8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:31.792315 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01efc7-d65f-43ae-bed6-860ebc176711 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:31.807121 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01efc7-d65f-43ae-bed6-860ebc176711 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:31.815180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fdb1f-5b00-439a-b63d-37666fb987a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:31.816303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fdb1f-5b00-439a-b63d-37666fb987a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:31.816808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fdb1f-5b00-439a-b63d-37666fb987a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:31.820988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fdb1f-5b00-439a-b63d-37666fb987a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:31.820988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fdb1f-5b00-439a-b63d-37666fb987a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:31.822059 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fdb1f-5b00-439a-b63d-37666fb987a4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:31.841679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1028/2033] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:31.845658 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fdb1f-5b00-439a-b63d-37666fb987a4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:31.855648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fdb1f-5b00-439a-b63d-37666fb987a4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:31.860336 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5402a-875a-49e3-81d5-b0db54358717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:31.861004 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5402a-875a-49e3-81d5-b0db54358717 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:31.861292 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5402a-875a-49e3-81d5-b0db54358717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:31.861606 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5402a-875a-49e3-81d5-b0db54358717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:31.862332 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5402a-875a-49e3-81d5-b0db54358717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:31.863931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5402a-875a-49e3-81d5-b0db54358717 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:31.876353 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1029/2034] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:31.880417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5402a-875a-49e3-81d5-b0db54358717 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:31.890802 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5402a-875a-49e3-81d5-b0db54358717 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:31.895524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c6497-a92f-46d2-a67f-6c21c31f2662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:31.896407 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c6497-a92f-46d2-a67f-6c21c31f2662 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:31.896686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c6497-a92f-46d2-a67f-6c21c31f2662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:31.896959 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c6497-a92f-46d2-a67f-6c21c31f2662 admin admin] PATH_INFO: `/v3/projects/285ee18c7ad94a8eb01c2bee4a285ba7/users/8aacd1c9bb054cdf930ffbd8ce8939be/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:31.912369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c6497-a92f-46d2-a67f-6c21c31f2662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=285ee18c7ad94a8eb01c2bee4a285ba7, user_id=8aacd1c9bb054cdf930ffbd8ce8939be, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:31.915180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c6497-a92f-46d2-a67f-6c21c31f2662 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:32.039339 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1030/2035] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:31 2022] PUT /identity/v3/projects/285ee18c7ad94a8eb01c2bee4a285ba7/users/8aacd1c9bb054cdf930ffbd8ce8939be/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:32.042332 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112a654-c4d9-4857-84f0-66b7ae5f747e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:32.042626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112a654-c4d9-4857-84f0-66b7ae5f747e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:32.043378 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112a654-c4d9-4857-84f0-66b7ae5f747e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:32.051862 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bb0ad836-244c-49e3-98c1-e53520aac3c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44aaa3ff42444f09816532b00acc718b', 'request_id': 'req-bb0ad836-244c-49e3-98c1-e53520aac3c8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:32.060309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bb0ad836-244c-49e3-98c1-e53520aac3c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44aaa3ff42444f09816532b00acc718b', 'request_id': 'req-bb0ad836-244c-49e3-98c1-e53520aac3c8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:32.082598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c112a654-c4d9-4857-84f0-66b7ae5f747e None None] MFA Rules not processed for user `8aacd1c9bb054cdf930ffbd8ce8939be`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:32.083839 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c112a654-c4d9-4857-84f0-66b7ae5f747e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:32.130526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bb0ad836-244c-49e3-98c1-e53520aac3c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44aaa3ff42444f09816532b00acc718b', 'request_id': 'req-bb0ad836-244c-49e3-98c1-e53520aac3c8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:32.153399 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bb0ad836-244c-49e3-98c1-e53520aac3c8 admin admin] The token cache is being invalidate because project 44aaa3ff42444f09816532b00acc718b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:32.153836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bb0ad836-244c-49e3-98c1-e53520aac3c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:32.154520 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bb0ad836-244c-49e3-98c1-e53520aac3c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:32.156794 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1031/2036] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:32.167124 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1006/2037] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:31 2022] DELETE /identity/v3/projects/44aaa3ff42444f09816532b00acc718b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:32.171565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112a654-c4d9-4857-84f0-66b7ae5f747e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:32.172286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ad836-244c-49e3-98c1-e53520aac3c8 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:32.174405 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-bb0ad836-244c-49e3-98c1-e53520aac3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:32.308557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112a654-c4d9-4857-84f0-66b7ae5f747e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:32.321020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6e0a9-8981-4628-af79-be1e12bfa1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:32.322421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6e0a9-8981-4628-af79-be1e12bfa1a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:32.322700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6e0a9-8981-4628-af79-be1e12bfa1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:32.322975 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6e0a9-8981-4628-af79-be1e12bfa1a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:32.323896 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6e0a9-8981-4628-af79-be1e12bfa1a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:32.330228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6e0a9-8981-4628-af79-be1e12bfa1a7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:32.345994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ad836-244c-49e3-98c1-e53520aac3c8 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:32.352810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30768895-5844-4771-b305-85302cacb9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:32.353825 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30768895-5844-4771-b305-85302cacb9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:32.354253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30768895-5844-4771-b305-85302cacb9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:32.354541 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30768895-5844-4771-b305-85302cacb9f3 admin admin] PATH_INFO: `/v3/users/b1b7596404794e4682182fe5935b4676` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:32.355833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30768895-5844-4771-b305-85302cacb9f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1b7596404794e4682182fe5935b4676)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:32.357885 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30768895-5844-4771-b305-85302cacb9f3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:32.440750 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1032/2038] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:32 2022] POST /identity/v3/projects => generated 367 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:32.442070 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6e0a9-8981-4628-af79-be1e12bfa1a7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:32.444509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ffd6e0a9-8981-4628-af79-be1e12bfa1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:32.510025 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6e0a9-8981-4628-af79-be1e12bfa1a7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:32.514682 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503658f-1368-4601-a42e-27f6f96f82e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:32.515552 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503658f-1368-4601-a42e-27f6f96f82e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:32.515835 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503658f-1368-4601-a42e-27f6f96f82e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:32.516113 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503658f-1368-4601-a42e-27f6f96f82e8 admin admin] PATH_INFO: `/v3/projects/b5952fd770fe42c7933be1b13b134cc5` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:32.517306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503658f-1368-4601-a42e-27f6f96f82e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5952fd770fe42c7933be1b13b134cc5)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:32.520577 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503658f-1368-4601-a42e-27f6f96f82e8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:32.586293 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-30768895-5844-4771-b305-85302cacb9f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1b7596404794e4682182fe5935b4676'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:32.598432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-30768895-5844-4771-b305-85302cacb9f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1b7596404794e4682182fe5935b4676'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:32.599152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-30768895-5844-4771-b305-85302cacb9f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1b7596404794e4682182fe5935b4676'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:32.599770 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-30768895-5844-4771-b305-85302cacb9f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1b7596404794e4682182fe5935b4676'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:32.607912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-30768895-5844-4771-b305-85302cacb9f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1b7596404794e4682182fe5935b4676'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:32.635536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:32.709379 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9503658f-1368-4601-a42e-27f6f96f82e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5952fd770fe42c7933be1b13b134cc5', 'request_id': 'req-9503658f-1368-4601-a42e-27f6f96f82e8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:32.735087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1007/2039] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:32 2022] DELETE /identity/v3/users/b1b7596404794e4682182fe5935b4676 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:32.735938 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30768895-5844-4771-b305-85302cacb9f3 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:32.737456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-30768895-5844-4771-b305-85302cacb9f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:32.833773 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30768895-5844-4771-b305-85302cacb9f3 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:32.840192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fb46f-ca28-4c7e-94fd-9efaeccea0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:32.840915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb46f-ca28-4c7e-94fd-9efaeccea0df admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:32.841191 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb46f-ca28-4c7e-94fd-9efaeccea0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:32.841521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb46f-ca28-4c7e-94fd-9efaeccea0df admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:32.842203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fb46f-ca28-4c7e-94fd-9efaeccea0df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:32.844293 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fb46f-ca28-4c7e-94fd-9efaeccea0df admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:32.849282 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9503658f-1368-4601-a42e-27f6f96f82e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5952fd770fe42c7933be1b13b134cc5', 'request_id': 'req-9503658f-1368-4601-a42e-27f6f96f82e8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:32.856670 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9503658f-1368-4601-a42e-27f6f96f82e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5952fd770fe42c7933be1b13b134cc5', 'request_id': 'req-9503658f-1368-4601-a42e-27f6f96f82e8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:32.868098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9503658f-1368-4601-a42e-27f6f96f82e8 admin admin] The token cache is being invalidate because project b5952fd770fe42c7933be1b13b134cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:32.868393 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9503658f-1368-4601-a42e-27f6f96f82e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:32.869093 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9503658f-1368-4601-a42e-27f6f96f82e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:32.870696 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1033/2040] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:32 2022] DELETE /identity/v3/projects/b5952fd770fe42c7933be1b13b134cc5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:32.875764 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c30268-679b-43ac-9a15-6748a49f4b27 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:32.876043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c30268-679b-43ac-9a15-6748a49f4b27 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:32.876322 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c30268-679b-43ac-9a15-6748a49f4b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:32.895852 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-33c30268-679b-43ac-9a15-6748a49f4b27 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:32.897107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-33c30268-679b-43ac-9a15-6748a49f4b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:32.906988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1034/2041] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:32.915388 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745c323-daaa-4e4e-ad2a-499ce79e9660 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:32.915681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745c323-daaa-4e4e-ad2a-499ce79e9660 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:32.915964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745c323-daaa-4e4e-ad2a-499ce79e9660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:32.935343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3745c323-daaa-4e4e-ad2a-499ce79e9660 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:32.936596 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3745c323-daaa-4e4e-ad2a-499ce79e9660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:32.938356 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:32.945608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1035/2042] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:32.949902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745c323-daaa-4e4e-ad2a-499ce79e9660 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:32.959081 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745c323-daaa-4e4e-ad2a-499ce79e9660 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:32.963987 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910adcf0-fb41-4f05-be11-883cf1afbbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:32.964913 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910adcf0-fb41-4f05-be11-883cf1afbbef admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:32.964913 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910adcf0-fb41-4f05-be11-883cf1afbbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:32.965172 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910adcf0-fb41-4f05-be11-883cf1afbbef admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:32.965938 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910adcf0-fb41-4f05-be11-883cf1afbbef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:32.966246 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910adcf0-fb41-4f05-be11-883cf1afbbef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:32.967881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910adcf0-fb41-4f05-be11-883cf1afbbef admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:32.980057 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1036/2043] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:35:32.984922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910adcf0-fb41-4f05-be11-883cf1afbbef admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:32.990917 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1008/2044] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:32 2022] POST /identity/v3/users => generated 290 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:32.996279 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910adcf0-fb41-4f05-be11-883cf1afbbef admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:33.000187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fb46f-ca28-4c7e-94fd-9efaeccea0df admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:33.001767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2298645-cd45-4256-8e91-54c5c296d07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:33.002350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3c8fb46f-ca28-4c7e-94fd-9efaeccea0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:33.002471 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2298645-cd45-4256-8e91-54c5c296d07f admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:33.002718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2298645-cd45-4256-8e91-54c5c296d07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:33.002999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2298645-cd45-4256-8e91-54c5c296d07f admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:33.003707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2298645-cd45-4256-8e91-54c5c296d07f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:33.005709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2298645-cd45-4256-8e91-54c5c296d07f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:33.022609 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fb46f-ca28-4c7e-94fd-9efaeccea0df admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:33.029168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56420590-c571-4955-9e5a-aedae293bc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:33.030495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56420590-c571-4955-9e5a-aedae293bc0f admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:33.030930 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56420590-c571-4955-9e5a-aedae293bc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:33.031333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56420590-c571-4955-9e5a-aedae293bc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:33.032169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56420590-c571-4955-9e5a-aedae293bc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:33.034750 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56420590-c571-4955-9e5a-aedae293bc0f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:33.056343 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1009/2045] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:33.058382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56420590-c571-4955-9e5a-aedae293bc0f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:33.074600 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56420590-c571-4955-9e5a-aedae293bc0f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:33.079583 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9d2dd-deee-4ef4-96dd-713f022fa07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:33.080537 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9d2dd-deee-4ef4-96dd-713f022fa07c admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:33.080823 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9d2dd-deee-4ef4-96dd-713f022fa07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:33.081090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9d2dd-deee-4ef4-96dd-713f022fa07c admin admin] PATH_INFO: `/v3/projects/cc38a49cc5344c7986055e9d0cdc86a5/users/e5c5bc1e9f4d4e36a92443188114414f/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:33.098734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9d2dd-deee-4ef4-96dd-713f022fa07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc38a49cc5344c7986055e9d0cdc86a5, user_id=e5c5bc1e9f4d4e36a92443188114414f, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:33.102761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9d2dd-deee-4ef4-96dd-713f022fa07c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:33.111931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1037/2046] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:32 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:33.130416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2298645-cd45-4256-8e91-54c5c296d07f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:33.198837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2298645-cd45-4256-8e91-54c5c296d07f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:33.342211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90c73a-883d-4a29-a47e-a8433cd4e52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:33.342211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90c73a-883d-4a29-a47e-a8433cd4e52a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:33.342211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90c73a-883d-4a29-a47e-a8433cd4e52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:33.342211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90c73a-883d-4a29-a47e-a8433cd4e52a admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:33.344049 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90c73a-883d-4a29-a47e-a8433cd4e52a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:33.344049 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90c73a-883d-4a29-a47e-a8433cd4e52a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:33.430607 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1010/2047] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:33 2022] PUT /identity/v3/projects/cc38a49cc5344c7986055e9d0cdc86a5/users/e5c5bc1e9f4d4e36a92443188114414f/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:33.434674 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9d2dd-deee-4ef4-96dd-713f022fa07c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:33.501207 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9d2dd-deee-4ef4-96dd-713f022fa07c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:33.506157 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994eccf-8e4e-407d-9676-bef880fa099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:33.506861 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994eccf-8e4e-407d-9676-bef880fa099a admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:33.507653 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994eccf-8e4e-407d-9676-bef880fa099a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:33.508072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994eccf-8e4e-407d-9676-bef880fa099a admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:33.508954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994eccf-8e4e-407d-9676-bef880fa099a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:33.510627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994eccf-8e4e-407d-9676-bef880fa099a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:33.525139 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1011/2048] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:33.529317 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994eccf-8e4e-407d-9676-bef880fa099a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:33.544743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994eccf-8e4e-407d-9676-bef880fa099a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:33.549902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7393f-e8f3-4b24-801f-76fc5b1382b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:33.554459 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7393f-e8f3-4b24-801f-76fc5b1382b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:33.554755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7393f-e8f3-4b24-801f-76fc5b1382b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:33.555034 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7393f-e8f3-4b24-801f-76fc5b1382b9 admin admin] PATH_INFO: `/v3/projects/cc38a49cc5344c7986055e9d0cdc86a5/users/e5c5bc1e9f4d4e36a92443188114414f/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:33.562240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7393f-e8f3-4b24-801f-76fc5b1382b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc38a49cc5344c7986055e9d0cdc86a5, user_id=e5c5bc1e9f4d4e36a92443188114414f, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:33.562240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7393f-e8f3-4b24-801f-76fc5b1382b9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:33.570245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1038/2049] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:33 2022] POST /identity/v3/users => generated 294 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:33.571696 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90c73a-883d-4a29-a47e-a8433cd4e52a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:33.573718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2e90c73a-883d-4a29-a47e-a8433cd4e52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:33.588667 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1012/2050] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:33 2022] PUT /identity/v3/projects/cc38a49cc5344c7986055e9d0cdc86a5/users/e5c5bc1e9f4d4e36a92443188114414f/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:33.589753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7393f-e8f3-4b24-801f-76fc5b1382b9 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:33.613354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90c73a-883d-4a29-a47e-a8433cd4e52a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:33.708654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4dc008-a9f7-47fe-a63f-242242808cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:33.710012 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dc008-a9f7-47fe-a63f-242242808cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:33.710815 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dc008-a9f7-47fe-a63f-242242808cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:33.711552 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dc008-a9f7-47fe-a63f-242242808cf4 admin admin] PATH_INFO: `/v3/projects/eb00d19943ee42ea8baac2a76ee00a63` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:33.713459 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4dc008-a9f7-47fe-a63f-242242808cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb00d19943ee42ea8baac2a76ee00a63)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:33.715957 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4dc008-a9f7-47fe-a63f-242242808cf4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:33.748839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7393f-e8f3-4b24-801f-76fc5b1382b9 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:33.755846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c98d8-d623-48e2-9f8e-82c0adb4c78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:33.756193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c98d8-d623-48e2-9f8e-82c0adb4c78b admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:33.756356 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c98d8-d623-48e2-9f8e-82c0adb4c78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:33.756626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c98d8-d623-48e2-9f8e-82c0adb4c78b admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:33.758084 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c98d8-d623-48e2-9f8e-82c0adb4c78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:33.760862 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c98d8-d623-48e2-9f8e-82c0adb4c78b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:33.774380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1013/2051] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:33.778221 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296db578-fb0d-4109-9746-257f5b6d971d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:33.778221 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296db578-fb0d-4109-9746-257f5b6d971d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:33.778221 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296db578-fb0d-4109-9746-257f5b6d971d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:33.809779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-296db578-fb0d-4109-9746-257f5b6d971d None None] MFA Rules not processed for user `e5c5bc1e9f4d4e36a92443188114414f`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:33.812345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-296db578-fb0d-4109-9746-257f5b6d971d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:33.887440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1014/2052] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:33.888293 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296db578-fb0d-4109-9746-257f5b6d971d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:33.891688 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-296db578-fb0d-4109-9746-257f5b6d971d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:33.899992 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7b4dc008-a9f7-47fe-a63f-242242808cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb00d19943ee42ea8baac2a76ee00a63', 'request_id': 'req-7b4dc008-a9f7-47fe-a63f-242242808cf4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:33.951340 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296db578-fb0d-4109-9746-257f5b6d971d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:33.983422 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7b4dc008-a9f7-47fe-a63f-242242808cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb00d19943ee42ea8baac2a76ee00a63', 'request_id': 'req-7b4dc008-a9f7-47fe-a63f-242242808cf4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:33.990377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7b4dc008-a9f7-47fe-a63f-242242808cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb00d19943ee42ea8baac2a76ee00a63', 'request_id': 'req-7b4dc008-a9f7-47fe-a63f-242242808cf4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:34.001569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7b4dc008-a9f7-47fe-a63f-242242808cf4 admin admin] The token cache is being invalidate because project eb00d19943ee42ea8baac2a76ee00a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:34.001753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c4948-82f8-46b0-ae90-adb0c944d882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:34.001885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7b4dc008-a9f7-47fe-a63f-242242808cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:34.002408 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c4948-82f8-46b0-ae90-adb0c944d882 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:34.002512 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7b4dc008-a9f7-47fe-a63f-242242808cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:34.002693 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c4948-82f8-46b0-ae90-adb0c944d882 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:34.002973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c4948-82f8-46b0-ae90-adb0c944d882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:34.004137 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1039/2053] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:33 2022] DELETE /identity/v3/projects/eb00d19943ee42ea8baac2a76ee00a63 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:34.005101 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cf8c4948-82f8-46b0-ae90-adb0c944d882 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:34.010495 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4dc008-a9f7-47fe-a63f-242242808cf4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:34.014529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7b4dc008-a9f7-47fe-a63f-242242808cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:34.075490 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c4948-82f8-46b0-ae90-adb0c944d882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:34.077042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c4948-82f8-46b0-ae90-adb0c944d882 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:34.085754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4dc008-a9f7-47fe-a63f-242242808cf4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:34.087816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1015/2054] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:34.089064 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c4948-82f8-46b0-ae90-adb0c944d882 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:34.090491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cf8c4948-82f8-46b0-ae90-adb0c944d882 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:34.099849 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c170653-c39c-4c52-a53b-0ec6d090ec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:34.101356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c170653-c39c-4c52-a53b-0ec6d090ec7f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:34.101942 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c170653-c39c-4c52-a53b-0ec6d090ec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:34.102226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c170653-c39c-4c52-a53b-0ec6d090ec7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:34.103672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c170653-c39c-4c52-a53b-0ec6d090ec7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:34.105445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c170653-c39c-4c52-a53b-0ec6d090ec7f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:34.110894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c4948-82f8-46b0-ae90-adb0c944d882 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:34.118140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1040/2055] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:34.121536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a03ec7-6e79-437d-aa07-f457dd4d9f1e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:34.121536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a03ec7-6e79-437d-aa07-f457dd4d9f1e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:34.121536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a03ec7-6e79-437d-aa07-f457dd4d9f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:34.126389 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7abe0-697c-478c-92a6-cc6bfee5befc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:34.126962 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7abe0-697c-478c-92a6-cc6bfee5befc service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:34.127254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7abe0-697c-478c-92a6-cc6bfee5befc service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:34.127597 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7abe0-697c-478c-92a6-cc6bfee5befc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:34.132440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-52c7abe0-697c-478c-92a6-cc6bfee5befc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:34.143953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-12a03ec7-6e79-437d-aa07-f457dd4d9f1e None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:34.149693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-12a03ec7-6e79-437d-aa07-f457dd4d9f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:34.155825 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1041/2056] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:34.157457 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7629ef-5ff1-4767-8f83-3f45410f4a19 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:34.157750 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7629ef-5ff1-4767-8f83-3f45410f4a19 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:34.158036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7629ef-5ff1-4767-8f83-3f45410f4a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:34.190804 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6e7629ef-5ff1-4767-8f83-3f45410f4a19 None None] MFA Rules not processed for user `d4eeb8684c1e4c8da065e92fc5f04c01`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:34.192197 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6e7629ef-5ff1-4767-8f83-3f45410f4a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:34.218841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7abe0-697c-478c-92a6-cc6bfee5befc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:34.221002 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7abe0-697c-478c-92a6-cc6bfee5befc service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:34.232587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1016/2057] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:34 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:34.233355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7abe0-697c-478c-92a6-cc6bfee5befc service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:34.245807 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7abe0-697c-478c-92a6-cc6bfee5befc service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:34.252557 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc64d6-1666-409c-9841-152fd8cc4af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:34.253298 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc64d6-1666-409c-9841-152fd8cc4af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:34.253785 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc64d6-1666-409c-9841-152fd8cc4af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:34.254226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc64d6-1666-409c-9841-152fd8cc4af3 admin admin] PATH_INFO: `/v3/projects/d1c95cfb03de43548bb42f7bac20c9fa/users/f491b528d3fd4faeb8831dd53d64620e/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:34.272715 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc64d6-1666-409c-9841-152fd8cc4af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c95cfb03de43548bb42f7bac20c9fa, user_id=f491b528d3fd4faeb8831dd53d64620e, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:34.273617 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1042/2058] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:34.275046 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f566c-0ced-46fc-ad48-6b62c36c6a9f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:34.275343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f566c-0ced-46fc-ad48-6b62c36c6a9f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:34.275561 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc64d6-1666-409c-9841-152fd8cc4af3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:34.275682 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f566c-0ced-46fc-ad48-6b62c36c6a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:34.295082 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1e9f566c-0ced-46fc-ad48-6b62c36c6a9f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:34.296293 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1e9f566c-0ced-46fc-ad48-6b62c36c6a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:34.304965 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1043/2059] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:34.310590 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f566c-0ced-46fc-ad48-6b62c36c6a9f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:34.319810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f566c-0ced-46fc-ad48-6b62c36c6a9f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:34.324509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16927f-59e5-40cc-8d03-596e879bde3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:34.325154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16927f-59e5-40cc-8d03-596e879bde3e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:34.325474 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16927f-59e5-40cc-8d03-596e879bde3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:34.325750 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16927f-59e5-40cc-8d03-596e879bde3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:34.326473 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16927f-59e5-40cc-8d03-596e879bde3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:34.326779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16927f-59e5-40cc-8d03-596e879bde3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:34.328369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16927f-59e5-40cc-8d03-596e879bde3e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:34.340383 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1044/2060] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:35:34.344902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16927f-59e5-40cc-8d03-596e879bde3e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:34.358187 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16927f-59e5-40cc-8d03-596e879bde3e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:34.365707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc3c37-3703-4ffd-990e-0756f01bffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:34.366375 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc3c37-3703-4ffd-990e-0756f01bffb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:34.367357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc3c37-3703-4ffd-990e-0756f01bffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:34.367636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc3c37-3703-4ffd-990e-0756f01bffb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:34.368330 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc3c37-3703-4ffd-990e-0756f01bffb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:34.370370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc3c37-3703-4ffd-990e-0756f01bffb3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:34.385556 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1017/2061] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:34 2022] PUT /identity/v3/projects/d1c95cfb03de43548bb42f7bac20c9fa/users/f491b528d3fd4faeb8831dd53d64620e/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:34.395186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc64d6-1666-409c-9841-152fd8cc4af3 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:34.450837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc64d6-1666-409c-9841-152fd8cc4af3 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:34.454486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6193b90-044e-4e84-8cc3-f307a5ccb964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:34.455132 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6193b90-044e-4e84-8cc3-f307a5ccb964 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:34.455413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6193b90-044e-4e84-8cc3-f307a5ccb964 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:34.455686 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6193b90-044e-4e84-8cc3-f307a5ccb964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:34.482608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1045/2062] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:34 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:34.483996 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c2035-5203-47a2-b83e-9c3f6774e59c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:34.485349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c2035-5203-47a2-b83e-9c3f6774e59c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:34.485349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c2035-5203-47a2-b83e-9c3f6774e59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:34.520885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-608c2035-5203-47a2-b83e-9c3f6774e59c None None] MFA Rules not processed for user `f491b528d3fd4faeb8831dd53d64620e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:34.522129 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6193b90-044e-4e84-8cc3-f307a5ccb964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:34.522517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-608c2035-5203-47a2-b83e-9c3f6774e59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:34.524201 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6193b90-044e-4e84-8cc3-f307a5ccb964 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:34.533850 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1018/2063] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:34.534674 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6193b90-044e-4e84-8cc3-f307a5ccb964 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:34.594842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1046/2064] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:34.599007 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c2035-5203-47a2-b83e-9c3f6774e59c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:34.602481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6193b90-044e-4e84-8cc3-f307a5ccb964 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:34.674176 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c2035-5203-47a2-b83e-9c3f6774e59c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:34.687758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a52fe5-a538-4d3d-91aa-31c31ae4e35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:34.687920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a52fe5-a538-4d3d-91aa-31c31ae4e35d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:34.688081 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a52fe5-a538-4d3d-91aa-31c31ae4e35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:34.688357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a52fe5-a538-4d3d-91aa-31c31ae4e35d admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:34.689058 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a52fe5-a538-4d3d-91aa-31c31ae4e35d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:34.691499 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a52fe5-a538-4d3d-91aa-31c31ae4e35d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:34.694118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46f01c-680b-4e34-ba00-1a22a5740cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:34.695324 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46f01c-680b-4e34-ba00-1a22a5740cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:34.695659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46f01c-680b-4e34-ba00-1a22a5740cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:34.696134 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46f01c-680b-4e34-ba00-1a22a5740cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:34.696841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46f01c-680b-4e34-ba00-1a22a5740cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:34.699610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46f01c-680b-4e34-ba00-1a22a5740cf3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:34.825794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1019/2065] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:34 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:34.827029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1047/2066] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:34 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:34.831148 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46f01c-680b-4e34-ba00-1a22a5740cf3 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:34.832418 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a52fe5-a538-4d3d-91aa-31c31ae4e35d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:34.842721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46f01c-680b-4e34-ba00-1a22a5740cf3 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:34.928520 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a52fe5-a538-4d3d-91aa-31c31ae4e35d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:34.931650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ca427-9a46-407a-a196-1a4d1d9b38e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:34.936449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ca427-9a46-407a-a196-1a4d1d9b38e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:34.936449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ca427-9a46-407a-a196-1a4d1d9b38e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:34.936449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ca427-9a46-407a-a196-1a4d1d9b38e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:34.936449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ca427-9a46-407a-a196-1a4d1d9b38e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:34.936932 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e4f2a-2bba-439f-989c-9d4d460631ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:34.937039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ca427-9a46-407a-a196-1a4d1d9b38e8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:34.937125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e4f2a-2bba-439f-989c-9d4d460631ea admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:34.937125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e4f2a-2bba-439f-989c-9d4d460631ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:34.937298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e4f2a-2bba-439f-989c-9d4d460631ea admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:34.938091 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e4f2a-2bba-439f-989c-9d4d460631ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:34.940162 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e4f2a-2bba-439f-989c-9d4d460631ea admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:34.954751 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1020/2067] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:34.954751 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ca427-9a46-407a-a196-1a4d1d9b38e8 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:34.973196 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ca427-9a46-407a-a196-1a4d1d9b38e8 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:34.980271 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6286e-7338-4bcb-810c-5561c7910413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:34.981067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6286e-7338-4bcb-810c-5561c7910413 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:34.981573 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6286e-7338-4bcb-810c-5561c7910413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:34.981859 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6286e-7338-4bcb-810c-5561c7910413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:34.982595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6286e-7338-4bcb-810c-5561c7910413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:34.984252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6286e-7338-4bcb-810c-5561c7910413 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:34.996771 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1021/2068] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:35.001507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6286e-7338-4bcb-810c-5561c7910413 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:35.012762 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6286e-7338-4bcb-810c-5561c7910413 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:35.017647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dde9c-3441-4575-ad07-192aa41051da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:35.018547 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dde9c-3441-4575-ad07-192aa41051da admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:35.020088 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dde9c-3441-4575-ad07-192aa41051da admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:35.020088 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dde9c-3441-4575-ad07-192aa41051da admin admin] PATH_INFO: `/v3/projects/354a206a35974ffe8d488fc0603c092b/users/37cc6f62c016454295753b775c0b2019/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:35.038211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dde9c-3441-4575-ad07-192aa41051da admin admin] RBAC: Authorizing `identity:create_grant(project_id=354a206a35974ffe8d488fc0603c092b, user_id=37cc6f62c016454295753b775c0b2019, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:35.040621 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1048/2069] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:34 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:35.041938 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dde9c-3441-4575-ad07-192aa41051da admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:35.047977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e4f2a-2bba-439f-989c-9d4d460631ea admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:35.079855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e4f2a-2bba-439f-989c-9d4d460631ea admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:35.085030 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a1f68-78b6-46b5-8af7-8b4d6f213c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:35.085782 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a1f68-78b6-46b5-8af7-8b4d6f213c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:35.086073 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a1f68-78b6-46b5-8af7-8b4d6f213c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:35.086538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a1f68-78b6-46b5-8af7-8b4d6f213c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:35.087300 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a1f68-78b6-46b5-8af7-8b4d6f213c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:35.088921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a1f68-78b6-46b5-8af7-8b4d6f213c4f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:35.095943 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:35.102331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1049/2070] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:35.106462 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a1f68-78b6-46b5-8af7-8b4d6f213c4f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:35.116308 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a1f68-78b6-46b5-8af7-8b4d6f213c4f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:35.121967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb1938-b821-446d-ac2a-60b2731a385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:35.122846 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1938-b821-446d-ac2a-60b2731a385c admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:35.123383 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1938-b821-446d-ac2a-60b2731a385c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:35.123652 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1938-b821-446d-ac2a-60b2731a385c admin admin] PATH_INFO: `/v3/projects/eabded33afd24a4c91091581ff2b1f12/users/cb350a8c749c45529289d327a74df729/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:35.138899 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb1938-b821-446d-ac2a-60b2731a385c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eabded33afd24a4c91091581ff2b1f12, user_id=cb350a8c749c45529289d327a74df729, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:35.141654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb1938-b821-446d-ac2a-60b2731a385c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:35.157579 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1022/2071] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:35 2022] PUT /identity/v3/projects/354a206a35974ffe8d488fc0603c092b/users/37cc6f62c016454295753b775c0b2019/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:35.169315 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f205a9-d939-48fc-8a6c-5ac54948b967 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:35.169579 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f205a9-d939-48fc-8a6c-5ac54948b967 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:35.169893 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f205a9-d939-48fc-8a6c-5ac54948b967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:35.198834 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-24f205a9-d939-48fc-8a6c-5ac54948b967 None None] MFA Rules not processed for user `37cc6f62c016454295753b775c0b2019`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:35.201249 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-24f205a9-d939-48fc-8a6c-5ac54948b967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:35.227597 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1050/2072] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:35 2022] PUT /identity/v3/projects/eabded33afd24a4c91091581ff2b1f12/users/cb350a8c749c45529289d327a74df729/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:35.233219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb1938-b821-446d-ac2a-60b2731a385c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:35.268752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1023/2073] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:35.273897 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f205a9-d939-48fc-8a6c-5ac54948b967 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:35.297177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb1938-b821-446d-ac2a-60b2731a385c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:35.302196 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4803a4f-8e4c-42fb-8aec-4bf79bb7d358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:35.302873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4803a4f-8e4c-42fb-8aec-4bf79bb7d358 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:35.303156 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4803a4f-8e4c-42fb-8aec-4bf79bb7d358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:35.303431 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4803a4f-8e4c-42fb-8aec-4bf79bb7d358 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:35.304254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4803a4f-8e4c-42fb-8aec-4bf79bb7d358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:35.311774 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4803a4f-8e4c-42fb-8aec-4bf79bb7d358 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:35.327182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1051/2074] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:35.328290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4803a4f-8e4c-42fb-8aec-4bf79bb7d358 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:35.358282 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f205a9-d939-48fc-8a6c-5ac54948b967 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:35.363319 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749ab3a-3b07-4855-b9ae-c7d100247a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:35.363627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ab3a-3b07-4855-b9ae-c7d100247a5e admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:35.363931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ab3a-3b07-4855-b9ae-c7d100247a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:35.364205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ab3a-3b07-4855-b9ae-c7d100247a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:35.364901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749ab3a-3b07-4855-b9ae-c7d100247a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:35.366906 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749ab3a-3b07-4855-b9ae-c7d100247a5e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:35.370521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=81,keystone:DELETE=15,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:35.388096 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4803a4f-8e4c-42fb-8aec-4bf79bb7d358 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:35.392621 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0f3bc-9348-4b86-9b65-91789d2f5766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:35.392911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0f3bc-9348-4b86-9b65-91789d2f5766 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:35.397182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0f3bc-9348-4b86-9b65-91789d2f5766 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:35.397182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0f3bc-9348-4b86-9b65-91789d2f5766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:35.397182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-44f0f3bc-9348-4b86-9b65-91789d2f5766 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:35.461848 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1024/2075] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:35 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:35.461848 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749ab3a-3b07-4855-b9ae-c7d100247a5e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:35.501568 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0f3bc-9348-4b86-9b65-91789d2f5766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:35.504781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0f3bc-9348-4b86-9b65-91789d2f5766 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:35.518860 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1052/2076] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:35.532269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0f3bc-9348-4b86-9b65-91789d2f5766 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:35.544432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749ab3a-3b07-4855-b9ae-c7d100247a5e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:35.547152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0f3bc-9348-4b86-9b65-91789d2f5766 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:35.549495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad9069-9653-4807-a1bb-be95bd020fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:35.550547 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad9069-9653-4807-a1bb-be95bd020fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:35.550898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad9069-9653-4807-a1bb-be95bd020fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:35.551174 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad9069-9653-4807-a1bb-be95bd020fd4 admin admin] PATH_INFO: `/v3/projects/eabded33afd24a4c91091581ff2b1f12/users/cb350a8c749c45529289d327a74df729/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:35.553407 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad9069-9653-4807-a1bb-be95bd020fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eabded33afd24a4c91091581ff2b1f12, user_id=cb350a8c749c45529289d327a74df729, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:35.553569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626eb62-d44d-4230-8c54-b25b804c0b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:35.554784 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626eb62-d44d-4230-8c54-b25b804c0b5c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:35.555152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626eb62-d44d-4230-8c54-b25b804c0b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:35.555506 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626eb62-d44d-4230-8c54-b25b804c0b5c admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:35.556352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626eb62-d44d-4230-8c54-b25b804c0b5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:35.557617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad9069-9653-4807-a1bb-be95bd020fd4 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:35.558474 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626eb62-d44d-4230-8c54-b25b804c0b5c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:35.574048 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1025/2077] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:35 2022] PUT /identity/v3/projects/eabded33afd24a4c91091581ff2b1f12/users/cb350a8c749c45529289d327a74df729/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:35.586583 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cca87-08f4-407b-b69b-1f1f196f343f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:35.586934 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cca87-08f4-407b-b69b-1f1f196f343f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:35.587198 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cca87-08f4-407b-b69b-1f1f196f343f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:35.631254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-452cca87-08f4-407b-b69b-1f1f196f343f None None] MFA Rules not processed for user `cb350a8c749c45529289d327a74df729`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:35.634302 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-452cca87-08f4-407b-b69b-1f1f196f343f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:35.696392 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:35.707156 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1053/2078] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:35 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:35.711967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626eb62-d44d-4230-8c54-b25b804c0b5c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:35.725580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626eb62-d44d-4230-8c54-b25b804c0b5c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:35.767380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1026/2079] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:35.806636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24913c-5276-4d74-8237-01dfd843105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:35.807346 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24913c-5276-4d74-8237-01dfd843105c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:35.807639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24913c-5276-4d74-8237-01dfd843105c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:35.807920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24913c-5276-4d74-8237-01dfd843105c admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:35.808659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24913c-5276-4d74-8237-01dfd843105c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:35.810441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24913c-5276-4d74-8237-01dfd843105c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:35.821155 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1054/2080] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:35.825348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cca87-08f4-407b-b69b-1f1f196f343f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:35.847236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cca87-08f4-407b-b69b-1f1f196f343f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:35.854848 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079befc5-a153-4239-83fa-8b6063590ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:35.856074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079befc5-a153-4239-83fa-8b6063590ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:35.856191 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079befc5-a153-4239-83fa-8b6063590ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:35.856465 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079befc5-a153-4239-83fa-8b6063590ad5 admin admin] PATH_INFO: `/v3/projects/75682a5475d34deb9b947e9dabb7fd9d/users/e2a86d728d8c4de1bee6f9acb534bbc0/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:35.875177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079befc5-a153-4239-83fa-8b6063590ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75682a5475d34deb9b947e9dabb7fd9d, user_id=e2a86d728d8c4de1bee6f9acb534bbc0, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:35.878147 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079befc5-a153-4239-83fa-8b6063590ad5 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:36.005228 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1027/2081] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:35 2022] PUT /identity/v3/projects/75682a5475d34deb9b947e9dabb7fd9d/users/e2a86d728d8c4de1bee6f9acb534bbc0/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:36.009464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24913c-5276-4d74-8237-01dfd843105c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:36.020823 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24913c-5276-4d74-8237-01dfd843105c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:36.097979 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf975487-f931-498c-a9fd-516c1b521b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:36.098674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf975487-f931-498c-a9fd-516c1b521b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:36.098961 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf975487-f931-498c-a9fd-516c1b521b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:36.099431 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf975487-f931-498c-a9fd-516c1b521b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:36.100408 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf975487-f931-498c-a9fd-516c1b521b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:36.103228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf975487-f931-498c-a9fd-516c1b521b4e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:36.114096 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1055/2082] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:36.118441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079befc5-a153-4239-83fa-8b6063590ad5 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:36.130389 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079befc5-a153-4239-83fa-8b6063590ad5 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:36.136965 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6e7ae-7d90-437f-a2fd-af72c9584524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:36.137945 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6e7ae-7d90-437f-a2fd-af72c9584524 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:36.138225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6e7ae-7d90-437f-a2fd-af72c9584524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:36.141587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6e7ae-7d90-437f-a2fd-af72c9584524 admin admin] PATH_INFO: `/v3/projects/75682a5475d34deb9b947e9dabb7fd9d/users/e2a86d728d8c4de1bee6f9acb534bbc0/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:36.143912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6e7ae-7d90-437f-a2fd-af72c9584524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75682a5475d34deb9b947e9dabb7fd9d, user_id=e2a86d728d8c4de1bee6f9acb534bbc0, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:36.147344 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6e7ae-7d90-437f-a2fd-af72c9584524 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:36.171173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1028/2083] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:36 2022] PUT /identity/v3/projects/75682a5475d34deb9b947e9dabb7fd9d/users/e2a86d728d8c4de1bee6f9acb534bbc0/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:36.173449 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524808c2-0997-4b83-b6be-debc1a02cce9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:36.174033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524808c2-0997-4b83-b6be-debc1a02cce9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:36.174442 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524808c2-0997-4b83-b6be-debc1a02cce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:36.183690 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6e7ae-7d90-437f-a2fd-af72c9584524 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:36.191978 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2bf6e7ae-7d90-437f-a2fd-af72c9584524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:36.212183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-524808c2-0997-4b83-b6be-debc1a02cce9 None None] MFA Rules not processed for user `e2a86d728d8c4de1bee6f9acb534bbc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:36.213459 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-524808c2-0997-4b83-b6be-debc1a02cce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:36.307085 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6e7ae-7d90-437f-a2fd-af72c9584524 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:36.312468 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50097a13-e33c-4316-b5a3-f131f4949ee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:36.313762 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50097a13-e33c-4316-b5a3-f131f4949ee4 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:36.314296 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50097a13-e33c-4316-b5a3-f131f4949ee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:36.314592 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50097a13-e33c-4316-b5a3-f131f4949ee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:36.339199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1056/2084] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:36.390957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50097a13-e33c-4316-b5a3-f131f4949ee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:36.392437 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50097a13-e33c-4316-b5a3-f131f4949ee4 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:36.406610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1029/2085] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:36.414319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524808c2-0997-4b83-b6be-debc1a02cce9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:36.424467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524808c2-0997-4b83-b6be-debc1a02cce9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:36.428354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fe0d3-0acd-497a-a659-fb3938f4254e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:36.429384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe0d3-0acd-497a-a659-fb3938f4254e service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:36.429683 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe0d3-0acd-497a-a659-fb3938f4254e service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:36.430062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe0d3-0acd-497a-a659-fb3938f4254e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:36.431809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-414fe0d3-0acd-497a-a659-fb3938f4254e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:36.461513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50097a13-e33c-4316-b5a3-f131f4949ee4 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:36.471022 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50097a13-e33c-4316-b5a3-f131f4949ee4 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:36.475171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05208ac-9f69-4247-9cc7-f44a75d5c143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:36.476357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05208ac-9f69-4247-9cc7-f44a75d5c143 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:36.476640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05208ac-9f69-4247-9cc7-f44a75d5c143 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:36.476915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05208ac-9f69-4247-9cc7-f44a75d5c143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:36.486751 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05208ac-9f69-4247-9cc7-f44a75d5c143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:36.488200 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05208ac-9f69-4247-9cc7-f44a75d5c143 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:36.499818 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1030/2086] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:36.506013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fe0d3-0acd-497a-a659-fb3938f4254e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:36.507696 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fe0d3-0acd-497a-a659-fb3938f4254e service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:36.518543 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1057/2087] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:36.671315 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05208ac-9f69-4247-9cc7-f44a75d5c143 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:36.740902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05208ac-9f69-4247-9cc7-f44a75d5c143 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:36.748561 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea0cda-294c-4ef3-93bc-83b8c309dd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:36.750627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea0cda-294c-4ef3-93bc-83b8c309dd0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:36.750627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea0cda-294c-4ef3-93bc-83b8c309dd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:36.750627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea0cda-294c-4ef3-93bc-83b8c309dd0b admin admin] PATH_INFO: `/v3/users/f491b528d3fd4faeb8831dd53d64620e` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:36.751692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea0cda-294c-4ef3-93bc-83b8c309dd0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f491b528d3fd4faeb8831dd53d64620e)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:36.754262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea0cda-294c-4ef3-93bc-83b8c309dd0b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:36.797290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712307c-5043-4a07-8117-980ad48a9da3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:36.803333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712307c-5043-4a07-8117-980ad48a9da3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:36.803333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712307c-5043-4a07-8117-980ad48a9da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:36.817730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6712307c-5043-4a07-8117-980ad48a9da3 None None] MFA Rules not processed for user `d4eeb8684c1e4c8da065e92fc5f04c01`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:36.819006 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6712307c-5043-4a07-8117-980ad48a9da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:36.879286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1058/2088] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:37.054418 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ffea0cda-294c-4ef3-93bc-83b8c309dd0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f491b528d3fd4faeb8831dd53d64620e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:37.066835 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ffea0cda-294c-4ef3-93bc-83b8c309dd0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f491b528d3fd4faeb8831dd53d64620e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:37.067995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ffea0cda-294c-4ef3-93bc-83b8c309dd0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f491b528d3fd4faeb8831dd53d64620e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:37.070482 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:37.071272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ffea0cda-294c-4ef3-93bc-83b8c309dd0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f491b528d3fd4faeb8831dd53d64620e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:37.079006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ffea0cda-294c-4ef3-93bc-83b8c309dd0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f491b528d3fd4faeb8831dd53d64620e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:37.166619 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1031/2089] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:36 2022] DELETE /identity/v3/users/f491b528d3fd4faeb8831dd53d64620e => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:37.172603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b6538-fc0f-4e0f-8dc7-015e90038725 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:37.173099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b6538-fc0f-4e0f-8dc7-015e90038725 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:37.173306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b6538-fc0f-4e0f-8dc7-015e90038725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:37.203350 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-814b6538-fc0f-4e0f-8dc7-015e90038725 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:37.204957 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-814b6538-fc0f-4e0f-8dc7-015e90038725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:37.308720 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1059/2090] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:37.326453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea0cda-294c-4ef3-93bc-83b8c309dd0b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:37.327891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ffea0cda-294c-4ef3-93bc-83b8c309dd0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:37.430336 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=4,keystone:SELECT=90,keystone:INSERT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:37.471950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea0cda-294c-4ef3-93bc-83b8c309dd0b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:37.476652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e87d3-c4ad-4f8d-8774-034165e88821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:37.477582 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e87d3-c4ad-4f8d-8774-034165e88821 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:37.477876 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e87d3-c4ad-4f8d-8774-034165e88821 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:37.478159 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e87d3-c4ad-4f8d-8774-034165e88821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:37.493418 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e87d3-c4ad-4f8d-8774-034165e88821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:37.497002 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e87d3-c4ad-4f8d-8774-034165e88821 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:37.512667 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1032/2091] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:37.999926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b6538-fc0f-4e0f-8dc7-015e90038725 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:38.001759 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-814b6538-fc0f-4e0f-8dc7-015e90038725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:38.022130 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b6538-fc0f-4e0f-8dc7-015e90038725 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:38.027799 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbe145-867d-40e8-a9e8-538bf026ad80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:38.029104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbe145-867d-40e8-a9e8-538bf026ad80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:38.029486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbe145-867d-40e8-a9e8-538bf026ad80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:38.029880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbe145-867d-40e8-a9e8-538bf026ad80 admin admin] PATH_INFO: `/v3/projects/d1c95cfb03de43548bb42f7bac20c9fa` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:38.031256 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbe145-867d-40e8-a9e8-538bf026ad80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1c95cfb03de43548bb42f7bac20c9fa)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:38.033626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbe145-867d-40e8-a9e8-538bf026ad80 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:38.152767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-36bbe145-867d-40e8-a9e8-538bf026ad80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1c95cfb03de43548bb42f7bac20c9fa', 'request_id': 'req-36bbe145-867d-40e8-a9e8-538bf026ad80'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:38.239114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-36bbe145-867d-40e8-a9e8-538bf026ad80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1c95cfb03de43548bb42f7bac20c9fa', 'request_id': 'req-36bbe145-867d-40e8-a9e8-538bf026ad80'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:38.251269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-36bbe145-867d-40e8-a9e8-538bf026ad80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1c95cfb03de43548bb42f7bac20c9fa', 'request_id': 'req-36bbe145-867d-40e8-a9e8-538bf026ad80'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:38.265631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-36bbe145-867d-40e8-a9e8-538bf026ad80 admin admin] The token cache is being invalidate because project d1c95cfb03de43548bb42f7bac20c9fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:38.266055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-36bbe145-867d-40e8-a9e8-538bf026ad80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:38.266790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-36bbe145-867d-40e8-a9e8-538bf026ad80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:38.268425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1060/2092] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:37 2022] DELETE /identity/v3/projects/d1c95cfb03de43548bb42f7bac20c9fa => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:38.272370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e87d3-c4ad-4f8d-8774-034165e88821 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:38.283328 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e87d3-c4ad-4f8d-8774-034165e88821 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:38.362248 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a40d4-df65-44a3-a9b2-12caafa581f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:38.363126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a40d4-df65-44a3-a9b2-12caafa581f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:38.363410 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a40d4-df65-44a3-a9b2-12caafa581f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:38.363689 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a40d4-df65-44a3-a9b2-12caafa581f4 admin admin] PATH_INFO: `/v3/users/cb350a8c749c45529289d327a74df729` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:38.364963 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a40d4-df65-44a3-a9b2-12caafa581f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb350a8c749c45529289d327a74df729)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:38.368210 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a40d4-df65-44a3-a9b2-12caafa581f4 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:38.613834 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-714a40d4-df65-44a3-a9b2-12caafa581f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb350a8c749c45529289d327a74df729'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:38.630821 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-714a40d4-df65-44a3-a9b2-12caafa581f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb350a8c749c45529289d327a74df729'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:38.631578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-714a40d4-df65-44a3-a9b2-12caafa581f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb350a8c749c45529289d327a74df729'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:38.632203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-714a40d4-df65-44a3-a9b2-12caafa581f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb350a8c749c45529289d327a74df729'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:38.640438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-714a40d4-df65-44a3-a9b2-12caafa581f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb350a8c749c45529289d327a74df729'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:38.785518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1033/2093] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:38 2022] DELETE /identity/v3/users/cb350a8c749c45529289d327a74df729 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:38.874711 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbe145-867d-40e8-a9e8-538bf026ad80 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:38.876270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-36bbe145-867d-40e8-a9e8-538bf026ad80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:38.892556 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbe145-867d-40e8-a9e8-538bf026ad80 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:38.952062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278d3b2-6a2d-419d-a99c-3efe4fbae32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:38.952963 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278d3b2-6a2d-419d-a99c-3efe4fbae32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:38.953291 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278d3b2-6a2d-419d-a99c-3efe4fbae32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:38.953619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278d3b2-6a2d-419d-a99c-3efe4fbae32c admin admin] PATH_INFO: `/v3/users/37cc6f62c016454295753b775c0b2019` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:38.954883 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278d3b2-6a2d-419d-a99c-3efe4fbae32c admin admin] RBAC: Authorizing `identity:delete_user(user_id=37cc6f62c016454295753b775c0b2019)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:38.956867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278d3b2-6a2d-419d-a99c-3efe4fbae32c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:39.185727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d278d3b2-6a2d-419d-a99c-3efe4fbae32c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37cc6f62c016454295753b775c0b2019'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:39.207436 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d278d3b2-6a2d-419d-a99c-3efe4fbae32c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37cc6f62c016454295753b775c0b2019'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:39.215515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d278d3b2-6a2d-419d-a99c-3efe4fbae32c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37cc6f62c016454295753b775c0b2019'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:39.216593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d278d3b2-6a2d-419d-a99c-3efe4fbae32c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37cc6f62c016454295753b775c0b2019'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:39.217351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d278d3b2-6a2d-419d-a99c-3efe4fbae32c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37cc6f62c016454295753b775c0b2019'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:39.287554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a40d4-df65-44a3-a9b2-12caafa581f4 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:39.289966 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-714a40d4-df65-44a3-a9b2-12caafa581f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:39.305237 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a40d4-df65-44a3-a9b2-12caafa581f4 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:39.310160 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913e3d8-a129-42e7-9cc2-67f62702056b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:39.311213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913e3d8-a129-42e7-9cc2-67f62702056b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:39.311508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913e3d8-a129-42e7-9cc2-67f62702056b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:39.311788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913e3d8-a129-42e7-9cc2-67f62702056b admin admin] PATH_INFO: `/v3/projects/eabded33afd24a4c91091581ff2b1f12` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:39.319015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913e3d8-a129-42e7-9cc2-67f62702056b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eabded33afd24a4c91091581ff2b1f12)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:39.321676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913e3d8-a129-42e7-9cc2-67f62702056b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:39.328317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1061/2094] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:38 2022] DELETE /identity/v3/users/37cc6f62c016454295753b775c0b2019 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:39.334284 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d334d5-bf97-4d5f-aad2-5ec289776cdc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:39.334284 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d334d5-bf97-4d5f-aad2-5ec289776cdc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:39.334284 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d334d5-bf97-4d5f-aad2-5ec289776cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:39.358506 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-45d334d5-bf97-4d5f-aad2-5ec289776cdc None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:39.359679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-45d334d5-bf97-4d5f-aad2-5ec289776cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:39.408767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:39.420599 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1062/2095] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:39.430658 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d334d5-bf97-4d5f-aad2-5ec289776cdc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:39.432076 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-45d334d5-bf97-4d5f-aad2-5ec289776cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:39.456580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9913e3d8-a129-42e7-9cc2-67f62702056b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eabded33afd24a4c91091581ff2b1f12', 'request_id': 'req-9913e3d8-a129-42e7-9cc2-67f62702056b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:39.464277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9913e3d8-a129-42e7-9cc2-67f62702056b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eabded33afd24a4c91091581ff2b1f12', 'request_id': 'req-9913e3d8-a129-42e7-9cc2-67f62702056b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:39.506945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d334d5-bf97-4d5f-aad2-5ec289776cdc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:39.549215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9913e3d8-a129-42e7-9cc2-67f62702056b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eabded33afd24a4c91091581ff2b1f12', 'request_id': 'req-9913e3d8-a129-42e7-9cc2-67f62702056b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:39.565292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9913e3d8-a129-42e7-9cc2-67f62702056b admin admin] The token cache is being invalidate because project eabded33afd24a4c91091581ff2b1f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:39.565624 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9913e3d8-a129-42e7-9cc2-67f62702056b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:39.566449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9913e3d8-a129-42e7-9cc2-67f62702056b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:39.568361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1034/2096] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:39 2022] DELETE /identity/v3/projects/eabded33afd24a4c91091581ff2b1f12 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:39.572780 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fb056-da9d-42db-b606-b5121a3e85e2 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:39.573250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fb056-da9d-42db-b606-b5121a3e85e2 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:39.573901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fb056-da9d-42db-b606-b5121a3e85e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:39.591155 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13173d-ccd8-4fd1-8b59-bc431df65251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:39.591924 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13173d-ccd8-4fd1-8b59-bc431df65251 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:39.592461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13173d-ccd8-4fd1-8b59-bc431df65251 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:39.592818 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13173d-ccd8-4fd1-8b59-bc431df65251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:39.595163 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9e13173d-ccd8-4fd1-8b59-bc431df65251 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:39.599649 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-958fb056-da9d-42db-b606-b5121a3e85e2 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:39.601643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-958fb056-da9d-42db-b606-b5121a3e85e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:39.685558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:39.697047 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13173d-ccd8-4fd1-8b59-bc431df65251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:39.698876 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13173d-ccd8-4fd1-8b59-bc431df65251 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:39.705299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1035/2097] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:39.706995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c1aab-ab4d-4973-a481-67ce12b6cce4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:39.707291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c1aab-ab4d-4973-a481-67ce12b6cce4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:39.707574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c1aab-ab4d-4973-a481-67ce12b6cce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:39.715071 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1063/2098] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:39.730655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d72c1aab-ab4d-4973-a481-67ce12b6cce4 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:39.730655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d72c1aab-ab4d-4973-a481-67ce12b6cce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:39.743680 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1036/2099] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:39.744409 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13173d-ccd8-4fd1-8b59-bc431df65251 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:39.755675 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13173d-ccd8-4fd1-8b59-bc431df65251 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:39.760800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30479b6-6ce3-41fc-b9fb-e016cc818bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:39.761639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30479b6-6ce3-41fc-b9fb-e016cc818bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:39.761926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30479b6-6ce3-41fc-b9fb-e016cc818bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:39.762223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30479b6-6ce3-41fc-b9fb-e016cc818bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:39.762948 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30479b6-6ce3-41fc-b9fb-e016cc818bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:39.763311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30479b6-6ce3-41fc-b9fb-e016cc818bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:39.764834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30479b6-6ce3-41fc-b9fb-e016cc818bf5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:39.780366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1064/2100] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:35:39.785101 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c1aab-ab4d-4973-a481-67ce12b6cce4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:39.795364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c1aab-ab4d-4973-a481-67ce12b6cce4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:39.800778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815016c6-aeb7-4221-82b9-07ecaeb43025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:39.801579 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815016c6-aeb7-4221-82b9-07ecaeb43025 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:39.801924 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815016c6-aeb7-4221-82b9-07ecaeb43025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:39.802272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815016c6-aeb7-4221-82b9-07ecaeb43025 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:39.803028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815016c6-aeb7-4221-82b9-07ecaeb43025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:39.805182 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815016c6-aeb7-4221-82b9-07ecaeb43025 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:39.938334 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1037/2101] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:39 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:39.947530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30479b6-6ce3-41fc-b9fb-e016cc818bf5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:39.961154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30479b6-6ce3-41fc-b9fb-e016cc818bf5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:40.041050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733e537-c1b8-4866-a565-211b6d96a069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:40.042959 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733e537-c1b8-4866-a565-211b6d96a069 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:40.042959 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733e537-c1b8-4866-a565-211b6d96a069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:40.043303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733e537-c1b8-4866-a565-211b6d96a069 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:40.044132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733e537-c1b8-4866-a565-211b6d96a069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:40.046470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733e537-c1b8-4866-a565-211b6d96a069 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:40.226531 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1065/2102] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:39 2022] POST /identity/v3/users => generated 291 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:40.234784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815016c6-aeb7-4221-82b9-07ecaeb43025 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:40.246906 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815016c6-aeb7-4221-82b9-07ecaeb43025 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:40.252504 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b709bbb-3b17-4bad-8223-795b27d3a9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:40.253316 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b709bbb-3b17-4bad-8223-795b27d3a9bf admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:40.253685 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b709bbb-3b17-4bad-8223-795b27d3a9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:40.254025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b709bbb-3b17-4bad-8223-795b27d3a9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:40.254818 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b709bbb-3b17-4bad-8223-795b27d3a9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:40.256540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b709bbb-3b17-4bad-8223-795b27d3a9bf admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:40.280278 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1038/2103] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:40.283070 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733e537-c1b8-4866-a565-211b6d96a069 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:40.293579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733e537-c1b8-4866-a565-211b6d96a069 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:40.298461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78913adf-536e-43d0-afba-1471f82fea82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:40.299128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78913adf-536e-43d0-afba-1471f82fea82 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:40.299407 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78913adf-536e-43d0-afba-1471f82fea82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:40.299681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78913adf-536e-43d0-afba-1471f82fea82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:40.300434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78913adf-536e-43d0-afba-1471f82fea82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:40.302095 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78913adf-536e-43d0-afba-1471f82fea82 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:40.312820 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1066/2104] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:40.317422 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b709bbb-3b17-4bad-8223-795b27d3a9bf admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:40.320151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78913adf-536e-43d0-afba-1471f82fea82 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:40.320896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9b709bbb-3b17-4bad-8223-795b27d3a9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:40.330867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78913adf-536e-43d0-afba-1471f82fea82 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:40.334545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b709bbb-3b17-4bad-8223-795b27d3a9bf admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:40.341419 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cad14a-8c41-49cd-b998-0f078f6b2908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:40.342563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cad14a-8c41-49cd-b998-0f078f6b2908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:40.342943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cad14a-8c41-49cd-b998-0f078f6b2908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:40.343316 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cad14a-8c41-49cd-b998-0f078f6b2908 admin admin] PATH_INFO: `/v3/projects/354a206a35974ffe8d488fc0603c092b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:40.343728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ea49c-f531-488e-ab01-377fa90b61c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:40.344635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ea49c-f531-488e-ab01-377fa90b61c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:40.344815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cad14a-8c41-49cd-b998-0f078f6b2908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=354a206a35974ffe8d488fc0603c092b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:40.344963 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ea49c-f531-488e-ab01-377fa90b61c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:40.345181 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ea49c-f531-488e-ab01-377fa90b61c6 admin admin] PATH_INFO: `/v3/projects/3acc3c6cf71e426bb20863bb69afe499/users/471e6d8b6cc643c8b879607c1080ad38/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:40.347362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cad14a-8c41-49cd-b998-0f078f6b2908 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:40.373378 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ea49c-f531-488e-ab01-377fa90b61c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3acc3c6cf71e426bb20863bb69afe499, user_id=471e6d8b6cc643c8b879607c1080ad38, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:40.375856 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ea49c-f531-488e-ab01-377fa90b61c6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:40.510012 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1067/2105] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:40 2022] PUT /identity/v3/projects/3acc3c6cf71e426bb20863bb69afe499/users/471e6d8b6cc643c8b879607c1080ad38/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:40.525565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-86cad14a-8c41-49cd-b998-0f078f6b2908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '354a206a35974ffe8d488fc0603c092b', 'request_id': 'req-86cad14a-8c41-49cd-b998-0f078f6b2908'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:40.529164 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd79cbc-b115-45b7-a829-0b468e6b92f5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:40.529524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd79cbc-b115-45b7-a829-0b468e6b92f5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:40.529855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd79cbc-b115-45b7-a829-0b468e6b92f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:40.532693 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-86cad14a-8c41-49cd-b998-0f078f6b2908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '354a206a35974ffe8d488fc0603c092b', 'request_id': 'req-86cad14a-8c41-49cd-b998-0f078f6b2908'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:40.557715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5fd79cbc-b115-45b7-a829-0b468e6b92f5 None None] MFA Rules not processed for user `471e6d8b6cc643c8b879607c1080ad38`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:40.558939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5fd79cbc-b115-45b7-a829-0b468e6b92f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:40.603393 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-86cad14a-8c41-49cd-b998-0f078f6b2908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '354a206a35974ffe8d488fc0603c092b', 'request_id': 'req-86cad14a-8c41-49cd-b998-0f078f6b2908'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:40.615234 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-86cad14a-8c41-49cd-b998-0f078f6b2908 admin admin] The token cache is being invalidate because project 354a206a35974ffe8d488fc0603c092b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:40.615815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-86cad14a-8c41-49cd-b998-0f078f6b2908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:40.617150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-86cad14a-8c41-49cd-b998-0f078f6b2908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:40.618997 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1039/2106] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:40 2022] DELETE /identity/v3/projects/354a206a35974ffe8d488fc0603c092b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:40.623180 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cad14a-8c41-49cd-b998-0f078f6b2908 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:40.624598 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-86cad14a-8c41-49cd-b998-0f078f6b2908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:40.630988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1068/2107] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:40.641152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd79cbc-b115-45b7-a829-0b468e6b92f5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:40.703117 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cad14a-8c41-49cd-b998-0f078f6b2908 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:40.711777 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d1276-035c-4ce1-a660-f4f6737b359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:40.712730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d1276-035c-4ce1-a660-f4f6737b359a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:40.713728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d1276-035c-4ce1-a660-f4f6737b359a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:40.715758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d1276-035c-4ce1-a660-f4f6737b359a admin admin] PATH_INFO: `/v3/users/e2a86d728d8c4de1bee6f9acb534bbc0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:40.715758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d1276-035c-4ce1-a660-f4f6737b359a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a86d728d8c4de1bee6f9acb534bbc0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:40.717227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd79cbc-b115-45b7-a829-0b468e6b92f5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:40.717705 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d1276-035c-4ce1-a660-f4f6737b359a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:40.722407 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bb7cb-b0bd-44d4-8064-384f2cec5085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:40.723349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bb7cb-b0bd-44d4-8064-384f2cec5085 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:40.723699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bb7cb-b0bd-44d4-8064-384f2cec5085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:40.724041 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bb7cb-b0bd-44d4-8064-384f2cec5085 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:40.724806 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bb7cb-b0bd-44d4-8064-384f2cec5085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:40.737090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bb7cb-b0bd-44d4-8064-384f2cec5085 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:40.859373 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1069/2108] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:40 2022] POST /identity/v3/projects => generated 383 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:40.862363 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bb7cb-b0bd-44d4-8064-384f2cec5085 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:40.864106 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b41bb7cb-b0bd-44d4-8064-384f2cec5085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:40.896303 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-728d1276-035c-4ce1-a660-f4f6737b359a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a86d728d8c4de1bee6f9acb534bbc0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:40.910545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-728d1276-035c-4ce1-a660-f4f6737b359a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a86d728d8c4de1bee6f9acb534bbc0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:40.911296 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-728d1276-035c-4ce1-a660-f4f6737b359a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a86d728d8c4de1bee6f9acb534bbc0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:40.911938 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-728d1276-035c-4ce1-a660-f4f6737b359a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a86d728d8c4de1bee6f9acb534bbc0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:40.919716 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-728d1276-035c-4ce1-a660-f4f6737b359a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a86d728d8c4de1bee6f9acb534bbc0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:40.958385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bb7cb-b0bd-44d4-8064-384f2cec5085 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:40.966111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acabbd3-9d7f-473b-b649-631c4a850b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:40.966815 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acabbd3-9d7f-473b-b649-631c4a850b6e admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:40.967144 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acabbd3-9d7f-473b-b649-631c4a850b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:40.967418 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acabbd3-9d7f-473b-b649-631c4a850b6e admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:40.968124 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acabbd3-9d7f-473b-b649-631c4a850b6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:40.970388 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acabbd3-9d7f-473b-b649-631c4a850b6e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:41.009215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:41.016345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1040/2109] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:40 2022] DELETE /identity/v3/users/e2a86d728d8c4de1bee6f9acb534bbc0 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:41.066149 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1070/2110] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:40 2022] POST /identity/v3/users => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:41.070544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d1276-035c-4ce1-a660-f4f6737b359a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:41.072287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-728d1276-035c-4ce1-a660-f4f6737b359a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:41.169843 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d1276-035c-4ce1-a660-f4f6737b359a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:41.176680 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45f1af-460d-4958-9825-35e569cc7c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:41.177699 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45f1af-460d-4958-9825-35e569cc7c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:41.179777 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45f1af-460d-4958-9825-35e569cc7c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:41.180516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45f1af-460d-4958-9825-35e569cc7c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:41.181045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45f1af-460d-4958-9825-35e569cc7c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:41.190890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45f1af-460d-4958-9825-35e569cc7c16 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:41.202977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1041/2111] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:41.207626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acabbd3-9d7f-473b-b649-631c4a850b6e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:41.218806 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acabbd3-9d7f-473b-b649-631c4a850b6e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:41.223927 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876b3c8-ae93-4772-88df-1cd0780ab4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:41.224828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876b3c8-ae93-4772-88df-1cd0780ab4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:41.225114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876b3c8-ae93-4772-88df-1cd0780ab4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:41.225422 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876b3c8-ae93-4772-88df-1cd0780ab4b0 admin admin] PATH_INFO: `/v3/projects/c42395a0aa67480ab04c6ce5203acf42/users/51c528f1c9d542b1b19acba60e76da09/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:41.245142 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876b3c8-ae93-4772-88df-1cd0780ab4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42395a0aa67480ab04c6ce5203acf42, user_id=51c528f1c9d542b1b19acba60e76da09, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:41.249596 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:41.258832 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876b3c8-ae93-4772-88df-1cd0780ab4b0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:41.346840 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1071/2112] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:41 2022] PUT /identity/v3/projects/c42395a0aa67480ab04c6ce5203acf42/users/51c528f1c9d542b1b19acba60e76da09/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:41.349774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45f1af-460d-4958-9825-35e569cc7c16 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:41.368228 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45f1af-460d-4958-9825-35e569cc7c16 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:41.461438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f37cc-e0da-4ced-996a-ab30d3acf677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:41.462160 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f37cc-e0da-4ced-996a-ab30d3acf677 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:41.462457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f37cc-e0da-4ced-996a-ab30d3acf677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:41.462736 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f37cc-e0da-4ced-996a-ab30d3acf677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:41.463971 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f37cc-e0da-4ced-996a-ab30d3acf677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:41.465172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f37cc-e0da-4ced-996a-ab30d3acf677 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:41.484329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1042/2113] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:41.488361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876b3c8-ae93-4772-88df-1cd0780ab4b0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:41.502232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876b3c8-ae93-4772-88df-1cd0780ab4b0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:41.509312 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f63c8-75ef-4d80-8778-15b2a373fcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:41.510285 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f63c8-75ef-4d80-8778-15b2a373fcbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:41.510574 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f63c8-75ef-4d80-8778-15b2a373fcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:41.510853 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f63c8-75ef-4d80-8778-15b2a373fcbb admin admin] PATH_INFO: `/v3/projects/c42395a0aa67480ab04c6ce5203acf42/users/51c528f1c9d542b1b19acba60e76da09/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:41.513033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f63c8-75ef-4d80-8778-15b2a373fcbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42395a0aa67480ab04c6ce5203acf42, user_id=51c528f1c9d542b1b19acba60e76da09, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:41.516694 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f63c8-75ef-4d80-8778-15b2a373fcbb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:41.529357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1072/2114] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:41 2022] PUT /identity/v3/projects/c42395a0aa67480ab04c6ce5203acf42/users/51c528f1c9d542b1b19acba60e76da09/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:41.540160 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b62f1-7c36-44b8-bedf-7b892c080010 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:41.540456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b62f1-7c36-44b8-bedf-7b892c080010 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:41.540739 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b62f1-7c36-44b8-bedf-7b892c080010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:41.560267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f63c8-75ef-4d80-8778-15b2a373fcbb admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:41.562205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1e4f63c8-75ef-4d80-8778-15b2a373fcbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:41.575966 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-fd3b62f1-7c36-44b8-bedf-7b892c080010 None None] MFA Rules not processed for user `51c528f1c9d542b1b19acba60e76da09`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:41.577783 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fd3b62f1-7c36-44b8-bedf-7b892c080010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:41.663005 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f63c8-75ef-4d80-8778-15b2a373fcbb admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:41.674452 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec91218-8e09-442e-9f98-b35c5b040b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:41.675320 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec91218-8e09-442e-9f98-b35c5b040b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:41.675555 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec91218-8e09-442e-9f98-b35c5b040b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:41.675835 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec91218-8e09-442e-9f98-b35c5b040b44 admin admin] PATH_INFO: `/v3/users/8aacd1c9bb054cdf930ffbd8ce8939be` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:41.676725 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1043/2115] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:41.681931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec91218-8e09-442e-9f98-b35c5b040b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aacd1c9bb054cdf930ffbd8ce8939be)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:41.682079 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b62f1-7c36-44b8-bedf-7b892c080010 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:41.682079 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fd3b62f1-7c36-44b8-bedf-7b892c080010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:41.682238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec91218-8e09-442e-9f98-b35c5b040b44 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:41.704273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b62f1-7c36-44b8-bedf-7b892c080010 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:41.711375 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:41.712503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:41.712853 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:41.713203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26 admin admin] PATH_INFO: `/v3/projects/75682a5475d34deb9b947e9dabb7fd9d` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:41.714556 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75682a5475d34deb9b947e9dabb7fd9d)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:41.716571 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:41.996747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fec91218-8e09-442e-9f98-b35c5b040b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aacd1c9bb054cdf930ffbd8ce8939be'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:41.998817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75682a5475d34deb9b947e9dabb7fd9d', 'request_id': 'req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:42.007144 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75682a5475d34deb9b947e9dabb7fd9d', 'request_id': 'req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:42.018266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fec91218-8e09-442e-9f98-b35c5b040b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aacd1c9bb054cdf930ffbd8ce8939be'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:42.027145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fec91218-8e09-442e-9f98-b35c5b040b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aacd1c9bb054cdf930ffbd8ce8939be'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:42.030294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fec91218-8e09-442e-9f98-b35c5b040b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aacd1c9bb054cdf930ffbd8ce8939be'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:42.031082 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fec91218-8e09-442e-9f98-b35c5b040b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aacd1c9bb054cdf930ffbd8ce8939be'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:42.089235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75682a5475d34deb9b947e9dabb7fd9d', 'request_id': 'req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:42.100246 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26 admin admin] The token cache is being invalidate because project 75682a5475d34deb9b947e9dabb7fd9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:42.100562 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:42.101229 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:42.103161 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1044/2116] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:41 2022] DELETE /identity/v3/projects/75682a5475d34deb9b947e9dabb7fd9d => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:42.104018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:42.105390 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:42.146580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1073/2117] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:41 2022] DELETE /identity/v3/users/8aacd1c9bb054cdf930ffbd8ce8939be => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:42.149300 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec91218-8e09-442e-9f98-b35c5b040b44 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:42.151280 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fec91218-8e09-442e-9f98-b35c5b040b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:42.166394 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22e5d6-f82c-4a3a-83d4-1a6730514a26 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:42.217982 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef90ff-97e9-406d-a17a-7724bfd27c7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:42.218867 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef90ff-97e9-406d-a17a-7724bfd27c7a service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:42.219150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef90ff-97e9-406d-a17a-7724bfd27c7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:42.219422 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef90ff-97e9-406d-a17a-7724bfd27c7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:42.219787 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec91218-8e09-442e-9f98-b35c5b040b44 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:42.221275 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ffef90ff-97e9-406d-a17a-7724bfd27c7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:42.224627 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33db682-3afe-48c4-9701-fb552b85f70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:42.225577 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33db682-3afe-48c4-9701-fb552b85f70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:42.225867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33db682-3afe-48c4-9701-fb552b85f70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:42.226145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33db682-3afe-48c4-9701-fb552b85f70c admin admin] PATH_INFO: `/v3/users/cc3de78fc738433ba86bf20041ef5f57` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:42.227733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33db682-3afe-48c4-9701-fb552b85f70c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3de78fc738433ba86bf20041ef5f57)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:42.229906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33db682-3afe-48c4-9701-fb552b85f70c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:42.300353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef90ff-97e9-406d-a17a-7724bfd27c7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:42.301995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef90ff-97e9-406d-a17a-7724bfd27c7a service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:42.318507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1045/2118] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:42.318507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e824f-2d18-4c4d-95e3-a5551bbe6fd6 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:42.318885 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e824f-2d18-4c4d-95e3-a5551bbe6fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:42.319898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e824f-2d18-4c4d-95e3-a5551bbe6fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:42.346352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-5c4e824f-2d18-4c4d-95e3-a5551bbe6fd6 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:42.352725 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5c4e824f-2d18-4c4d-95e3-a5551bbe6fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:42.370816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1046/2119] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:42.372274 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b62733-71e5-48c7-9291-a96188325e03 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:42.372567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b62733-71e5-48c7-9291-a96188325e03 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:42.373271 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b62733-71e5-48c7-9291-a96188325e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:42.397248 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-63b62733-71e5-48c7-9291-a96188325e03 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:42.399394 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-63b62733-71e5-48c7-9291-a96188325e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:42.409770 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1047/2120] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:42.417049 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f3249-0fdc-43b2-ab62-b2b6ca4d4742 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:42.417049 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f3249-0fdc-43b2-ab62-b2b6ca4d4742 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:42.417049 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f3249-0fdc-43b2-ab62-b2b6ca4d4742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:42.434026 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-883f3249-0fdc-43b2-ab62-b2b6ca4d4742 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:42.435247 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-883f3249-0fdc-43b2-ab62-b2b6ca4d4742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:42.444782 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1048/2121] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:42.445810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f3249-0fdc-43b2-ab62-b2b6ca4d4742 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:42.451273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-883f3249-0fdc-43b2-ab62-b2b6ca4d4742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:42.454457 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c33db682-3afe-48c4-9701-fb552b85f70c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3de78fc738433ba86bf20041ef5f57'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:42.468517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c33db682-3afe-48c4-9701-fb552b85f70c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3de78fc738433ba86bf20041ef5f57'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:42.476453 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c33db682-3afe-48c4-9701-fb552b85f70c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3de78fc738433ba86bf20041ef5f57'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:42.477314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c33db682-3afe-48c4-9701-fb552b85f70c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3de78fc738433ba86bf20041ef5f57'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:42.477961 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c33db682-3afe-48c4-9701-fb552b85f70c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3de78fc738433ba86bf20041ef5f57'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:42.517934 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f3249-0fdc-43b2-ab62-b2b6ca4d4742 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:42.522137 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bb2e5-cc3a-4089-95c2-3452d12e307f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:42.522941 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bb2e5-cc3a-4089-95c2-3452d12e307f service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:42.523227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bb2e5-cc3a-4089-95c2-3452d12e307f service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:42.523523 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bb2e5-cc3a-4089-95c2-3452d12e307f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:42.525351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-823bb2e5-cc3a-4089-95c2-3452d12e307f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:42.539405 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bb2e5-cc3a-4089-95c2-3452d12e307f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:42.541097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bb2e5-cc3a-4089-95c2-3452d12e307f service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:42.552714 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1049/2122] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:42.557497 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bb2e5-cc3a-4089-95c2-3452d12e307f service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:42.557497 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-823bb2e5-cc3a-4089-95c2-3452d12e307f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:42.569025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bb2e5-cc3a-4089-95c2-3452d12e307f service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:42.575492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431034e-7ce7-40c1-8568-f77e114ba164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:42.576523 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431034e-7ce7-40c1-8568-f77e114ba164 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:42.576852 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431034e-7ce7-40c1-8568-f77e114ba164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:42.577134 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431034e-7ce7-40c1-8568-f77e114ba164 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:42.577955 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431034e-7ce7-40c1-8568-f77e114ba164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:42.578456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431034e-7ce7-40c1-8568-f77e114ba164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:42.580612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431034e-7ce7-40c1-8568-f77e114ba164 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:42.586172 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1074/2123] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:42 2022] DELETE /identity/v3/users/cc3de78fc738433ba86bf20041ef5f57 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:42.587280 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33db682-3afe-48c4-9701-fb552b85f70c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:42.589081 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c33db682-3afe-48c4-9701-fb552b85f70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:42.598840 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1050/2124] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:35:42.600087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9b2a0-b847-451f-9ae9-3f6faa7b55a7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:42.600391 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9b2a0-b847-451f-9ae9-3f6faa7b55a7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:42.601923 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9b2a0-b847-451f-9ae9-3f6faa7b55a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:42.624768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-21a9b2a0-b847-451f-9ae9-3f6faa7b55a7 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:42.627201 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-21a9b2a0-b847-451f-9ae9-3f6faa7b55a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:42.664400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:42.677583 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33db682-3afe-48c4-9701-fb552b85f70c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:42.683507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11994248-ff53-44aa-80ec-829d2811cc05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:42.684470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11994248-ff53-44aa-80ec-829d2811cc05 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:42.684958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11994248-ff53-44aa-80ec-829d2811cc05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:42.685679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11994248-ff53-44aa-80ec-829d2811cc05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:42.687951 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-11994248-ff53-44aa-80ec-829d2811cc05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:42.701636 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1051/2125] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:42.705597 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9b2a0-b847-451f-9ae9-3f6faa7b55a7 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:42.716602 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9b2a0-b847-451f-9ae9-3f6faa7b55a7 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:42.722034 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00543-c3ab-4709-b9c1-444c992c1833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:42.722800 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00543-c3ab-4709-b9c1-444c992c1833 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:42.723174 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00543-c3ab-4709-b9c1-444c992c1833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:42.723516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00543-c3ab-4709-b9c1-444c992c1833 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:42.724304 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e00543-c3ab-4709-b9c1-444c992c1833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:42.727042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e00543-c3ab-4709-b9c1-444c992c1833 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:42.756359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11994248-ff53-44aa-80ec-829d2811cc05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:42.757900 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11994248-ff53-44aa-80ec-829d2811cc05 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:42.767178 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1075/2126] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:42.769774 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11994248-ff53-44aa-80ec-829d2811cc05 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:42.771104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-11994248-ff53-44aa-80ec-829d2811cc05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:42.795408 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:42.830332 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1052/2127] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:42 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:42.831281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00543-c3ab-4709-b9c1-444c992c1833 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:42.841042 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11994248-ff53-44aa-80ec-829d2811cc05 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:42.899005 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13f113-98b9-4001-ba35-37a6ef86fdeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:42.899386 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13f113-98b9-4001-ba35-37a6ef86fdeb service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:42.899470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13f113-98b9-4001-ba35-37a6ef86fdeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:42.899713 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13f113-98b9-4001-ba35-37a6ef86fdeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:42.902744 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00543-c3ab-4709-b9c1-444c992c1833 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:42.908126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6ea32-e1cb-4d2f-9a94-c37f69939f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:42.908825 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6ea32-e1cb-4d2f-9a94-c37f69939f93 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:42.909111 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6ea32-e1cb-4d2f-9a94-c37f69939f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:42.909420 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6ea32-e1cb-4d2f-9a94-c37f69939f93 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:42.910236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6ea32-e1cb-4d2f-9a94-c37f69939f93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:42.910346 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13f113-98b9-4001-ba35-37a6ef86fdeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:42.911740 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13f113-98b9-4001-ba35-37a6ef86fdeb service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:42.912224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6ea32-e1cb-4d2f-9a94-c37f69939f93 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:42.930619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1076/2128] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:43.054952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1053/2129] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:42 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:43.057226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13f113-98b9-4001-ba35-37a6ef86fdeb service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:43.072560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13f113-98b9-4001-ba35-37a6ef86fdeb service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:43.079043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdeb7f-2b8e-4faa-9a04-71764c17f1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:43.079796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdeb7f-2b8e-4faa-9a04-71764c17f1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:43.080153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdeb7f-2b8e-4faa-9a04-71764c17f1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:43.080502 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdeb7f-2b8e-4faa-9a04-71764c17f1d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:43.081358 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdeb7f-2b8e-4faa-9a04-71764c17f1d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:43.083059 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdeb7f-2b8e-4faa-9a04-71764c17f1d2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:43.097536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1077/2130] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:43.101704 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6ea32-e1cb-4d2f-9a94-c37f69939f93 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:43.115195 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6ea32-e1cb-4d2f-9a94-c37f69939f93 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:43.125983 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dec40-010d-4141-a4b0-e96166eaa229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:43.126679 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dec40-010d-4141-a4b0-e96166eaa229 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:43.126965 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dec40-010d-4141-a4b0-e96166eaa229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:43.127244 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dec40-010d-4141-a4b0-e96166eaa229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:43.128024 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dec40-010d-4141-a4b0-e96166eaa229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:43.136246 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dec40-010d-4141-a4b0-e96166eaa229 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:43.161893 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1054/2131] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:43.164062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdeb7f-2b8e-4faa-9a04-71764c17f1d2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:43.177034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdeb7f-2b8e-4faa-9a04-71764c17f1d2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:43.183451 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fa574-1086-4dab-80cd-0068844d1676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:43.184569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fa574-1086-4dab-80cd-0068844d1676 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:43.185023 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fa574-1086-4dab-80cd-0068844d1676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:43.185572 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fa574-1086-4dab-80cd-0068844d1676 admin admin] PATH_INFO: `/v3/projects/1b6369fd157246fbac72ae4950a3e542/users/26d9586d48564d0594365654847d4ac9/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:43.205003 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fa574-1086-4dab-80cd-0068844d1676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6369fd157246fbac72ae4950a3e542, user_id=26d9586d48564d0594365654847d4ac9, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:43.208429 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fa574-1086-4dab-80cd-0068844d1676 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:43.246460 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dec40-010d-4141-a4b0-e96166eaa229 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:43.248922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-296dec40-010d-4141-a4b0-e96166eaa229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:43.281203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dec40-010d-4141-a4b0-e96166eaa229 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:43.281203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:43.281203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:43.281203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:43.281533 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08 admin admin] PATH_INFO: `/v3/projects/285ee18c7ad94a8eb01c2bee4a285ba7` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:43.281533 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=285ee18c7ad94a8eb01c2bee4a285ba7)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:43.283786 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:43.316072 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1078/2132] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:43 2022] PUT /identity/v3/projects/1b6369fd157246fbac72ae4950a3e542/users/26d9586d48564d0594365654847d4ac9/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:43.327500 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d85dea-5210-40f3-9600-750c353c8781 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:43.327800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d85dea-5210-40f3-9600-750c353c8781 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:43.328156 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d85dea-5210-40f3-9600-750c353c8781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:43.357729 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-96d85dea-5210-40f3-9600-750c353c8781 None None] MFA Rules not processed for user `26d9586d48564d0594365654847d4ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:43.358973 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-96d85dea-5210-40f3-9600-750c353c8781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:43.460165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285ee18c7ad94a8eb01c2bee4a285ba7', 'request_id': 'req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:43.479913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285ee18c7ad94a8eb01c2bee4a285ba7', 'request_id': 'req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:43.490284 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1079/2133] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:43.491936 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d85dea-5210-40f3-9600-750c353c8781 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:43.493303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-96d85dea-5210-40f3-9600-750c353c8781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:43.576730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d85dea-5210-40f3-9600-750c353c8781 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:43.603171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285ee18c7ad94a8eb01c2bee4a285ba7', 'request_id': 'req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:43.619020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08 admin admin] The token cache is being invalidate because project 285ee18c7ad94a8eb01c2bee4a285ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:43.619443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:43.626399 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:43.629612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1055/2134] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:43 2022] DELETE /identity/v3/projects/285ee18c7ad94a8eb01c2bee4a285ba7 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:43.630593 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:43.632255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:43.646801 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d273213-b833-4350-8df6-5767369d11e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:43.648893 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d273213-b833-4350-8df6-5767369d11e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:43.649395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d273213-b833-4350-8df6-5767369d11e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:43.650600 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d273213-b833-4350-8df6-5767369d11e2 admin admin] PATH_INFO: `/v3/users/471e6d8b6cc643c8b879607c1080ad38` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:43.651968 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d273213-b833-4350-8df6-5767369d11e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=471e6d8b6cc643c8b879607c1080ad38)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:43.662401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d273213-b833-4350-8df6-5767369d11e2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:43.718587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb7bfc-69a6-4d8c-b38b-bd683d797d08 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:43.718587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d2a5a-ba06-4dd3-a084-53f1ecf8fae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:43.718587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d2a5a-ba06-4dd3-a084-53f1ecf8fae7 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:43.718587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d2a5a-ba06-4dd3-a084-53f1ecf8fae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:43.719272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d2a5a-ba06-4dd3-a084-53f1ecf8fae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:43.719952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-af7d2a5a-ba06-4dd3-a084-53f1ecf8fae7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:43.783917 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d2a5a-ba06-4dd3-a084-53f1ecf8fae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:43.785429 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d2a5a-ba06-4dd3-a084-53f1ecf8fae7 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:43.796123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1056/2135] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:43.798361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d2a5a-ba06-4dd3-a084-53f1ecf8fae7 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:43.801089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-af7d2a5a-ba06-4dd3-a084-53f1ecf8fae7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:43.815796 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d2a5a-ba06-4dd3-a084-53f1ecf8fae7 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:43.824813 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb7bbc-d473-4d72-a535-b21c2242af97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:43.825976 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb7bbc-d473-4d72-a535-b21c2242af97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:43.826892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb7bbc-d473-4d72-a535-b21c2242af97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:43.827377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb7bbc-d473-4d72-a535-b21c2242af97 admin admin] PATH_INFO: `/v3/users/e5c5bc1e9f4d4e36a92443188114414f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:43.829505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb7bbc-d473-4d72-a535-b21c2242af97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5c5bc1e9f4d4e36a92443188114414f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:43.836165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb7bbc-d473-4d72-a535-b21c2242af97 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:44.000410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8d273213-b833-4350-8df6-5767369d11e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471e6d8b6cc643c8b879607c1080ad38'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:44.014022 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8d273213-b833-4350-8df6-5767369d11e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471e6d8b6cc643c8b879607c1080ad38'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:44.021141 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8d273213-b833-4350-8df6-5767369d11e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471e6d8b6cc643c8b879607c1080ad38'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:44.021986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8d273213-b833-4350-8df6-5767369d11e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471e6d8b6cc643c8b879607c1080ad38'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:44.023332 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8d273213-b833-4350-8df6-5767369d11e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471e6d8b6cc643c8b879607c1080ad38'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:44.071127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:44.084865 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fcfb7bbc-d473-4d72-a535-b21c2242af97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5c5bc1e9f4d4e36a92443188114414f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:44.098109 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fcfb7bbc-d473-4d72-a535-b21c2242af97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5c5bc1e9f4d4e36a92443188114414f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:44.098956 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fcfb7bbc-d473-4d72-a535-b21c2242af97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5c5bc1e9f4d4e36a92443188114414f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:44.099570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fcfb7bbc-d473-4d72-a535-b21c2242af97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5c5bc1e9f4d4e36a92443188114414f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:44.107804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fcfb7bbc-d473-4d72-a535-b21c2242af97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5c5bc1e9f4d4e36a92443188114414f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:44.131950 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1080/2136] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:43 2022] DELETE /identity/v3/users/471e6d8b6cc643c8b879607c1080ad38 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:44.135719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d273213-b833-4350-8df6-5767369d11e2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:44.137116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8d273213-b833-4350-8df6-5767369d11e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:44.215800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d273213-b833-4350-8df6-5767369d11e2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:44.216194 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1057/2137] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:43 2022] DELETE /identity/v3/users/e5c5bc1e9f4d4e36a92443188114414f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:44.219710 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74117ba7-59ff-4a2b-a0c6-939678b59306 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:44.219710 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74117ba7-59ff-4a2b-a0c6-939678b59306 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:44.219710 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74117ba7-59ff-4a2b-a0c6-939678b59306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:44.245550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-74117ba7-59ff-4a2b-a0c6-939678b59306 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:44.248692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-74117ba7-59ff-4a2b-a0c6-939678b59306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:44.302084 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483b47b-29f2-4423-8d78-8fbd8875c115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:44.303201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483b47b-29f2-4423-8d78-8fbd8875c115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:44.304306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483b47b-29f2-4423-8d78-8fbd8875c115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:44.305002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483b47b-29f2-4423-8d78-8fbd8875c115 admin admin] PATH_INFO: `/v3/projects/66b7a3b22a594bc693a47e8889a78d1d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:44.306578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483b47b-29f2-4423-8d78-8fbd8875c115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66b7a3b22a594bc693a47e8889a78d1d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:44.308657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483b47b-29f2-4423-8d78-8fbd8875c115 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:44.352246 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1058/2138] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:44.361569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74117ba7-59ff-4a2b-a0c6-939678b59306 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:44.363133 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-74117ba7-59ff-4a2b-a0c6-939678b59306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:44.426086 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74117ba7-59ff-4a2b-a0c6-939678b59306 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:44.430672 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964202d-837a-4dc8-8154-8037ce437f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:44.431394 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964202d-837a-4dc8-8154-8037ce437f54 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:44.431683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964202d-837a-4dc8-8154-8037ce437f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:44.431967 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964202d-837a-4dc8-8154-8037ce437f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:44.441740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964202d-837a-4dc8-8154-8037ce437f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:44.443211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964202d-837a-4dc8-8154-8037ce437f54 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:44.453802 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1059/2139] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:44.463981 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:44.483971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5483b47b-29f2-4423-8d78-8fbd8875c115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b7a3b22a594bc693a47e8889a78d1d', 'request_id': 'req-5483b47b-29f2-4423-8d78-8fbd8875c115'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:44.613509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5483b47b-29f2-4423-8d78-8fbd8875c115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b7a3b22a594bc693a47e8889a78d1d', 'request_id': 'req-5483b47b-29f2-4423-8d78-8fbd8875c115'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:44.624484 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5483b47b-29f2-4423-8d78-8fbd8875c115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b7a3b22a594bc693a47e8889a78d1d', 'request_id': 'req-5483b47b-29f2-4423-8d78-8fbd8875c115'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:44.638031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:44.649149 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5483b47b-29f2-4423-8d78-8fbd8875c115 admin admin] The token cache is being invalidate because project 66b7a3b22a594bc693a47e8889a78d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:44.649478 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5483b47b-29f2-4423-8d78-8fbd8875c115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:44.652431 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5483b47b-29f2-4423-8d78-8fbd8875c115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:44.654169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1081/2140] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:44 2022] DELETE /identity/v3/projects/66b7a3b22a594bc693a47e8889a78d1d => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:44.658172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964202d-837a-4dc8-8154-8037ce437f54 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:44.659634 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b964202d-837a-4dc8-8154-8037ce437f54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:44.688119 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964202d-837a-4dc8-8154-8037ce437f54 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:44.807194 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57ac79-cd91-4ca2-8b7a-cbe0643aa57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:44.808055 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57ac79-cd91-4ca2-8b7a-cbe0643aa57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:44.809364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57ac79-cd91-4ca2-8b7a-cbe0643aa57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:44.809364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57ac79-cd91-4ca2-8b7a-cbe0643aa57e admin admin] PATH_INFO: `/v3/users/a1f24e03b1ff4cc3ad4d0a8367328918` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:44.810531 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57ac79-cd91-4ca2-8b7a-cbe0643aa57e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f24e03b1ff4cc3ad4d0a8367328918)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:44.813293 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57ac79-cd91-4ca2-8b7a-cbe0643aa57e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:45.058384 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5d57ac79-cd91-4ca2-8b7a-cbe0643aa57e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f24e03b1ff4cc3ad4d0a8367328918'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:45.082285 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5d57ac79-cd91-4ca2-8b7a-cbe0643aa57e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f24e03b1ff4cc3ad4d0a8367328918'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:45.083217 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5d57ac79-cd91-4ca2-8b7a-cbe0643aa57e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f24e03b1ff4cc3ad4d0a8367328918'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:45.084197 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5d57ac79-cd91-4ca2-8b7a-cbe0643aa57e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f24e03b1ff4cc3ad4d0a8367328918'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:45.093804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5d57ac79-cd91-4ca2-8b7a-cbe0643aa57e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f24e03b1ff4cc3ad4d0a8367328918'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:45.172236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1060/2141] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:44 2022] DELETE /identity/v3/users/a1f24e03b1ff4cc3ad4d0a8367328918 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:45.373302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483b47b-29f2-4423-8d78-8fbd8875c115 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:45.375051 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5483b47b-29f2-4423-8d78-8fbd8875c115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:45.411507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483b47b-29f2-4423-8d78-8fbd8875c115 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:45.482569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea46364-9311-4955-9243-ca0b987b320d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:45.483585 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea46364-9311-4955-9243-ca0b987b320d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:45.483995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea46364-9311-4955-9243-ca0b987b320d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:45.484458 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea46364-9311-4955-9243-ca0b987b320d admin admin] PATH_INFO: `/v3/projects/cc38a49cc5344c7986055e9d0cdc86a5` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:45.485762 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea46364-9311-4955-9243-ca0b987b320d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc38a49cc5344c7986055e9d0cdc86a5)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:45.487715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea46364-9311-4955-9243-ca0b987b320d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:45.531315 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57ac79-cd91-4ca2-8b7a-cbe0643aa57e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:45.533136 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5d57ac79-cd91-4ca2-8b7a-cbe0643aa57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:45.548043 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57ac79-cd91-4ca2-8b7a-cbe0643aa57e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:45.555872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaee1ae-3d76-4997-b3f7-cd285c359579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:45.556884 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaee1ae-3d76-4997-b3f7-cd285c359579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:45.559780 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaee1ae-3d76-4997-b3f7-cd285c359579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:45.560183 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaee1ae-3d76-4997-b3f7-cd285c359579 admin admin] PATH_INFO: `/v3/projects/3acc3c6cf71e426bb20863bb69afe499` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:45.580731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaee1ae-3d76-4997-b3f7-cd285c359579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3acc3c6cf71e426bb20863bb69afe499)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:45.587646 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaee1ae-3d76-4997-b3f7-cd285c359579 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:45.693313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eea46364-9311-4955-9243-ca0b987b320d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc38a49cc5344c7986055e9d0cdc86a5', 'request_id': 'req-eea46364-9311-4955-9243-ca0b987b320d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:45.785794 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eea46364-9311-4955-9243-ca0b987b320d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc38a49cc5344c7986055e9d0cdc86a5', 'request_id': 'req-eea46364-9311-4955-9243-ca0b987b320d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:45.790480 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:45.797229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eea46364-9311-4955-9243-ca0b987b320d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc38a49cc5344c7986055e9d0cdc86a5', 'request_id': 'req-eea46364-9311-4955-9243-ca0b987b320d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:45.820749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eea46364-9311-4955-9243-ca0b987b320d admin admin] The token cache is being invalidate because project cc38a49cc5344c7986055e9d0cdc86a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:45.824434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eea46364-9311-4955-9243-ca0b987b320d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:45.827013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eea46364-9311-4955-9243-ca0b987b320d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:45.830271 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1082/2142] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:45 2022] DELETE /identity/v3/projects/cc38a49cc5344c7986055e9d0cdc86a5 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:45.835601 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19473840-897f-4b5c-8d74-8be0bb54000f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:45.836562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19473840-897f-4b5c-8d74-8be0bb54000f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:45.837033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19473840-897f-4b5c-8d74-8be0bb54000f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:45.859126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-19473840-897f-4b5c-8d74-8be0bb54000f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:45.861316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-19473840-897f-4b5c-8d74-8be0bb54000f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:45.876944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ecaee1ae-3d76-4997-b3f7-cd285c359579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3acc3c6cf71e426bb20863bb69afe499', 'request_id': 'req-ecaee1ae-3d76-4997-b3f7-cd285c359579'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:45.899252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ecaee1ae-3d76-4997-b3f7-cd285c359579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3acc3c6cf71e426bb20863bb69afe499', 'request_id': 'req-ecaee1ae-3d76-4997-b3f7-cd285c359579'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:45.958313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1083/2143] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:45.961512 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:45.968647 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0f113-83a2-4ea5-8342-183db12dfd24 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:45.969307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0f113-83a2-4ea5-8342-183db12dfd24 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:45.969788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0f113-83a2-4ea5-8342-183db12dfd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:45.993142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ecaee1ae-3d76-4997-b3f7-cd285c359579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3acc3c6cf71e426bb20863bb69afe499', 'request_id': 'req-ecaee1ae-3d76-4997-b3f7-cd285c359579'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:45.998434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-08d0f113-83a2-4ea5-8342-183db12dfd24 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:46.004980 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-08d0f113-83a2-4ea5-8342-183db12dfd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:46.009176 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ecaee1ae-3d76-4997-b3f7-cd285c359579 admin admin] The token cache is being invalidate because project 3acc3c6cf71e426bb20863bb69afe499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:46.009693 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ecaee1ae-3d76-4997-b3f7-cd285c359579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:46.012908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1084/2144] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:46.014536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0f113-83a2-4ea5-8342-183db12dfd24 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:46.027087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ecaee1ae-3d76-4997-b3f7-cd285c359579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:46.027307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0f113-83a2-4ea5-8342-183db12dfd24 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:46.031961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1061/2145] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:45 2022] DELETE /identity/v3/projects/3acc3c6cf71e426bb20863bb69afe499 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:46.033838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5b5c7-d6a2-4081-b8fe-092e065a8ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:46.034746 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5b5c7-d6a2-4081-b8fe-092e065a8ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:46.035090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5b5c7-d6a2-4081-b8fe-092e065a8ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:46.035443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5b5c7-d6a2-4081-b8fe-092e065a8ce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:46.037625 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5b5c7-d6a2-4081-b8fe-092e065a8ce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:46.038181 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5b5c7-d6a2-4081-b8fe-092e065a8ce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:46.039178 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaee1ae-3d76-4997-b3f7-cd285c359579 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:46.041480 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5b5c7-d6a2-4081-b8fe-092e065a8ce1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:46.043957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ecaee1ae-3d76-4997-b3f7-cd285c359579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:46.058474 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1085/2146] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:35:46.063886 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5b5c7-d6a2-4081-b8fe-092e065a8ce1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:46.065704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-baf5b5c7-d6a2-4081-b8fe-092e065a8ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:46.097039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaee1ae-3d76-4997-b3f7-cd285c359579 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:46.098333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5b5c7-d6a2-4081-b8fe-092e065a8ce1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:46.111088 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4c9d1-1d09-4bbf-910a-d77dac7c9224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:46.112873 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4c9d1-1d09-4bbf-910a-d77dac7c9224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:46.113789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0afcb5-5660-49dd-9b6a-fe99e88cbd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:46.114854 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0afcb5-5660-49dd-9b6a-fe99e88cbd39 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:46.115246 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0afcb5-5660-49dd-9b6a-fe99e88cbd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:46.115459 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4c9d1-1d09-4bbf-910a-d77dac7c9224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:46.115703 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0afcb5-5660-49dd-9b6a-fe99e88cbd39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:46.118148 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4c9d1-1d09-4bbf-910a-d77dac7c9224 admin admin] PATH_INFO: `/v3/users/51c528f1c9d542b1b19acba60e76da09` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:46.120122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4c9d1-1d09-4bbf-910a-d77dac7c9224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51c528f1c9d542b1b19acba60e76da09)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:46.120986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0afcb5-5660-49dd-9b6a-fe99e88cbd39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:46.123528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0afcb5-5660-49dd-9b6a-fe99e88cbd39 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:46.123842 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4c9d1-1d09-4bbf-910a-d77dac7c9224 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:46.276077 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1086/2147] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:46 2022] POST /identity/v3/projects => generated 371 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:46.281645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0afcb5-5660-49dd-9b6a-fe99e88cbd39 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:46.411633 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-caf4c9d1-1d09-4bbf-910a-d77dac7c9224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51c528f1c9d542b1b19acba60e76da09'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:46.461700 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-caf4c9d1-1d09-4bbf-910a-d77dac7c9224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51c528f1c9d542b1b19acba60e76da09'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:46.467407 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-caf4c9d1-1d09-4bbf-910a-d77dac7c9224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51c528f1c9d542b1b19acba60e76da09'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:46.467407 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-caf4c9d1-1d09-4bbf-910a-d77dac7c9224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51c528f1c9d542b1b19acba60e76da09'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:46.470055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0afcb5-5660-49dd-9b6a-fe99e88cbd39 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:46.484247 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-caf4c9d1-1d09-4bbf-910a-d77dac7c9224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51c528f1c9d542b1b19acba60e76da09'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:46.489601 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604ccbe-f7d9-4858-bef6-739a5809e93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:46.492516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604ccbe-f7d9-4858-bef6-739a5809e93b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:46.493611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604ccbe-f7d9-4858-bef6-739a5809e93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:46.496916 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604ccbe-f7d9-4858-bef6-739a5809e93b admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:46.502056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604ccbe-f7d9-4858-bef6-739a5809e93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:46.508176 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604ccbe-f7d9-4858-bef6-739a5809e93b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:46.611710 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1062/2148] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:46 2022] DELETE /identity/v3/users/51c528f1c9d542b1b19acba60e76da09 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:46.611924 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1087/2149] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:46 2022] POST /identity/v3/users => generated 286 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:46.614934 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4c9d1-1d09-4bbf-910a-d77dac7c9224 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:46.617181 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604ccbe-f7d9-4858-bef6-739a5809e93b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:46.617990 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-caf4c9d1-1d09-4bbf-910a-d77dac7c9224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:46.619595 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0604ccbe-f7d9-4858-bef6-739a5809e93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:46.644633 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604ccbe-f7d9-4858-bef6-739a5809e93b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:46.783612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4c9d1-1d09-4bbf-910a-d77dac7c9224 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:46.794166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c516dd3-e863-4f57-aa1a-654ea375a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:46.794166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c516dd3-e863-4f57-aa1a-654ea375a13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:46.794390 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c516dd3-e863-4f57-aa1a-654ea375a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:46.794508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c516dd3-e863-4f57-aa1a-654ea375a13d admin admin] PATH_INFO: `/v3/projects/648d8ede8a84461cabb1dc3d4a702af8` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:46.796115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c516dd3-e863-4f57-aa1a-654ea375a13d admin admin] RBAC: Authorizing `identity:delete_project(project_id=648d8ede8a84461cabb1dc3d4a702af8)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:46.798588 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c516dd3-e863-4f57-aa1a-654ea375a13d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:46.820778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac5d49-9329-43d2-bf60-f8d5cde6a68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:46.820778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac5d49-9329-43d2-bf60-f8d5cde6a68a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:46.820778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac5d49-9329-43d2-bf60-f8d5cde6a68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:46.820778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac5d49-9329-43d2-bf60-f8d5cde6a68a admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:46.823217 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac5d49-9329-43d2-bf60-f8d5cde6a68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:46.823217 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac5d49-9329-43d2-bf60-f8d5cde6a68a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:46.862232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1088/2150] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:46.866776 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac5d49-9329-43d2-bf60-f8d5cde6a68a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:46.890662 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac5d49-9329-43d2-bf60-f8d5cde6a68a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:46.896610 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a94ab-5569-4e9a-b7cb-699f752a5577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:46.897390 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a94ab-5569-4e9a-b7cb-699f752a5577 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:46.898259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a94ab-5569-4e9a-b7cb-699f752a5577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:46.898385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a94ab-5569-4e9a-b7cb-699f752a5577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:46.899157 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a94ab-5569-4e9a-b7cb-699f752a5577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:46.900827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a94ab-5569-4e9a-b7cb-699f752a5577 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:46.919201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1089/2151] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:46.923623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a94ab-5569-4e9a-b7cb-699f752a5577 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:46.936761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8c516dd3-e863-4f57-aa1a-654ea375a13d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '648d8ede8a84461cabb1dc3d4a702af8', 'request_id': 'req-8c516dd3-e863-4f57-aa1a-654ea375a13d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:46.943661 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8c516dd3-e863-4f57-aa1a-654ea375a13d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '648d8ede8a84461cabb1dc3d4a702af8', 'request_id': 'req-8c516dd3-e863-4f57-aa1a-654ea375a13d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:46.944638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a94ab-5569-4e9a-b7cb-699f752a5577 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:47.012659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1381a-b1cb-4251-bc39-1fdcdf849fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:47.013829 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1381a-b1cb-4251-bc39-1fdcdf849fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:47.014271 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1381a-b1cb-4251-bc39-1fdcdf849fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:47.014365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1381a-b1cb-4251-bc39-1fdcdf849fb2 admin admin] PATH_INFO: `/v3/projects/de05a05f535c456ca1ec35b64c96cad9/users/324aa7868ab84dc8823e2de74ea78549/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:47.025534 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8c516dd3-e863-4f57-aa1a-654ea375a13d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '648d8ede8a84461cabb1dc3d4a702af8', 'request_id': 'req-8c516dd3-e863-4f57-aa1a-654ea375a13d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:47.042911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1381a-b1cb-4251-bc39-1fdcdf849fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de05a05f535c456ca1ec35b64c96cad9, user_id=324aa7868ab84dc8823e2de74ea78549, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:47.045962 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1381a-b1cb-4251-bc39-1fdcdf849fb2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:47.067628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8c516dd3-e863-4f57-aa1a-654ea375a13d admin admin] The token cache is being invalidate because project 648d8ede8a84461cabb1dc3d4a702af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:47.067926 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8c516dd3-e863-4f57-aa1a-654ea375a13d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:47.081155 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8c516dd3-e863-4f57-aa1a-654ea375a13d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:47.083016 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1063/2152] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:46 2022] DELETE /identity/v3/projects/648d8ede8a84461cabb1dc3d4a702af8 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:47.087148 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c516dd3-e863-4f57-aa1a-654ea375a13d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:47.088993 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8c516dd3-e863-4f57-aa1a-654ea375a13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:47.103632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c516dd3-e863-4f57-aa1a-654ea375a13d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:47.109558 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb697e-019b-450f-bcaf-8daf61e69084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:47.110565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb697e-019b-450f-bcaf-8daf61e69084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:47.110919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb697e-019b-450f-bcaf-8daf61e69084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:47.111266 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb697e-019b-450f-bcaf-8daf61e69084 admin admin] PATH_INFO: `/v3/users/8efc5cbfc2294746a48457fef794e6c3` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:47.112750 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb697e-019b-450f-bcaf-8daf61e69084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8efc5cbfc2294746a48457fef794e6c3)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:47.115010 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb697e-019b-450f-bcaf-8daf61e69084 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:47.132745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1090/2153] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:46 2022] PUT /identity/v3/projects/de05a05f535c456ca1ec35b64c96cad9/users/324aa7868ab84dc8823e2de74ea78549/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:47.136057 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14071ae4-05b8-443e-ba46-7b3f3efb8b2d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:47.136057 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14071ae4-05b8-443e-ba46-7b3f3efb8b2d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:47.136057 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14071ae4-05b8-443e-ba46-7b3f3efb8b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:47.165158 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:47.181578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-14071ae4-05b8-443e-ba46-7b3f3efb8b2d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:47.182902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-14071ae4-05b8-443e-ba46-7b3f3efb8b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:47.255564 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1091/2154] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:47.266854 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14071ae4-05b8-443e-ba46-7b3f3efb8b2d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:47.268656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-14071ae4-05b8-443e-ba46-7b3f3efb8b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:47.337553 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:47.345030 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14071ae4-05b8-443e-ba46-7b3f3efb8b2d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:47.346810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-18cb697e-019b-450f-bcaf-8daf61e69084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8efc5cbfc2294746a48457fef794e6c3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:47.349153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f161b9-e93e-40c5-83d1-d5eb6a7c375b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:47.349875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f161b9-e93e-40c5-83d1-d5eb6a7c375b service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:47.350162 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f161b9-e93e-40c5-83d1-d5eb6a7c375b service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:47.351350 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f161b9-e93e-40c5-83d1-d5eb6a7c375b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:47.367945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f161b9-e93e-40c5-83d1-d5eb6a7c375b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:47.369655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f161b9-e93e-40c5-83d1-d5eb6a7c375b service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:47.381262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1092/2155] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:47.382343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f161b9-e93e-40c5-83d1-d5eb6a7c375b service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:47.383937 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-69f161b9-e93e-40c5-83d1-d5eb6a7c375b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:47.386178 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-18cb697e-019b-450f-bcaf-8daf61e69084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8efc5cbfc2294746a48457fef794e6c3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:47.386962 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-18cb697e-019b-450f-bcaf-8daf61e69084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8efc5cbfc2294746a48457fef794e6c3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:47.387583 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-18cb697e-019b-450f-bcaf-8daf61e69084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8efc5cbfc2294746a48457fef794e6c3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:47.395489 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-18cb697e-019b-450f-bcaf-8daf61e69084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8efc5cbfc2294746a48457fef794e6c3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:47.398590 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f161b9-e93e-40c5-83d1-d5eb6a7c375b service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:47.403866 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702e7d3-fa64-4379-9650-4e95bcb2881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:47.405297 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702e7d3-fa64-4379-9650-4e95bcb2881e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:47.405862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702e7d3-fa64-4379-9650-4e95bcb2881e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:47.408953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702e7d3-fa64-4379-9650-4e95bcb2881e admin admin] PATH_INFO: `/v3/projects/c42395a0aa67480ab04c6ce5203acf42` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:47.408953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702e7d3-fa64-4379-9650-4e95bcb2881e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42395a0aa67480ab04c6ce5203acf42)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:47.412502 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702e7d3-fa64-4379-9650-4e95bcb2881e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:47.474931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1064/2156] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:47 2022] DELETE /identity/v3/users/8efc5cbfc2294746a48457fef794e6c3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:47.585793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8702e7d3-fa64-4379-9650-4e95bcb2881e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42395a0aa67480ab04c6ce5203acf42', 'request_id': 'req-8702e7d3-fa64-4379-9650-4e95bcb2881e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:47.686943 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8702e7d3-fa64-4379-9650-4e95bcb2881e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42395a0aa67480ab04c6ce5203acf42', 'request_id': 'req-8702e7d3-fa64-4379-9650-4e95bcb2881e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:47.693514 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8702e7d3-fa64-4379-9650-4e95bcb2881e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42395a0aa67480ab04c6ce5203acf42', 'request_id': 'req-8702e7d3-fa64-4379-9650-4e95bcb2881e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:47.705353 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8702e7d3-fa64-4379-9650-4e95bcb2881e admin admin] The token cache is being invalidate because project c42395a0aa67480ab04c6ce5203acf42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:47.705642 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8702e7d3-fa64-4379-9650-4e95bcb2881e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:47.706321 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8702e7d3-fa64-4379-9650-4e95bcb2881e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:47.707888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1093/2157] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:47 2022] DELETE /identity/v3/projects/c42395a0aa67480ab04c6ce5203acf42 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:47.713382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd482a0e-29b2-4f3a-86aa-19fcd1e38274 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:47.713675 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd482a0e-29b2-4f3a-86aa-19fcd1e38274 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:47.713969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd482a0e-29b2-4f3a-86aa-19fcd1e38274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:47.734901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-dd482a0e-29b2-4f3a-86aa-19fcd1e38274 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:47.736396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dd482a0e-29b2-4f3a-86aa-19fcd1e38274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:47.807447 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1065/2158] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:47.815145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a74a6a-8edb-4dc5-861c-13cc0731064a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:47.815661 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a74a6a-8edb-4dc5-861c-13cc0731064a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:47.816627 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a74a6a-8edb-4dc5-861c-13cc0731064a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:47.842518 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b6a74a6a-8edb-4dc5-861c-13cc0731064a None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:47.853235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b6a74a6a-8edb-4dc5-861c-13cc0731064a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:47.859844 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1094/2159] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:47.870964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd482a0e-29b2-4f3a-86aa-19fcd1e38274 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:47.882274 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd482a0e-29b2-4f3a-86aa-19fcd1e38274 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:47.892054 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d7194-20a7-4682-89b6-5cee5e97b185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:47.898147 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d7194-20a7-4682-89b6-5cee5e97b185 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:47.898147 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d7194-20a7-4682-89b6-5cee5e97b185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:47.898147 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d7194-20a7-4682-89b6-5cee5e97b185 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:47.898147 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d7194-20a7-4682-89b6-5cee5e97b185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:47.898147 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d7194-20a7-4682-89b6-5cee5e97b185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:47.898147 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d7194-20a7-4682-89b6-5cee5e97b185 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:47.913801 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1066/2160] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:35:47.922562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a74a6a-8edb-4dc5-861c-13cc0731064a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:47.933439 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a74a6a-8edb-4dc5-861c-13cc0731064a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:47.939563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c4df7-e8fb-46a0-970c-e95cd994928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:47.939756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c4df7-e8fb-46a0-970c-e95cd994928a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:47.939980 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c4df7-e8fb-46a0-970c-e95cd994928a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:47.940215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c4df7-e8fb-46a0-970c-e95cd994928a admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:47.940921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c4df7-e8fb-46a0-970c-e95cd994928a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:47.942952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c4df7-e8fb-46a0-970c-e95cd994928a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:48.033067 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1095/2161] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:47 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:48.034002 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d7194-20a7-4682-89b6-5cee5e97b185 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:48.045706 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d7194-20a7-4682-89b6-5cee5e97b185 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:48.105280 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c4df7-e8fb-46a0-970c-e95cd994928a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:48.107083 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c33c4df7-e8fb-46a0-970c-e95cd994928a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:48.123494 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ae8e5-5ca4-4c0e-83bb-032bf41c06d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:48.124386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ae8e5-5ca4-4c0e-83bb-032bf41c06d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:48.124853 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ae8e5-5ca4-4c0e-83bb-032bf41c06d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:48.125276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ae8e5-5ca4-4c0e-83bb-032bf41c06d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:48.126142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ae8e5-5ca4-4c0e-83bb-032bf41c06d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:48.128840 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ae8e5-5ca4-4c0e-83bb-032bf41c06d8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:48.212352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c4df7-e8fb-46a0-970c-e95cd994928a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:48.217120 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5168f-e5d8-46a5-9cb7-50e0299b0a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:48.218396 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5168f-e5d8-46a5-9cb7-50e0299b0a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:48.218697 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5168f-e5d8-46a5-9cb7-50e0299b0a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:48.218962 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5168f-e5d8-46a5-9cb7-50e0299b0a43 admin admin] PATH_INFO: `/v3/projects/54f34ff234ab410588ffeff12c09c352` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:48.220425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5168f-e5d8-46a5-9cb7-50e0299b0a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54f34ff234ab410588ffeff12c09c352)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:48.223722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5168f-e5d8-46a5-9cb7-50e0299b0a43 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:48.258544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1067/2162] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:48 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:48.262867 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ae8e5-5ca4-4c0e-83bb-032bf41c06d8 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:48.273907 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ae8e5-5ca4-4c0e-83bb-032bf41c06d8 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:48.278722 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c9ec4-d446-403d-9fa2-6791a6c9b00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:48.279329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c9ec4-d446-403d-9fa2-6791a6c9b00c admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:48.279611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c9ec4-d446-403d-9fa2-6791a6c9b00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:48.279891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c9ec4-d446-403d-9fa2-6791a6c9b00c admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:48.280618 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c9ec4-d446-403d-9fa2-6791a6c9b00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:48.282401 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c9ec4-d446-403d-9fa2-6791a6c9b00c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:48.293563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1068/2163] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:48.297423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c9ec4-d446-403d-9fa2-6791a6c9b00c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:48.307433 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c9ec4-d446-403d-9fa2-6791a6c9b00c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:48.313873 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703246db-2313-4c56-9653-19c59b91390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:48.314590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703246db-2313-4c56-9653-19c59b91390e admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:48.319723 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703246db-2313-4c56-9653-19c59b91390e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:48.319723 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703246db-2313-4c56-9653-19c59b91390e admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:48.319723 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703246db-2313-4c56-9653-19c59b91390e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:48.319723 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703246db-2313-4c56-9653-19c59b91390e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:48.328943 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9dc5168f-e5d8-46a5-9cb7-50e0299b0a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54f34ff234ab410588ffeff12c09c352', 'request_id': 'req-9dc5168f-e5d8-46a5-9cb7-50e0299b0a43'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:48.332914 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1069/2164] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:48.337665 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703246db-2313-4c56-9653-19c59b91390e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:48.352375 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703246db-2313-4c56-9653-19c59b91390e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:48.419837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26bbde-1779-45c1-8126-cfbfaceae157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:48.420648 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26bbde-1779-45c1-8126-cfbfaceae157 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:48.420927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26bbde-1779-45c1-8126-cfbfaceae157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:48.421201 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26bbde-1779-45c1-8126-cfbfaceae157 admin admin] PATH_INFO: `/v3/projects/543aecefb7514859bad9195566f7df4f/users/6e280f21fd274a02bac741801d3c9078/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:48.431396 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9dc5168f-e5d8-46a5-9cb7-50e0299b0a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54f34ff234ab410588ffeff12c09c352', 'request_id': 'req-9dc5168f-e5d8-46a5-9cb7-50e0299b0a43'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:48.437273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26bbde-1779-45c1-8126-cfbfaceae157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=543aecefb7514859bad9195566f7df4f, user_id=6e280f21fd274a02bac741801d3c9078, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:48.438287 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9dc5168f-e5d8-46a5-9cb7-50e0299b0a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54f34ff234ab410588ffeff12c09c352', 'request_id': 'req-9dc5168f-e5d8-46a5-9cb7-50e0299b0a43'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:48.440037 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26bbde-1779-45c1-8126-cfbfaceae157 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:48.449463 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9dc5168f-e5d8-46a5-9cb7-50e0299b0a43 admin admin] The token cache is being invalidate because project 54f34ff234ab410588ffeff12c09c352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:48.449753 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9dc5168f-e5d8-46a5-9cb7-50e0299b0a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:48.450414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9dc5168f-e5d8-46a5-9cb7-50e0299b0a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:48.451977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1096/2165] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:48 2022] DELETE /identity/v3/projects/54f34ff234ab410588ffeff12c09c352 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:48.456568 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527dcc4-b4d7-4251-9642-6e28ea11d472 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:48.456854 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527dcc4-b4d7-4251-9642-6e28ea11d472 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:48.457134 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527dcc4-b4d7-4251-9642-6e28ea11d472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:48.478338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9527dcc4-b4d7-4251-9642-6e28ea11d472 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:48.479632 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9527dcc4-b4d7-4251-9642-6e28ea11d472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:48.487838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1097/2166] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:48.496229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3652348-2ac0-4876-a1e2-6f21506f6cea None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:48.496556 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3652348-2ac0-4876-a1e2-6f21506f6cea None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:48.496839 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3652348-2ac0-4876-a1e2-6f21506f6cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:48.514686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c3652348-2ac0-4876-a1e2-6f21506f6cea None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:48.515858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c3652348-2ac0-4876-a1e2-6f21506f6cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:48.524443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1098/2167] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:48.528522 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3652348-2ac0-4876-a1e2-6f21506f6cea None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:48.537357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3652348-2ac0-4876-a1e2-6f21506f6cea None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:48.542701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122145a8-ed1f-4275-84ad-94538e021c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:48.543342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122145a8-ed1f-4275-84ad-94538e021c9a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:48.543623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122145a8-ed1f-4275-84ad-94538e021c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:48.543979 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122145a8-ed1f-4275-84ad-94538e021c9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:48.544674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122145a8-ed1f-4275-84ad-94538e021c9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:48.544983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122145a8-ed1f-4275-84ad-94538e021c9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:48.546767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122145a8-ed1f-4275-84ad-94538e021c9a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:48.552682 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1070/2168] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:48 2022] PUT /identity/v3/projects/543aecefb7514859bad9195566f7df4f/users/6e280f21fd274a02bac741801d3c9078/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:48.565594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818afa3b-5cb8-4236-a1fb-08df9d76cdbb None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:48.565594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818afa3b-5cb8-4236-a1fb-08df9d76cdbb None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:48.565843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1099/2169] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:35:48.569134 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818afa3b-5cb8-4236-a1fb-08df9d76cdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:48.570308 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122145a8-ed1f-4275-84ad-94538e021c9a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:48.584303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122145a8-ed1f-4275-84ad-94538e021c9a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:48.605836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-818afa3b-5cb8-4236-a1fb-08df9d76cdbb None None] MFA Rules not processed for user `6e280f21fd274a02bac741801d3c9078`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:48.607341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-818afa3b-5cb8-4236-a1fb-08df9d76cdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:48.657527 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0964a9-0155-4ac6-b71e-a82506b03712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:48.659164 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0964a9-0155-4ac6-b71e-a82506b03712 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:48.659501 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0964a9-0155-4ac6-b71e-a82506b03712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:48.659916 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0964a9-0155-4ac6-b71e-a82506b03712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:48.660740 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0964a9-0155-4ac6-b71e-a82506b03712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:48.664188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0964a9-0155-4ac6-b71e-a82506b03712 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:48.712889 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1071/2170] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:48.723593 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818afa3b-5cb8-4236-a1fb-08df9d76cdbb None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:48.726778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-818afa3b-5cb8-4236-a1fb-08df9d76cdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:48.791828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1100/2171] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:48 2022] POST /identity/v3/projects => generated 399 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:48.792267 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818afa3b-5cb8-4236-a1fb-08df9d76cdbb None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:48.796028 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0964a9-0155-4ac6-b71e-a82506b03712 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:48.843937 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:48.847739 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84367bf3-f367-4c70-a38f-ee8e69199416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:48.848632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84367bf3-f367-4c70-a38f-ee8e69199416 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:48.849058 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84367bf3-f367-4c70-a38f-ee8e69199416 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:48.849510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84367bf3-f367-4c70-a38f-ee8e69199416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:48.874578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0964a9-0155-4ac6-b71e-a82506b03712 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:48.889674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38debf9a-e486-43a6-be6e-8dfd9d6124d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:48.890753 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38debf9a-e486-43a6-be6e-8dfd9d6124d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:48.891271 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38debf9a-e486-43a6-be6e-8dfd9d6124d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:48.891566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38debf9a-e486-43a6-be6e-8dfd9d6124d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:48.892390 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38debf9a-e486-43a6-be6e-8dfd9d6124d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:48.894966 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38debf9a-e486-43a6-be6e-8dfd9d6124d0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:48.946762 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84367bf3-f367-4c70-a38f-ee8e69199416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:48.948250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84367bf3-f367-4c70-a38f-ee8e69199416 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:48.959235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1072/2172] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:48.974749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40b726-1ff0-4bbc-a357-709af5f2c5e0 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:48.976648 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40b726-1ff0-4bbc-a357-709af5f2c5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:48.976836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40b726-1ff0-4bbc-a357-709af5f2c5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:48.985677 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:48.994076 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1101/2173] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:48 2022] POST /identity/v3/users => generated 300 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:48.995122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38debf9a-e486-43a6-be6e-8dfd9d6124d0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:49.008617 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38debf9a-e486-43a6-be6e-8dfd9d6124d0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:49.014274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e3d9e-533f-45b0-b06b-2066ead473fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:49.014958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e3d9e-533f-45b0-b06b-2066ead473fd admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:49.015237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e3d9e-533f-45b0-b06b-2066ead473fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:49.015601 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e3d9e-533f-45b0-b06b-2066ead473fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:49.016313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e3d9e-533f-45b0-b06b-2066ead473fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:49.018864 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e3d9e-533f-45b0-b06b-2066ead473fd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:49.021522 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-ff40b726-1ff0-4bbc-a357-709af5f2c5e0 None None] MFA Rules not processed for user `324aa7868ab84dc8823e2de74ea78549`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:49.023983 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ff40b726-1ff0-4bbc-a357-709af5f2c5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:49.035207 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1102/2174] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:49.037204 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e3d9e-533f-45b0-b06b-2066ead473fd admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:49.051376 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e3d9e-533f-45b0-b06b-2066ead473fd admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:49.058761 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f23789-51c0-4e6a-87f4-4cb402cfe882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:49.060615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23789-51c0-4e6a-87f4-4cb402cfe882 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:49.061112 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23789-51c0-4e6a-87f4-4cb402cfe882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:49.062003 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23789-51c0-4e6a-87f4-4cb402cfe882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:49.064420 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f23789-51c0-4e6a-87f4-4cb402cfe882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:49.066329 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f23789-51c0-4e6a-87f4-4cb402cfe882 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:49.085888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1103/2175] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:49.090657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f23789-51c0-4e6a-87f4-4cb402cfe882 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:49.104745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f23789-51c0-4e6a-87f4-4cb402cfe882 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:49.110184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d18115-7868-43ca-ae78-95cb280b4219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:49.111421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d18115-7868-43ca-ae78-95cb280b4219 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:49.111705 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d18115-7868-43ca-ae78-95cb280b4219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:49.111979 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d18115-7868-43ca-ae78-95cb280b4219 admin admin] PATH_INFO: `/v3/projects/0f46473f8d9d4dccad55e37424991d42/users/567e6c0031304acf9f6563e7b1d6a6f8/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:49.115365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1073/2176] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:49.120516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40b726-1ff0-4bbc-a357-709af5f2c5e0 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:49.122339 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ff40b726-1ff0-4bbc-a357-709af5f2c5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:49.138648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d18115-7868-43ca-ae78-95cb280b4219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f46473f8d9d4dccad55e37424991d42, user_id=567e6c0031304acf9f6563e7b1d6a6f8, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:49.140967 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40b726-1ff0-4bbc-a357-709af5f2c5e0 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:49.143168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d18115-7868-43ca-ae78-95cb280b4219 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:49.147032 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8c2ef-b985-462f-9d6c-9acce3ac187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:49.148465 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8c2ef-b985-462f-9d6c-9acce3ac187b admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:49.148921 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8c2ef-b985-462f-9d6c-9acce3ac187b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:49.149263 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8c2ef-b985-462f-9d6c-9acce3ac187b admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:49.150182 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8c2ef-b985-462f-9d6c-9acce3ac187b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:49.152358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8c2ef-b985-462f-9d6c-9acce3ac187b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:49.246306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1104/2177] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:49 2022] PUT /identity/v3/projects/0f46473f8d9d4dccad55e37424991d42/users/567e6c0031304acf9f6563e7b1d6a6f8/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:49.248239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1074/2178] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:49 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:35:49.255851 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d18115-7868-43ca-ae78-95cb280b4219 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:49.257070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec9994-b98f-4538-920e-9568e593491e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:49.257560 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec9994-b98f-4538-920e-9568e593491e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:49.257874 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec9994-b98f-4538-920e-9568e593491e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:49.286164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8eec9994-b98f-4538-920e-9568e593491e None None] MFA Rules not processed for user `567e6c0031304acf9f6563e7b1d6a6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:49.287379 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8eec9994-b98f-4538-920e-9568e593491e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:49.323726 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d18115-7868-43ca-ae78-95cb280b4219 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:49.354495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1075/2179] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:49.367842 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec9994-b98f-4538-920e-9568e593491e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:49.369223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8eec9994-b98f-4538-920e-9568e593491e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:49.382975 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea732dd-8054-4072-b99c-12b7fd632270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:49.383540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea732dd-8054-4072-b99c-12b7fd632270 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:49.383815 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea732dd-8054-4072-b99c-12b7fd632270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:49.387265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea732dd-8054-4072-b99c-12b7fd632270 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:49.387265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea732dd-8054-4072-b99c-12b7fd632270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:49.387265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea732dd-8054-4072-b99c-12b7fd632270 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:49.429932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec9994-b98f-4538-920e-9568e593491e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:49.433803 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785fe09-1638-4d0c-b89e-6aa00322cbc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:49.434463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785fe09-1638-4d0c-b89e-6aa00322cbc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:49.437220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785fe09-1638-4d0c-b89e-6aa00322cbc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:49.437220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785fe09-1638-4d0c-b89e-6aa00322cbc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:49.443910 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785fe09-1638-4d0c-b89e-6aa00322cbc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:49.446292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785fe09-1638-4d0c-b89e-6aa00322cbc3 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:49.455073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1076/2180] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:49.495957 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1105/2181] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:49 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:49.496192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785fe09-1638-4d0c-b89e-6aa00322cbc3 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:49.496563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea732dd-8054-4072-b99c-12b7fd632270 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:49.497345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a785fe09-1638-4d0c-b89e-6aa00322cbc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:49.514026 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785fe09-1638-4d0c-b89e-6aa00322cbc3 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:49.516331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea732dd-8054-4072-b99c-12b7fd632270 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:49.519157 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb49149-8f52-4ffe-b576-b40eee6aebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:49.520100 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb49149-8f52-4ffe-b576-b40eee6aebba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:49.520379 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb49149-8f52-4ffe-b576-b40eee6aebba admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:49.520675 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb49149-8f52-4ffe-b576-b40eee6aebba admin admin] PATH_INFO: `/v3/users/26d9586d48564d0594365654847d4ac9` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:49.522416 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb49149-8f52-4ffe-b576-b40eee6aebba admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d9586d48564d0594365654847d4ac9)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:49.523437 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0199773-cf52-4853-89be-855f88674c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:49.528794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb49149-8f52-4ffe-b576-b40eee6aebba admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:49.528908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0199773-cf52-4853-89be-855f88674c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:49.528908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0199773-cf52-4853-89be-855f88674c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:49.528908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0199773-cf52-4853-89be-855f88674c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:49.528908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0199773-cf52-4853-89be-855f88674c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:49.528908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0199773-cf52-4853-89be-855f88674c9b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:49.548665 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1106/2182] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:49.550875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0199773-cf52-4853-89be-855f88674c9b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:49.561251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0199773-cf52-4853-89be-855f88674c9b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:49.566124 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd2489-5064-4f79-8871-bf798746f4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:49.567014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd2489-5064-4f79-8871-bf798746f4ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:49.567297 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd2489-5064-4f79-8871-bf798746f4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:49.567578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd2489-5064-4f79-8871-bf798746f4ce admin admin] PATH_INFO: `/v3/projects/294f5a265c7c4ced9846120c5ac5ffa9/users/ae2c6c2248a4436697373782474f3167/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:49.590169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd2489-5064-4f79-8871-bf798746f4ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=294f5a265c7c4ced9846120c5ac5ffa9, user_id=ae2c6c2248a4436697373782474f3167, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:49.590169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd2489-5064-4f79-8871-bf798746f4ce admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:49.708635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1107/2183] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:49 2022] PUT /identity/v3/projects/294f5a265c7c4ced9846120c5ac5ffa9/users/ae2c6c2248a4436697373782474f3167/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:49.712623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd2489-5064-4f79-8871-bf798746f4ce admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:49.750143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9fb49149-8f52-4ffe-b576-b40eee6aebba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d9586d48564d0594365654847d4ac9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:49.764351 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9fb49149-8f52-4ffe-b576-b40eee6aebba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d9586d48564d0594365654847d4ac9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:49.765120 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9fb49149-8f52-4ffe-b576-b40eee6aebba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d9586d48564d0594365654847d4ac9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:49.765782 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9fb49149-8f52-4ffe-b576-b40eee6aebba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d9586d48564d0594365654847d4ac9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:49.776934 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9fb49149-8f52-4ffe-b576-b40eee6aebba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d9586d48564d0594365654847d4ac9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:49.796999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd2489-5064-4f79-8871-bf798746f4ce admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:49.802015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0b440-bdb7-4e18-834f-738ad6d45f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:49.802757 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0b440-bdb7-4e18-834f-738ad6d45f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:49.803182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0b440-bdb7-4e18-834f-738ad6d45f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:49.804142 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0b440-bdb7-4e18-834f-738ad6d45f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:49.805292 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0b440-bdb7-4e18-834f-738ad6d45f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:49.806637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0b440-bdb7-4e18-834f-738ad6d45f96 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:49.817626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1108/2184] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:49.822901 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0b440-bdb7-4e18-834f-738ad6d45f96 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:49.824636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f6f0b440-bdb7-4e18-834f-738ad6d45f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:49.837564 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0b440-bdb7-4e18-834f-738ad6d45f96 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:49.842311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01080bc-1fa3-48d1-9bfe-778c497231f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:49.843201 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01080bc-1fa3-48d1-9bfe-778c497231f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:49.843492 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01080bc-1fa3-48d1-9bfe-778c497231f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:49.843768 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01080bc-1fa3-48d1-9bfe-778c497231f7 admin admin] PATH_INFO: `/v3/projects/294f5a265c7c4ced9846120c5ac5ffa9/users/ae2c6c2248a4436697373782474f3167/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:49.845911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01080bc-1fa3-48d1-9bfe-778c497231f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=294f5a265c7c4ced9846120c5ac5ffa9, user_id=ae2c6c2248a4436697373782474f3167, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:49.848583 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01080bc-1fa3-48d1-9bfe-778c497231f7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:49.858334 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1077/2185] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:35:49 2022] DELETE /identity/v3/users/26d9586d48564d0594365654847d4ac9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:49.863221 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037951e-657d-48f3-bd9c-7d38574f1c2a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:49.863511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037951e-657d-48f3-bd9c-7d38574f1c2a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:49.863745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:49.863885 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037951e-657d-48f3-bd9c-7d38574f1c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:49.875446 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1109/2186] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:49 2022] PUT /identity/v3/projects/294f5a265c7c4ced9846120c5ac5ffa9/users/ae2c6c2248a4436697373782474f3167/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:49.908894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d037951e-657d-48f3-bd9c-7d38574f1c2a None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:49.908894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d037951e-657d-48f3-bd9c-7d38574f1c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:49.992081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1078/2187] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:50.003768 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01080bc-1fa3-48d1-9bfe-778c497231f7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:50.005516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b01080bc-1fa3-48d1-9bfe-778c497231f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:50.086110 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01080bc-1fa3-48d1-9bfe-778c497231f7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:50.090392 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f156d33-0fc4-4508-95a5-07eabc57b0cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:50.091274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f156d33-0fc4-4508-95a5-07eabc57b0cb service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:50.091766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f156d33-0fc4-4508-95a5-07eabc57b0cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:50.096874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f156d33-0fc4-4508-95a5-07eabc57b0cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:50.105629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f156d33-0fc4-4508-95a5-07eabc57b0cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:50.107168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f156d33-0fc4-4508-95a5-07eabc57b0cb service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:50.121205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1110/2188] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:50.787784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037951e-657d-48f3-bd9c-7d38574f1c2a None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:50.789958 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d037951e-657d-48f3-bd9c-7d38574f1c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:50.802957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037951e-657d-48f3-bd9c-7d38574f1c2a None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:50.808373 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec907e2-4424-4212-af5c-ae9b3e21daf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:50.809587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec907e2-4424-4212-af5c-ae9b3e21daf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:50.810017 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec907e2-4424-4212-af5c-ae9b3e21daf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:50.810434 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec907e2-4424-4212-af5c-ae9b3e21daf9 admin admin] PATH_INFO: `/v3/projects/1b6369fd157246fbac72ae4950a3e542` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:50.811949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec907e2-4424-4212-af5c-ae9b3e21daf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6369fd157246fbac72ae4950a3e542)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:50.814275 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec907e2-4424-4212-af5c-ae9b3e21daf9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:50.954603 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-aec907e2-4424-4212-af5c-ae9b3e21daf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6369fd157246fbac72ae4950a3e542', 'request_id': 'req-aec907e2-4424-4212-af5c-ae9b3e21daf9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:50.961123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-aec907e2-4424-4212-af5c-ae9b3e21daf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6369fd157246fbac72ae4950a3e542', 'request_id': 'req-aec907e2-4424-4212-af5c-ae9b3e21daf9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:51.035429 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-aec907e2-4424-4212-af5c-ae9b3e21daf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6369fd157246fbac72ae4950a3e542', 'request_id': 'req-aec907e2-4424-4212-af5c-ae9b3e21daf9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:51.048797 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-aec907e2-4424-4212-af5c-ae9b3e21daf9 admin admin] The token cache is being invalidate because project 1b6369fd157246fbac72ae4950a3e542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:35:51.049116 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-aec907e2-4424-4212-af5c-ae9b3e21daf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:51.049736 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-aec907e2-4424-4212-af5c-ae9b3e21daf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:35:51.055908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1079/2189] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:35:50 2022] DELETE /identity/v3/projects/1b6369fd157246fbac72ae4950a3e542 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:35:51.057507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6db0ed-4ea1-4dc1-a8a9-fba55c31279b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:51.058545 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6db0ed-4ea1-4dc1-a8a9-fba55c31279b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:51.058981 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6db0ed-4ea1-4dc1-a8a9-fba55c31279b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:51.078935 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4c6db0ed-4ea1-4dc1-a8a9-fba55c31279b None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:51.080243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4c6db0ed-4ea1-4dc1-a8a9-fba55c31279b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:51.146521 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1111/2190] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:51.167798 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d29162-0a2f-4ec0-9509-19b5b27f5bf0 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:51.167798 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d29162-0a2f-4ec0-9509-19b5b27f5bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:51.167798 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d29162-0a2f-4ec0-9509-19b5b27f5bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:51.178854 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-06d29162-0a2f-4ec0-9509-19b5b27f5bf0 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:51.180177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-06d29162-0a2f-4ec0-9509-19b5b27f5bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:51.188453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1080/2191] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:51.192832 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6db0ed-4ea1-4dc1-a8a9-fba55c31279b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:51.203383 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6db0ed-4ea1-4dc1-a8a9-fba55c31279b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:51.209826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fc5a5-0bf2-4b29-b31f-5d69c01a5111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:51.210515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fc5a5-0bf2-4b29-b31f-5d69c01a5111 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:51.210798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fc5a5-0bf2-4b29-b31f-5d69c01a5111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:51.211072 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fc5a5-0bf2-4b29-b31f-5d69c01a5111 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:51.211804 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fc5a5-0bf2-4b29-b31f-5d69c01a5111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:35:51.212105 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fc5a5-0bf2-4b29-b31f-5d69c01a5111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:51.213743 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fc5a5-0bf2-4b29-b31f-5d69c01a5111 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:51.225944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1112/2192] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:35:51.230298 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d29162-0a2f-4ec0-9509-19b5b27f5bf0 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:51.239685 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d29162-0a2f-4ec0-9509-19b5b27f5bf0 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:51.245738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa5fd0-609e-441e-980c-db86e0c071f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:51.246352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa5fd0-609e-441e-980c-db86e0c071f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:51.246646 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa5fd0-609e-441e-980c-db86e0c071f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:51.246926 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa5fd0-609e-441e-980c-db86e0c071f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:51.247999 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa5fd0-609e-441e-980c-db86e0c071f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:51.249913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa5fd0-609e-441e-980c-db86e0c071f1 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:51.355802 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1081/2193] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:35:51 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:51.359803 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fc5a5-0bf2-4b29-b31f-5d69c01a5111 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:51.371598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fc5a5-0bf2-4b29-b31f-5d69c01a5111 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:51.411585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465c28b-6a60-4bb0-9dfa-4319d9a6fed3 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:51.411725 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465c28b-6a60-4bb0-9dfa-4319d9a6fed3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:51.411906 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465c28b-6a60-4bb0-9dfa-4319d9a6fed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:51.448917 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fcf78-3481-4c76-b750-9429d2869e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:51.450324 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fcf78-3481-4c76-b750-9429d2869e72 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:51.451011 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fcf78-3481-4c76-b750-9429d2869e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:51.451359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fcf78-3481-4c76-b750-9429d2869e72 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:51.452134 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fcf78-3481-4c76-b750-9429d2869e72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:51.452457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f465c28b-6a60-4bb0-9dfa-4319d9a6fed3 None None] MFA Rules not processed for user `ae2c6c2248a4436697373782474f3167`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:51.454276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fcf78-3481-4c76-b750-9429d2869e72 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:51.454492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f465c28b-6a60-4bb0-9dfa-4319d9a6fed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:51.533363 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1082/2194] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:35:51.545813 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465c28b-6a60-4bb0-9dfa-4319d9a6fed3 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:51.552583 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f465c28b-6a60-4bb0-9dfa-4319d9a6fed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:51.563584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1113/2195] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:35:51 2022] POST /identity/v3/users => generated 284 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:35:51.563584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fcf78-3481-4c76-b750-9429d2869e72 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:51.577164 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fcf78-3481-4c76-b750-9429d2869e72 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:51.583095 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed5f13-8d28-4c3b-8fba-419e67924a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:51.583837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed5f13-8d28-4c3b-8fba-419e67924a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:51.584117 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed5f13-8d28-4c3b-8fba-419e67924a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:51.584416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed5f13-8d28-4c3b-8fba-419e67924a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:51.585186 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed5f13-8d28-4c3b-8fba-419e67924a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:51.586854 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed5f13-8d28-4c3b-8fba-419e67924a9a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:51.606307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1114/2196] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:35:51.607370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed5f13-8d28-4c3b-8fba-419e67924a9a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:51.619167 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed5f13-8d28-4c3b-8fba-419e67924a9a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:51.625019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7dd2a4-df4c-4a89-8259-74ca5dfcc43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:51.625500 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dd2a4-df4c-4a89-8259-74ca5dfcc43e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:51.625779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dd2a4-df4c-4a89-8259-74ca5dfcc43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:51.626046 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dd2a4-df4c-4a89-8259-74ca5dfcc43e admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:51.626819 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7dd2a4-df4c-4a89-8259-74ca5dfcc43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:51.627126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465c28b-6a60-4bb0-9dfa-4319d9a6fed3 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:51.628554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7dd2a4-df4c-4a89-8259-74ca5dfcc43e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:51.631323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c2d56-114c-4e63-85f5-2397fb925fb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:51.632138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c2d56-114c-4e63-85f5-2397fb925fb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:51.632800 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c2d56-114c-4e63-85f5-2397fb925fb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:51.633027 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c2d56-114c-4e63-85f5-2397fb925fb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:51.635171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-183c2d56-114c-4e63-85f5-2397fb925fb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:51.650439 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1115/2197] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:35:51.654111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7dd2a4-df4c-4a89-8259-74ca5dfcc43e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:51.672753 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7dd2a4-df4c-4a89-8259-74ca5dfcc43e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:51.678096 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b3209-8921-486f-945f-4d0031060cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:51.680206 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b3209-8921-486f-945f-4d0031060cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:51.680600 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b3209-8921-486f-945f-4d0031060cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:51.680971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b3209-8921-486f-945f-4d0031060cd0 admin admin] PATH_INFO: `/v3/projects/74b4c8d1a9d046c3b3639ddec5d8459d/users/5857c02b3422415fb7627da8c1a50be6/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:51.699943 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b3209-8921-486f-945f-4d0031060cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b4c8d1a9d046c3b3639ddec5d8459d, user_id=5857c02b3422415fb7627da8c1a50be6, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:51.702688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b3209-8921-486f-945f-4d0031060cd0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:51.714654 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c2d56-114c-4e63-85f5-2397fb925fb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:51.716133 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c2d56-114c-4e63-85f5-2397fb925fb4 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:51.725985 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1083/2198] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:35:51.806667 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1116/2199] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:35:51 2022] PUT /identity/v3/projects/74b4c8d1a9d046c3b3639ddec5d8459d/users/5857c02b3422415fb7627da8c1a50be6/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:35:51.817811 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717d221-1fc8-470d-b7da-5d1393ef004d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:51.818349 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717d221-1fc8-470d-b7da-5d1393ef004d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:51.818349 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717d221-1fc8-470d-b7da-5d1393ef004d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:51.846208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8717d221-1fc8-470d-b7da-5d1393ef004d None None] MFA Rules not processed for user `5857c02b3422415fb7627da8c1a50be6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:35:51.847411 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8717d221-1fc8-470d-b7da-5d1393ef004d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:51.920952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1084/2200] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:35:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:35:51.929195 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b3209-8921-486f-945f-4d0031060cd0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:35:51.931023 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-749b3209-8921-486f-945f-4d0031060cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:35:51.994615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b3209-8921-486f-945f-4d0031060cd0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:35:51.999139 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4100f-7bfb-44d5-b876-5c2869fa187e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde4369f695745c199ce6c10d241b841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:35:51.999787 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4100f-7bfb-44d5-b876-5c2869fa187e service glance] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:35:52.000072 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4100f-7bfb-44d5-b876-5c2869fa187e service glance] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:35:52.000352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4100f-7bfb-44d5-b876-5c2869fa187e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:35:52.009872 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4100f-7bfb-44d5-b876-5c2869fa187e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:35:52.011327 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4100f-7bfb-44d5-b876-5c2869fa187e service glance] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:35:52.020717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1117/2201] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:35:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:35:52.263283 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:53.028808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:54.114065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:54.305315 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:54.748766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:54.777075 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:54.897437 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:54.971163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:55.019566 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:55.059649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:55.217785 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:55.245458 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:55.331056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:INSERT=2,keystone:SELECT=90,keystone:DELETE=8 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:55.359702 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:55.502642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:55.531015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:55.708622 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=76,keystone:DELETE=22,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:55.737237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:55.852014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:55.880029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:56.025959 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:56.074567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:56.415130 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:56.439932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:56.525526 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:56.555160 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:56.659624 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:56.685972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:56.871335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:04.449472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717d221-1fc8-470d-b7da-5d1393ef004d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:04.450882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8717d221-1fc8-470d-b7da-5d1393ef004d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:04.511619 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717d221-1fc8-470d-b7da-5d1393ef004d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:04.515302 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154e157-700a-4001-a612-de0a3db57938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:04.516044 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154e157-700a-4001-a612-de0a3db57938 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:04.516330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154e157-700a-4001-a612-de0a3db57938 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:04.516608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154e157-700a-4001-a612-de0a3db57938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:04.561861 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:04.586138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154e157-700a-4001-a612-de0a3db57938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:04.588594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154e157-700a-4001-a612-de0a3db57938 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:04.599301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1085/2202] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:36:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:36:06.816749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:07.471790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4100f-7bfb-44d5-b876-5c2869fa187e service glance] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:07.473223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c5b4100f-7bfb-44d5-b876-5c2869fa187e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:07.564766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4100f-7bfb-44d5-b876-5c2869fa187e service glance] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:07.570769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec57b4-2e3f-41e1-bada-25667d3c8426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:07.572487 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec57b4-2e3f-41e1-bada-25667d3c8426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:07.573092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec57b4-2e3f-41e1-bada-25667d3c8426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:07.573450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec57b4-2e3f-41e1-bada-25667d3c8426 admin admin] PATH_INFO: `/v3/users/6e280f21fd274a02bac741801d3c9078` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:07.574878 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec57b4-2e3f-41e1-bada-25667d3c8426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e280f21fd274a02bac741801d3c9078)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:07.577020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec57b4-2e3f-41e1-bada-25667d3c8426 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:07.610513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154e157-700a-4001-a612-de0a3db57938 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:07.612026 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8154e157-700a-4001-a612-de0a3db57938 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:07.629928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154e157-700a-4001-a612-de0a3db57938 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:07.634830 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7099e-9e53-411a-a61e-b99646856f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:07.636187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7099e-9e53-411a-a61e-b99646856f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:07.636496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7099e-9e53-411a-a61e-b99646856f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:07.636776 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7099e-9e53-411a-a61e-b99646856f86 admin admin] PATH_INFO: `/v3/users/567e6c0031304acf9f6563e7b1d6a6f8` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:07.638240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7099e-9e53-411a-a61e-b99646856f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=567e6c0031304acf9f6563e7b1d6a6f8)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:07.640283 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7099e-9e53-411a-a61e-b99646856f86 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:07.755553 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8cec57b4-2e3f-41e1-bada-25667d3c8426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e280f21fd274a02bac741801d3c9078'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:07.770236 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8cec57b4-2e3f-41e1-bada-25667d3c8426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e280f21fd274a02bac741801d3c9078'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:07.779249 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8cec57b4-2e3f-41e1-bada-25667d3c8426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e280f21fd274a02bac741801d3c9078'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:07.780063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8cec57b4-2e3f-41e1-bada-25667d3c8426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e280f21fd274a02bac741801d3c9078'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:07.781059 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8cec57b4-2e3f-41e1-bada-25667d3c8426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e280f21fd274a02bac741801d3c9078'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:07.832953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-7fe7099e-9e53-411a-a61e-b99646856f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '567e6c0031304acf9f6563e7b1d6a6f8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:07.848680 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-7fe7099e-9e53-411a-a61e-b99646856f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '567e6c0031304acf9f6563e7b1d6a6f8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:07.849697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-7fe7099e-9e53-411a-a61e-b99646856f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '567e6c0031304acf9f6563e7b1d6a6f8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:07.850329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-7fe7099e-9e53-411a-a61e-b99646856f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '567e6c0031304acf9f6563e7b1d6a6f8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:07.858325 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-7fe7099e-9e53-411a-a61e-b99646856f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '567e6c0031304acf9f6563e7b1d6a6f8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:07.878672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1118/2203] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:36:07 2022] DELETE /identity/v3/users/6e280f21fd274a02bac741801d3c9078 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:36:07.887265 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4211d0-d5ef-4554-97fa-2a366e09d3f8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:07.887664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4211d0-d5ef-4554-97fa-2a366e09d3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:07.888213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4211d0-d5ef-4554-97fa-2a366e09d3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:07.907902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ec4211d0-d5ef-4554-97fa-2a366e09d3f8 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:07.909773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ec4211d0-d5ef-4554-97fa-2a366e09d3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:07.928692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1086/2204] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:36:07 2022] DELETE /identity/v3/users/567e6c0031304acf9f6563e7b1d6a6f8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:36:07.934640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4eeb7-d8b8-40d2-a15c-7d0dadeba790 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:07.934926 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4eeb7-d8b8-40d2-a15c-7d0dadeba790 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:07.935197 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4eeb7-d8b8-40d2-a15c-7d0dadeba790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:07.955099 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-43a4eeb7-d8b8-40d2-a15c-7d0dadeba790 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:07.956317 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-43a4eeb7-d8b8-40d2-a15c-7d0dadeba790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:07.979288 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1119/2205] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:07.989253 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4211d0-d5ef-4554-97fa-2a366e09d3f8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:07.990855 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ec4211d0-d5ef-4554-97fa-2a366e09d3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:08.015707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:08.025775 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1087/2206] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:36:08.035965 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4eeb7-d8b8-40d2-a15c-7d0dadeba790 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:08.037651 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-43a4eeb7-d8b8-40d2-a15c-7d0dadeba790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:08.054458 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4211d0-d5ef-4554-97fa-2a366e09d3f8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:08.098212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:08.102768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4eeb7-d8b8-40d2-a15c-7d0dadeba790 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:08.107323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14396a-12ff-4fd4-9f8d-eddbe74a9c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:08.108052 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14396a-12ff-4fd4-9f8d-eddbe74a9c6c service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:08.108371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14396a-12ff-4fd4-9f8d-eddbe74a9c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:08.108672 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14396a-12ff-4fd4-9f8d-eddbe74a9c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:08.112402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae13f7-35f5-461d-bf24-8f136de85c9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:08.113054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae13f7-35f5-461d-bf24-8f136de85c9e service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:08.116408 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae13f7-35f5-461d-bf24-8f136de85c9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:08.116408 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae13f7-35f5-461d-bf24-8f136de85c9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:08.119343 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14396a-12ff-4fd4-9f8d-eddbe74a9c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:08.120809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14396a-12ff-4fd4-9f8d-eddbe74a9c6c service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:08.123908 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae13f7-35f5-461d-bf24-8f136de85c9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:08.125419 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae13f7-35f5-461d-bf24-8f136de85c9e service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:08.132116 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1088/2207] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:36:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:36:08.137389 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1120/2208] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:36:08.666105 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14396a-12ff-4fd4-9f8d-eddbe74a9c6c service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:08.666628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0e14396a-12ff-4fd4-9f8d-eddbe74a9c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:08.701088 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14396a-12ff-4fd4-9f8d-eddbe74a9c6c service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:08.709462 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8b3ea-07d1-40a0-8856-89131eab609e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:08.710845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8b3ea-07d1-40a0-8856-89131eab609e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:08.711358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8b3ea-07d1-40a0-8856-89131eab609e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:08.711644 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8b3ea-07d1-40a0-8856-89131eab609e admin admin] PATH_INFO: `/v3/projects/543aecefb7514859bad9195566f7df4f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:08.714698 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8b3ea-07d1-40a0-8856-89131eab609e admin admin] RBAC: Authorizing `identity:delete_project(project_id=543aecefb7514859bad9195566f7df4f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:08.716671 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8b3ea-07d1-40a0-8856-89131eab609e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:08.739615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae13f7-35f5-461d-bf24-8f136de85c9e service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:08.742071 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-19ae13f7-35f5-461d-bf24-8f136de85c9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:08.784964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae13f7-35f5-461d-bf24-8f136de85c9e service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:08.792280 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce090c8-338d-489c-85bb-064c56c6543c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:08.793765 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce090c8-338d-489c-85bb-064c56c6543c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:08.794140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce090c8-338d-489c-85bb-064c56c6543c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:08.794457 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce090c8-338d-489c-85bb-064c56c6543c admin admin] PATH_INFO: `/v3/projects/0f46473f8d9d4dccad55e37424991d42` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:08.796440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce090c8-338d-489c-85bb-064c56c6543c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f46473f8d9d4dccad55e37424991d42)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:08.798578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce090c8-338d-489c-85bb-064c56c6543c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:08.845199 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f7f8b3ea-07d1-40a0-8856-89131eab609e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '543aecefb7514859bad9195566f7df4f', 'request_id': 'req-f7f8b3ea-07d1-40a0-8856-89131eab609e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:08.853056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f7f8b3ea-07d1-40a0-8856-89131eab609e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '543aecefb7514859bad9195566f7df4f', 'request_id': 'req-f7f8b3ea-07d1-40a0-8856-89131eab609e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:08.933903 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f7f8b3ea-07d1-40a0-8856-89131eab609e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '543aecefb7514859bad9195566f7df4f', 'request_id': 'req-f7f8b3ea-07d1-40a0-8856-89131eab609e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:08.950856 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fce090c8-338d-489c-85bb-064c56c6543c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f46473f8d9d4dccad55e37424991d42', 'request_id': 'req-fce090c8-338d-489c-85bb-064c56c6543c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:08.957090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f7f8b3ea-07d1-40a0-8856-89131eab609e admin admin] The token cache is being invalidate because project 543aecefb7514859bad9195566f7df4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:36:08.957430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f7f8b3ea-07d1-40a0-8856-89131eab609e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:08.960676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f7f8b3ea-07d1-40a0-8856-89131eab609e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:08.960875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1089/2209] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:36:08 2022] DELETE /identity/v3/projects/543aecefb7514859bad9195566f7df4f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:36:08.965866 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a3817-dfa5-496d-988a-85d85894de3f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:08.966548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a3817-dfa5-496d-988a-85d85894de3f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:08.967436 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a3817-dfa5-496d-988a-85d85894de3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:08.990664 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-440a3817-dfa5-496d-988a-85d85894de3f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:08.991963 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-440a3817-dfa5-496d-988a-85d85894de3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:09.031638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fce090c8-338d-489c-85bb-064c56c6543c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f46473f8d9d4dccad55e37424991d42', 'request_id': 'req-fce090c8-338d-489c-85bb-064c56c6543c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:09.042290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fce090c8-338d-489c-85bb-064c56c6543c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f46473f8d9d4dccad55e37424991d42', 'request_id': 'req-fce090c8-338d-489c-85bb-064c56c6543c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:09.058097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fce090c8-338d-489c-85bb-064c56c6543c admin admin] The token cache is being invalidate because project 0f46473f8d9d4dccad55e37424991d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:36:09.058642 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fce090c8-338d-489c-85bb-064c56c6543c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:09.059702 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fce090c8-338d-489c-85bb-064c56c6543c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:09.061944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1121/2210] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:36:08 2022] DELETE /identity/v3/projects/0f46473f8d9d4dccad55e37424991d42 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:36:09.068165 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ac179-4da3-4c8f-87a6-34a8594e8ec6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:09.069348 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ac179-4da3-4c8f-87a6-34a8594e8ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:09.069715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ac179-4da3-4c8f-87a6-34a8594e8ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:09.089183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d11ac179-4da3-4c8f-87a6-34a8594e8ec6 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:09.090666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d11ac179-4da3-4c8f-87a6-34a8594e8ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:09.098268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1090/2211] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:09.106966 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d4787-18f8-451f-b906-a73e0f0dc321 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:09.107375 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d4787-18f8-451f-b906-a73e0f0dc321 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:09.107801 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d4787-18f8-451f-b906-a73e0f0dc321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:09.112999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1122/2212] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:09.126233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2869e72-9b0a-4b85-b674-96526d7979d7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:09.126626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2869e72-9b0a-4b85-b674-96526d7979d7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:09.126847 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2869e72-9b0a-4b85-b674-96526d7979d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:09.132061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0c3d4787-18f8-451f-b906-a73e0f0dc321 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:09.133712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0c3d4787-18f8-451f-b906-a73e0f0dc321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:09.149455 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1091/2213] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:09.151576 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e2869e72-9b0a-4b85-b674-96526d7979d7 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:09.153637 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d4787-18f8-451f-b906-a73e0f0dc321 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:09.155768 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e2869e72-9b0a-4b85-b674-96526d7979d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:09.164549 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d4787-18f8-451f-b906-a73e0f0dc321 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:09.169993 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a04f9e-eccc-45c3-a46a-9dfe5b39bdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:09.170493 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a04f9e-eccc-45c3-a46a-9dfe5b39bdaf admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:09.170762 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a04f9e-eccc-45c3-a46a-9dfe5b39bdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:09.171034 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a04f9e-eccc-45c3-a46a-9dfe5b39bdaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:09.171777 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a04f9e-eccc-45c3-a46a-9dfe5b39bdaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:36:09.172079 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a04f9e-eccc-45c3-a46a-9dfe5b39bdaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:09.173590 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1123/2214] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:09.173843 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a04f9e-eccc-45c3-a46a-9dfe5b39bdaf admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:09.177901 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2869e72-9b0a-4b85-b674-96526d7979d7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:09.190289 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2869e72-9b0a-4b85-b674-96526d7979d7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:09.194627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1092/2215] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:36:09.197122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7150a-0c1d-4336-8851-6999573e2bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:09.197853 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7150a-0c1d-4336-8851-6999573e2bcb admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:09.198127 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7150a-0c1d-4336-8851-6999573e2bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:09.198396 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7150a-0c1d-4336-8851-6999573e2bcb admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:09.199141 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7150a-0c1d-4336-8851-6999573e2bcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:36:09.199445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7150a-0c1d-4336-8851-6999573e2bcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:09.199563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a04f9e-eccc-45c3-a46a-9dfe5b39bdaf admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:09.201343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7150a-0c1d-4336-8851-6999573e2bcb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:09.216939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a04f9e-eccc-45c3-a46a-9dfe5b39bdaf admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:09.220161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1124/2216] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:36:09.223523 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9dd25-2b1f-466e-bf62-0de4f1bef07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:09.224436 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9dd25-2b1f-466e-bf62-0de4f1bef07c admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:09.225317 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9dd25-2b1f-466e-bf62-0de4f1bef07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:09.225627 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7150a-0c1d-4336-8851-6999573e2bcb admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:09.225729 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9dd25-2b1f-466e-bf62-0de4f1bef07c admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:09.226336 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9dd25-2b1f-466e-bf62-0de4f1bef07c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:09.228312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9dd25-2b1f-466e-bf62-0de4f1bef07c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:09.239779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7150a-0c1d-4336-8851-6999573e2bcb admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:09.246145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b4997-268c-40e0-998a-74e051b72758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:09.247375 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b4997-268c-40e0-998a-74e051b72758 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:09.247724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b4997-268c-40e0-998a-74e051b72758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:09.248073 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b4997-268c-40e0-998a-74e051b72758 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:09.248857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b4997-268c-40e0-998a-74e051b72758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:09.251044 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b4997-268c-40e0-998a-74e051b72758 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:09.316129 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1093/2217] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:36:09 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:36:09.317602 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9dd25-2b1f-466e-bf62-0de4f1bef07c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:09.344710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1125/2218] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:36:09 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:36:09.348945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b4997-268c-40e0-998a-74e051b72758 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:09.366956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:09.377264 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:09.411346 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9dd25-2b1f-466e-bf62-0de4f1bef07c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:09.432925 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b4997-268c-40e0-998a-74e051b72758 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:09.446180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca21a98-972d-46a1-873a-f664e03536ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:09.447788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca21a98-972d-46a1-873a-f664e03536ac admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:09.448143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca21a98-972d-46a1-873a-f664e03536ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:09.448436 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca21a98-972d-46a1-873a-f664e03536ac admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:09.449479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca21a98-972d-46a1-873a-f664e03536ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:09.453467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca21a98-972d-46a1-873a-f664e03536ac admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:09.505782 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d56d7b-44a9-4ada-96da-b2d6c1bb0715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:09.507020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d56d7b-44a9-4ada-96da-b2d6c1bb0715 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:09.507344 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d56d7b-44a9-4ada-96da-b2d6c1bb0715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:09.507717 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d56d7b-44a9-4ada-96da-b2d6c1bb0715 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:09.508622 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d56d7b-44a9-4ada-96da-b2d6c1bb0715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:09.511020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d56d7b-44a9-4ada-96da-b2d6c1bb0715 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:09.562252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1126/2219] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:36:09 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:36:09.566465 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca21a98-972d-46a1-873a-f664e03536ac admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:09.579082 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca21a98-972d-46a1-873a-f664e03536ac admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:09.585121 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3cf83-aa7a-4019-a9f9-d9bcbe2950f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:09.591763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3cf83-aa7a-4019-a9f9-d9bcbe2950f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:09.591763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3cf83-aa7a-4019-a9f9-d9bcbe2950f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:09.591763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3cf83-aa7a-4019-a9f9-d9bcbe2950f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:09.591763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3cf83-aa7a-4019-a9f9-d9bcbe2950f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:09.591763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3cf83-aa7a-4019-a9f9-d9bcbe2950f7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:09.604665 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1127/2220] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:36:09.616551 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3cf83-aa7a-4019-a9f9-d9bcbe2950f7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:09.628877 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3cf83-aa7a-4019-a9f9-d9bcbe2950f7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:09.644246 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1094/2221] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:36:09 2022] POST /identity/v3/users => generated 288 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:36:09.648745 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d56d7b-44a9-4ada-96da-b2d6c1bb0715 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:09.654230 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4e25d-c521-47fc-b1f9-3128d7fb965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:09.655229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e25d-c521-47fc-b1f9-3128d7fb965a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:09.661080 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d56d7b-44a9-4ada-96da-b2d6c1bb0715 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:09.673374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a0c03-e5a9-4974-887d-154754525c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:09.673374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a0c03-e5a9-4974-887d-154754525c36 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:09.673374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a0c03-e5a9-4974-887d-154754525c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:09.673374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a0c03-e5a9-4974-887d-154754525c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:09.678953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a0c03-e5a9-4974-887d-154754525c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:09.678953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a0c03-e5a9-4974-887d-154754525c36 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:09.679104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e25d-c521-47fc-b1f9-3128d7fb965a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:09.679104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e25d-c521-47fc-b1f9-3128d7fb965a admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:09.679104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4e25d-c521-47fc-b1f9-3128d7fb965a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:09.684791 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4e25d-c521-47fc-b1f9-3128d7fb965a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:09.685809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1095/2222] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:36:09.690608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a0c03-e5a9-4974-887d-154754525c36 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:09.707646 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a0c03-e5a9-4974-887d-154754525c36 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:09.716370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1128/2223] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:36:09.716847 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4e25d-c521-47fc-b1f9-3128d7fb965a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:09.720708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed2a1b-6076-4378-9ad3-ce4bd426d9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:09.722005 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed2a1b-6076-4378-9ad3-ce4bd426d9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:09.722719 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed2a1b-6076-4378-9ad3-ce4bd426d9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:09.724295 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed2a1b-6076-4378-9ad3-ce4bd426d9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:09.726368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed2a1b-6076-4378-9ad3-ce4bd426d9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:09.728749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed2a1b-6076-4378-9ad3-ce4bd426d9a5 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:09.729203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4e25d-c521-47fc-b1f9-3128d7fb965a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:09.734785 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57db089-1b10-4eb5-8fd6-76bf885700dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:09.735585 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57db089-1b10-4eb5-8fd6-76bf885700dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:09.735852 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57db089-1b10-4eb5-8fd6-76bf885700dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:09.736132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57db089-1b10-4eb5-8fd6-76bf885700dc admin admin] PATH_INFO: `/v3/projects/8705999014cf43e1b1ccd5186b67b4bd/users/781e29f49f27417a96cfc4ba00af95dd/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:09.753766 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1096/2224] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:36:09.754740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed2a1b-6076-4378-9ad3-ce4bd426d9a5 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:09.757271 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57db089-1b10-4eb5-8fd6-76bf885700dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8705999014cf43e1b1ccd5186b67b4bd, user_id=781e29f49f27417a96cfc4ba00af95dd, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:09.760156 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57db089-1b10-4eb5-8fd6-76bf885700dc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:09.767512 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed2a1b-6076-4378-9ad3-ce4bd426d9a5 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:09.773206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e301919-7bd2-4377-9bee-6c8ebd674ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:09.773899 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e301919-7bd2-4377-9bee-6c8ebd674ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:09.774183 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e301919-7bd2-4377-9bee-6c8ebd674ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:09.774487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e301919-7bd2-4377-9bee-6c8ebd674ef3 admin admin] PATH_INFO: `/v3/projects/7909c0f990f24e7e8fab44e3d17a426c/users/7e89b8dc30e5434b8b09de73e2bf83ba/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:09.791536 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e301919-7bd2-4377-9bee-6c8ebd674ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7909c0f990f24e7e8fab44e3d17a426c, user_id=7e89b8dc30e5434b8b09de73e2bf83ba, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:09.794737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e301919-7bd2-4377-9bee-6c8ebd674ef3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:09.856168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1129/2225] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:36:09 2022] PUT /identity/v3/projects/8705999014cf43e1b1ccd5186b67b4bd/users/781e29f49f27417a96cfc4ba00af95dd/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:36:09.861615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4c109-e150-43db-a3e3-2809e393bdf7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:09.861916 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4c109-e150-43db-a3e3-2809e393bdf7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:09.862313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4c109-e150-43db-a3e3-2809e393bdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:09.892083 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1097/2226] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:36:09 2022] PUT /identity/v3/projects/7909c0f990f24e7e8fab44e3d17a426c/users/7e89b8dc30e5434b8b09de73e2bf83ba/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:36:09.909896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3641aa4-562f-4fc8-a9da-d631481fc4eb None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:09.910187 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3641aa4-562f-4fc8-a9da-d631481fc4eb None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:09.910464 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3641aa4-562f-4fc8-a9da-d631481fc4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:09.911649 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6ae4c109-e150-43db-a3e3-2809e393bdf7 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:09.913788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6ae4c109-e150-43db-a3e3-2809e393bdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:09.948046 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b3641aa4-562f-4fc8-a9da-d631481fc4eb None None] MFA Rules not processed for user `7e89b8dc30e5434b8b09de73e2bf83ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:09.949595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b3641aa4-562f-4fc8-a9da-d631481fc4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:10.005272 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1130/2227] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:36:10.016024 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4c109-e150-43db-a3e3-2809e393bdf7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:10.017604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6ae4c109-e150-43db-a3e3-2809e393bdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:10.063089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1098/2228] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:36:10.086632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3641aa4-562f-4fc8-a9da-d631481fc4eb None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:10.088202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b3641aa4-562f-4fc8-a9da-d631481fc4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:10.111089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:10.128687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4c109-e150-43db-a3e3-2809e393bdf7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:10.135760 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f805cfb-4827-40ec-9206-f20f6800f0f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:10.136541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f805cfb-4827-40ec-9206-f20f6800f0f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:10.136896 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f805cfb-4827-40ec-9206-f20f6800f0f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:10.137406 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f805cfb-4827-40ec-9206-f20f6800f0f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:10.149493 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f805cfb-4827-40ec-9206-f20f6800f0f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:10.151599 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f805cfb-4827-40ec-9206-f20f6800f0f5 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:10.158391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:10.167787 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1131/2229] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:36:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:36:10.173293 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3641aa4-562f-4fc8-a9da-d631481fc4eb None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:10.179227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedba76-867f-4b46-9bcc-418296119054 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:10.179227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedba76-867f-4b46-9bcc-418296119054 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:10.179575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedba76-867f-4b46-9bcc-418296119054 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:10.179682 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedba76-867f-4b46-9bcc-418296119054 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:10.190478 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eedba76-867f-4b46-9bcc-418296119054 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:10.195133 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eedba76-867f-4b46-9bcc-418296119054 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:10.206315 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1099/2230] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:36:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:36:14.638647 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357b38b-ef34-47e2-9e4a-7dcb40d3c124 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:14.639270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357b38b-ef34-47e2-9e4a-7dcb40d3c124 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:14.639270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357b38b-ef34-47e2-9e4a-7dcb40d3c124 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:14.642812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1132/2231] 10.222.0.52 () {54 vars in 921 bytes} [Fri Jun 17 07:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:36:14.657557 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d6f0b-032c-464e-8911-819832254cb6 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:14.658192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d6f0b-032c-464e-8911-819832254cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:14.658192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d6f0b-032c-464e-8911-819832254cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:14.683740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f00d6f0b-032c-464e-8911-819832254cb6 None None] MFA Rules not processed for user `71adc8b93e5c41929b928002e004df6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:14.687339 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f00d6f0b-032c-464e-8911-819832254cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:14.774264 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1100/2232] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Jun 17 07:36:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:14.786172 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357b38b-ef34-47e2-9e4a-7dcb40d3c124 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:14.791243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d357b38b-ef34-47e2-9e4a-7dcb40d3c124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:14.814663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357b38b-ef34-47e2-9e4a-7dcb40d3c124 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:14.821390 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66e9bd-2669-4627-b82c-05672ac5c81b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adc8b93e5c41929b928002e004df6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:14.822163 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66e9bd-2669-4627-b82c-05672ac5c81b service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:14.822509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66e9bd-2669-4627-b82c-05672ac5c81b service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:14.822996 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66e9bd-2669-4627-b82c-05672ac5c81b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:14.832483 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66e9bd-2669-4627-b82c-05672ac5c81b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:14.835562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66e9bd-2669-4627-b82c-05672ac5c81b service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:14.856464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1133/2233] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:36:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:36:14.870526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d6f0b-032c-464e-8911-819832254cb6 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:14.872438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f00d6f0b-032c-464e-8911-819832254cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:14.893788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d6f0b-032c-464e-8911-819832254cb6 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:14.901817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30adc1f-cd7f-4a25-80dc-2fe48bda93ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:14.902131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30adc1f-cd7f-4a25-80dc-2fe48bda93ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:14.902619 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30adc1f-cd7f-4a25-80dc-2fe48bda93ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:14.903215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30adc1f-cd7f-4a25-80dc-2fe48bda93ae admin admin] PATH_INFO: `/v3/users/3e7b9aa8532b47afafeb7481932bfce9` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:14.905649 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30adc1f-cd7f-4a25-80dc-2fe48bda93ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e7b9aa8532b47afafeb7481932bfce9)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:14.907902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30adc1f-cd7f-4a25-80dc-2fe48bda93ae admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:15.172708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a30adc1f-cd7f-4a25-80dc-2fe48bda93ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e7b9aa8532b47afafeb7481932bfce9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:15.194015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a30adc1f-cd7f-4a25-80dc-2fe48bda93ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e7b9aa8532b47afafeb7481932bfce9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:15.195221 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a30adc1f-cd7f-4a25-80dc-2fe48bda93ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e7b9aa8532b47afafeb7481932bfce9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:15.196086 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a30adc1f-cd7f-4a25-80dc-2fe48bda93ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e7b9aa8532b47afafeb7481932bfce9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:15.207240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a30adc1f-cd7f-4a25-80dc-2fe48bda93ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e7b9aa8532b47afafeb7481932bfce9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:15.286361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1101/2234] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:36:14 2022] DELETE /identity/v3/users/3e7b9aa8532b47afafeb7481932bfce9 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:36:15.594652 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66e9bd-2669-4627-b82c-05672ac5c81b service placement] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:15.632790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66e9bd-2669-4627-b82c-05672ac5c81b service placement] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:15.777881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54c5be-17bf-46e3-bf32-d02d9e0983c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:15.778843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54c5be-17bf-46e3-bf32-d02d9e0983c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:15.779223 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54c5be-17bf-46e3-bf32-d02d9e0983c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:15.779600 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54c5be-17bf-46e3-bf32-d02d9e0983c6 admin admin] PATH_INFO: `/v3/projects/1d57351560654accb09e975bbc8dcf17` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:15.781070 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54c5be-17bf-46e3-bf32-d02d9e0983c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d57351560654accb09e975bbc8dcf17)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:15.783824 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54c5be-17bf-46e3-bf32-d02d9e0983c6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:15.929476 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f54c5be-17bf-46e3-bf32-d02d9e0983c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d57351560654accb09e975bbc8dcf17', 'request_id': 'req-2f54c5be-17bf-46e3-bf32-d02d9e0983c6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:16.023094 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f54c5be-17bf-46e3-bf32-d02d9e0983c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d57351560654accb09e975bbc8dcf17', 'request_id': 'req-2f54c5be-17bf-46e3-bf32-d02d9e0983c6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:16.033771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f54c5be-17bf-46e3-bf32-d02d9e0983c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d57351560654accb09e975bbc8dcf17', 'request_id': 'req-2f54c5be-17bf-46e3-bf32-d02d9e0983c6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:16.057115 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f54c5be-17bf-46e3-bf32-d02d9e0983c6 admin admin] The token cache is being invalidate because project 1d57351560654accb09e975bbc8dcf17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:36:16.057536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f54c5be-17bf-46e3-bf32-d02d9e0983c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:16.058395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f54c5be-17bf-46e3-bf32-d02d9e0983c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:16.062497 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1134/2235] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:36:15 2022] DELETE /identity/v3/projects/1d57351560654accb09e975bbc8dcf17 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:36:16.067407 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3180-bc5f-402c-b72f-94387b06a48c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:16.068813 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3180-bc5f-402c-b72f-94387b06a48c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:16.070668 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3180-bc5f-402c-b72f-94387b06a48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:16.094831 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f95f3180-bc5f-402c-b72f-94387b06a48c None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:16.096241 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f95f3180-bc5f-402c-b72f-94387b06a48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:16.138793 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:16.234599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1102/2236] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:16.236059 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d77ee-15fd-4cc9-92f0-7c7b301023e1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:16.236411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d77ee-15fd-4cc9-92f0-7c7b301023e1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:16.236762 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d77ee-15fd-4cc9-92f0-7c7b301023e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:16.267976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1d6d77ee-15fd-4cc9-92f0-7c7b301023e1 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:16.269922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1d6d77ee-15fd-4cc9-92f0-7c7b301023e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:16.286372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f3180-bc5f-402c-b72f-94387b06a48c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:16.294464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1135/2237] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:36:16.298678 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f3180-bc5f-402c-b72f-94387b06a48c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:16.304311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea48a1a-889f-4554-9330-8ecd30e9b1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:16.305065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea48a1a-889f-4554-9330-8ecd30e9b1ee admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:16.305450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea48a1a-889f-4554-9330-8ecd30e9b1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:16.305792 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea48a1a-889f-4554-9330-8ecd30e9b1ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:16.306598 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea48a1a-889f-4554-9330-8ecd30e9b1ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:36:16.306972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea48a1a-889f-4554-9330-8ecd30e9b1ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:16.308847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea48a1a-889f-4554-9330-8ecd30e9b1ee admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:16.327734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1103/2238] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:36:16.332011 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d77ee-15fd-4cc9-92f0-7c7b301023e1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:16.342836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d77ee-15fd-4cc9-92f0-7c7b301023e1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:16.348116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdabb8-46c0-49e6-892f-f947b5031d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:16.349219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdabb8-46c0-49e6-892f-f947b5031d02 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:16.349867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdabb8-46c0-49e6-892f-f947b5031d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:16.351252 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdabb8-46c0-49e6-892f-f947b5031d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:16.352245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdabb8-46c0-49e6-892f-f947b5031d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:16.354723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdabb8-46c0-49e6-892f-f947b5031d02 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:16.473891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1136/2239] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:36:16 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:36:16.474668 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea48a1a-889f-4554-9330-8ecd30e9b1ee admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:16.488460 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea48a1a-889f-4554-9330-8ecd30e9b1ee admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:16.557290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453fe06-9404-46fd-a7b7-a7dc6e3c242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:16.558271 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453fe06-9404-46fd-a7b7-a7dc6e3c242f admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:16.558766 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453fe06-9404-46fd-a7b7-a7dc6e3c242f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:16.564438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453fe06-9404-46fd-a7b7-a7dc6e3c242f admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:16.564438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453fe06-9404-46fd-a7b7-a7dc6e3c242f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:16.564438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453fe06-9404-46fd-a7b7-a7dc6e3c242f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:16.653317 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1104/2240] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:36:16 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:36:16.657969 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdabb8-46c0-49e6-892f-f947b5031d02 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:16.676501 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdabb8-46c0-49e6-892f-f947b5031d02 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:16.683109 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecb8b0-579f-487c-9012-7125691f4b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:16.684112 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecb8b0-579f-487c-9012-7125691f4b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:16.684900 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecb8b0-579f-487c-9012-7125691f4b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:16.685672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecb8b0-579f-487c-9012-7125691f4b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:16.686681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecb8b0-579f-487c-9012-7125691f4b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:16.689202 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecb8b0-579f-487c-9012-7125691f4b0f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:16.709569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1137/2241] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:36:16.714277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453fe06-9404-46fd-a7b7-a7dc6e3c242f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:16.731077 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453fe06-9404-46fd-a7b7-a7dc6e3c242f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:16.738006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d62b4-481d-4dbc-83f3-7e403c7b98c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:16.738838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d62b4-481d-4dbc-83f3-7e403c7b98c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:16.739120 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d62b4-481d-4dbc-83f3-7e403c7b98c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:16.739639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d62b4-481d-4dbc-83f3-7e403c7b98c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:16.740481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d62b4-481d-4dbc-83f3-7e403c7b98c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:16.743254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d62b4-481d-4dbc-83f3-7e403c7b98c7 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:16.774243 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1105/2242] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:36:16.774918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecb8b0-579f-487c-9012-7125691f4b0f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:16.792272 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecb8b0-579f-487c-9012-7125691f4b0f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:16.804271 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9313f01-76bc-4ed9-9fdd-fdb597051526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:16.805833 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9313f01-76bc-4ed9-9fdd-fdb597051526 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:16.806306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9313f01-76bc-4ed9-9fdd-fdb597051526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:16.806759 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9313f01-76bc-4ed9-9fdd-fdb597051526 admin admin] PATH_INFO: `/v3/projects/ae461627578a489a9a6a9569cee15eb8/users/c9c07cf08d9c45479f9530efe9dcad2a/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:16.828326 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9313f01-76bc-4ed9-9fdd-fdb597051526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae461627578a489a9a6a9569cee15eb8, user_id=c9c07cf08d9c45479f9530efe9dcad2a, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:16.840473 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9313f01-76bc-4ed9-9fdd-fdb597051526 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:16.936895 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1138/2243] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:36:16 2022] PUT /identity/v3/projects/ae461627578a489a9a6a9569cee15eb8/users/c9c07cf08d9c45479f9530efe9dcad2a/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:36:16.941863 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44d122-16e3-4cbd-84f4-6ebea3dd10f7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:16.942325 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44d122-16e3-4cbd-84f4-6ebea3dd10f7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:16.942631 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44d122-16e3-4cbd-84f4-6ebea3dd10f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:16.974056 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-1a44d122-16e3-4cbd-84f4-6ebea3dd10f7 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:16.987523 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-1a44d122-16e3-4cbd-84f4-6ebea3dd10f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:17.057612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1106/2244] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:17.067473 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9313f01-76bc-4ed9-9fdd-fdb597051526 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:17.069409 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e9313f01-76bc-4ed9-9fdd-fdb597051526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:17.086868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:17.137924 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9313f01-76bc-4ed9-9fdd-fdb597051526 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:17.143103 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954614d-cfee-47b7-ba3e-03c9c36efc5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:17.144107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954614d-cfee-47b7-ba3e-03c9c36efc5f service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:17.144400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954614d-cfee-47b7-ba3e-03c9c36efc5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:17.144679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954614d-cfee-47b7-ba3e-03c9c36efc5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:17.157278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954614d-cfee-47b7-ba3e-03c9c36efc5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:17.158995 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954614d-cfee-47b7-ba3e-03c9c36efc5f service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:17.171415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1139/2245] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:36:17.891703 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f506d-ce36-4c2f-9f50-4d19a77817b4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:17.892537 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f506d-ce36-4c2f-9f50-4d19a77817b4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:17.892829 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f506d-ce36-4c2f-9f50-4d19a77817b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:17.925781 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-926f506d-ce36-4c2f-9f50-4d19a77817b4 None None] MFA Rules not processed for user `781e29f49f27417a96cfc4ba00af95dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:17.927396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-926f506d-ce36-4c2f-9f50-4d19a77817b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:17.954400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:18.027685 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1107/2246] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:18.032208 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954614d-cfee-47b7-ba3e-03c9c36efc5f service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:18.033892 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a954614d-cfee-47b7-ba3e-03c9c36efc5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:18.055225 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954614d-cfee-47b7-ba3e-03c9c36efc5f service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:18.060964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726e2d3-7b7c-4fa8-bd32-535b3a57ba94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:18.061744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726e2d3-7b7c-4fa8-bd32-535b3a57ba94 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:18.062693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726e2d3-7b7c-4fa8-bd32-535b3a57ba94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:18.063485 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726e2d3-7b7c-4fa8-bd32-535b3a57ba94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:18.064403 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726e2d3-7b7c-4fa8-bd32-535b3a57ba94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:18.066435 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726e2d3-7b7c-4fa8-bd32-535b3a57ba94 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:18.172602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1140/2247] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:36:18 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:36:18.176352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f506d-ce36-4c2f-9f50-4d19a77817b4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:18.190260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f506d-ce36-4c2f-9f50-4d19a77817b4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:18.274253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da422d-b504-46f0-bf60-e293c4fe0c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:18.274576 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da422d-b504-46f0-bf60-e293c4fe0c44 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:18.274791 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da422d-b504-46f0-bf60-e293c4fe0c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:18.275591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da422d-b504-46f0-bf60-e293c4fe0c44 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:18.277244 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da422d-b504-46f0-bf60-e293c4fe0c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:18.280021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da422d-b504-46f0-bf60-e293c4fe0c44 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:18.377725 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1108/2248] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:36:18 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:36:18.382687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726e2d3-7b7c-4fa8-bd32-535b3a57ba94 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:18.401216 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726e2d3-7b7c-4fa8-bd32-535b3a57ba94 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:18.406444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882e3f3-b0f4-4472-b32d-9b0cc5426be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:18.407257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882e3f3-b0f4-4472-b32d-9b0cc5426be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:18.407645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882e3f3-b0f4-4472-b32d-9b0cc5426be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:18.407993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882e3f3-b0f4-4472-b32d-9b0cc5426be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:18.408837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882e3f3-b0f4-4472-b32d-9b0cc5426be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:18.410577 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882e3f3-b0f4-4472-b32d-9b0cc5426be4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:18.424963 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1141/2249] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:36:18.430352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da422d-b504-46f0-bf60-e293c4fe0c44 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:18.441792 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da422d-b504-46f0-bf60-e293c4fe0c44 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:18.447749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aabfa-d7a3-48c6-b161-e262098031ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:18.448903 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aabfa-d7a3-48c6-b161-e262098031ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:18.449223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aabfa-d7a3-48c6-b161-e262098031ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:18.449600 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aabfa-d7a3-48c6-b161-e262098031ef admin admin] PATH_INFO: `/v3/projects/b99c9d9f4a384db1a8fc5252167f3b4f/users/ffb1baa644ca4adab70b783ef90545ed/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:18.465801 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90aabfa-d7a3-48c6-b161-e262098031ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99c9d9f4a384db1a8fc5252167f3b4f, user_id=ffb1baa644ca4adab70b783ef90545ed, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:18.468477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90aabfa-d7a3-48c6-b161-e262098031ef admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:18.536408 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1109/2250] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:36:18 2022] PUT /identity/v3/projects/b99c9d9f4a384db1a8fc5252167f3b4f/users/ffb1baa644ca4adab70b783ef90545ed/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:36:18.540599 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882e3f3-b0f4-4472-b32d-9b0cc5426be4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:18.551048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882e3f3-b0f4-4472-b32d-9b0cc5426be4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:18.609372 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d90a1-cf69-4db2-a0e4-697be70b8a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:18.609969 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d90a1-cf69-4db2-a0e4-697be70b8a06 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:18.610352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d90a1-cf69-4db2-a0e4-697be70b8a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:18.610619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d90a1-cf69-4db2-a0e4-697be70b8a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:18.611360 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d90a1-cf69-4db2-a0e4-697be70b8a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:18.613611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d90a1-cf69-4db2-a0e4-697be70b8a06 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:18.625690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1142/2251] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:36:18.629432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aabfa-d7a3-48c6-b161-e262098031ef admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:18.644328 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aabfa-d7a3-48c6-b161-e262098031ef admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:18.651203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f879e-9d23-4a1e-9e7a-56397cae37cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:18.652388 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f879e-9d23-4a1e-9e7a-56397cae37cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:18.652388 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f879e-9d23-4a1e-9e7a-56397cae37cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:18.652688 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f879e-9d23-4a1e-9e7a-56397cae37cf admin admin] PATH_INFO: `/v3/projects/b99c9d9f4a384db1a8fc5252167f3b4f/users/ffb1baa644ca4adab70b783ef90545ed/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:18.655314 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f879e-9d23-4a1e-9e7a-56397cae37cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99c9d9f4a384db1a8fc5252167f3b4f, user_id=ffb1baa644ca4adab70b783ef90545ed, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:18.658781 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f879e-9d23-4a1e-9e7a-56397cae37cf admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:18.680911 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1110/2252] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:36:18 2022] PUT /identity/v3/projects/b99c9d9f4a384db1a8fc5252167f3b4f/users/ffb1baa644ca4adab70b783ef90545ed/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:36:25.500775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175c909-e355-4259-9f6d-5c997a0b00d0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:25.501660 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175c909-e355-4259-9f6d-5c997a0b00d0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:25.502096 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175c909-e355-4259-9f6d-5c997a0b00d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:25.539590 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a175c909-e355-4259-9f6d-5c997a0b00d0 None None] MFA Rules not processed for user `c9c07cf08d9c45479f9530efe9dcad2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:25.540875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a175c909-e355-4259-9f6d-5c997a0b00d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:25.684394 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1143/2253] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:36:25.688991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f879e-9d23-4a1e-9e7a-56397cae37cf admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:25.691082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ac9f879e-9d23-4a1e-9e7a-56397cae37cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:25.879809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f879e-9d23-4a1e-9e7a-56397cae37cf admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:25.887485 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa9d42-2e7b-44f0-8ec2-6228c48b0147 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:25.888379 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa9d42-2e7b-44f0-8ec2-6228c48b0147 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:25.888840 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa9d42-2e7b-44f0-8ec2-6228c48b0147 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:25.889291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa9d42-2e7b-44f0-8ec2-6228c48b0147 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:25.900075 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa9d42-2e7b-44f0-8ec2-6228c48b0147 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:25.902175 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa9d42-2e7b-44f0-8ec2-6228c48b0147 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:25.910522 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:25.933402 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1111/2254] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:36:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:36:27.589865 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12df72f-1578-4737-8330-c8363610f44c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:27.590366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12df72f-1578-4737-8330-c8363610f44c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:27.590484 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12df72f-1578-4737-8330-c8363610f44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:27.610053 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:27.620863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f12df72f-1578-4737-8330-c8363610f44c None None] MFA Rules not processed for user `ffb1baa644ca4adab70b783ef90545ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:27.622515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f12df72f-1578-4737-8330-c8363610f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:27.740818 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1144/2255] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:27.758734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa9d42-2e7b-44f0-8ec2-6228c48b0147 service nova] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:27.770235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa9d42-2e7b-44f0-8ec2-6228c48b0147 service nova] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:27.777446 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b4165-9f39-4e52-a0fe-116e64299853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:27.778126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b4165-9f39-4e52-a0fe-116e64299853 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:27.778412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b4165-9f39-4e52-a0fe-116e64299853 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:27.778690 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b4165-9f39-4e52-a0fe-116e64299853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:27.841193 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b4165-9f39-4e52-a0fe-116e64299853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:27.842884 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b4165-9f39-4e52-a0fe-116e64299853 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:27.852622 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1112/2256] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:36:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:36:29.055297 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f56a9-2e5f-4920-84c0-9d34e923ae97 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:29.055781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f56a9-2e5f-4920-84c0-9d34e923ae97 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:29.055900 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f56a9-2e5f-4920-84c0-9d34e923ae97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:29.082010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d81f56a9-2e5f-4920-84c0-9d34e923ae97 None None] MFA Rules not processed for user `c9c07cf08d9c45479f9530efe9dcad2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:29.084290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d81f56a9-2e5f-4920-84c0-9d34e923ae97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:29.098565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1145/2257] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:37.848741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=29 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:39.074678 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=33 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:41.550511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b4165-9f39-4e52-a0fe-116e64299853 service nova] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:41.552087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a20b4165-9f39-4e52-a0fe-116e64299853 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:41.699618 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b4165-9f39-4e52-a0fe-116e64299853 service nova] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:41.705547 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db529e13-4f98-45ae-bf81-839c977711bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:41.706492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db529e13-4f98-45ae-bf81-839c977711bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:41.706836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db529e13-4f98-45ae-bf81-839c977711bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:41.707361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db529e13-4f98-45ae-bf81-839c977711bd admin admin] PATH_INFO: `/v3/users/324aa7868ab84dc8823e2de74ea78549` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:41.709594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db529e13-4f98-45ae-bf81-839c977711bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=324aa7868ab84dc8823e2de74ea78549)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:41.714419 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db529e13-4f98-45ae-bf81-839c977711bd admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:41.898643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-db529e13-4f98-45ae-bf81-839c977711bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '324aa7868ab84dc8823e2de74ea78549'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:41.911125 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-db529e13-4f98-45ae-bf81-839c977711bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '324aa7868ab84dc8823e2de74ea78549'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:41.911941 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-db529e13-4f98-45ae-bf81-839c977711bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '324aa7868ab84dc8823e2de74ea78549'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:41.912554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-db529e13-4f98-45ae-bf81-839c977711bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '324aa7868ab84dc8823e2de74ea78549'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:41.919439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-db529e13-4f98-45ae-bf81-839c977711bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '324aa7868ab84dc8823e2de74ea78549'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:41.981132 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1113/2258] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:36:41 2022] DELETE /identity/v3/users/324aa7868ab84dc8823e2de74ea78549 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:36:42.228370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f56a9-2e5f-4920-84c0-9d34e923ae97 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:42.261578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f56a9-2e5f-4920-84c0-9d34e923ae97 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:42.324799 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff5707-6a6a-4103-a6d6-58e9126940bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:42.325695 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff5707-6a6a-4103-a6d6-58e9126940bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:42.325975 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff5707-6a6a-4103-a6d6-58e9126940bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:42.326246 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff5707-6a6a-4103-a6d6-58e9126940bc admin admin] PATH_INFO: `/v3/projects/de05a05f535c456ca1ec35b64c96cad9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:42.327417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff5707-6a6a-4103-a6d6-58e9126940bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=de05a05f535c456ca1ec35b64c96cad9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:42.329365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff5707-6a6a-4103-a6d6-58e9126940bc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:42.438684 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-35ff5707-6a6a-4103-a6d6-58e9126940bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de05a05f535c456ca1ec35b64c96cad9', 'request_id': 'req-35ff5707-6a6a-4103-a6d6-58e9126940bc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:42.518097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-35ff5707-6a6a-4103-a6d6-58e9126940bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de05a05f535c456ca1ec35b64c96cad9', 'request_id': 'req-35ff5707-6a6a-4103-a6d6-58e9126940bc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:42.525569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-35ff5707-6a6a-4103-a6d6-58e9126940bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de05a05f535c456ca1ec35b64c96cad9', 'request_id': 'req-35ff5707-6a6a-4103-a6d6-58e9126940bc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:42.536168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-35ff5707-6a6a-4103-a6d6-58e9126940bc admin admin] The token cache is being invalidate because project de05a05f535c456ca1ec35b64c96cad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:36:42.536453 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-35ff5707-6a6a-4103-a6d6-58e9126940bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:42.537107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-35ff5707-6a6a-4103-a6d6-58e9126940bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:42.538778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1146/2259] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:36:42 2022] DELETE /identity/v3/projects/de05a05f535c456ca1ec35b64c96cad9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:36:42.542784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db529e13-4f98-45ae-bf81-839c977711bd admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:42.544335 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-db529e13-4f98-45ae-bf81-839c977711bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:42.558682 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db529e13-4f98-45ae-bf81-839c977711bd admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:42.572783 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:42.616806 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000b7d5-610c-43b3-9137-c7c602c0baa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:42.617693 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000b7d5-610c-43b3-9137-c7c602c0baa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:42.617980 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000b7d5-610c-43b3-9137-c7c602c0baa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:42.618258 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000b7d5-610c-43b3-9137-c7c602c0baa0 admin admin] PATH_INFO: `/v3/users/ae2c6c2248a4436697373782474f3167` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:42.619451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000b7d5-610c-43b3-9137-c7c602c0baa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2c6c2248a4436697373782474f3167)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:42.621701 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000b7d5-610c-43b3-9137-c7c602c0baa0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:42.831183 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3000b7d5-610c-43b3-9137-c7c602c0baa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2c6c2248a4436697373782474f3167'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:42.843366 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3000b7d5-610c-43b3-9137-c7c602c0baa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2c6c2248a4436697373782474f3167'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:42.844029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3000b7d5-610c-43b3-9137-c7c602c0baa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2c6c2248a4436697373782474f3167'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:42.844662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3000b7d5-610c-43b3-9137-c7c602c0baa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2c6c2248a4436697373782474f3167'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:42.853860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3000b7d5-610c-43b3-9137-c7c602c0baa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2c6c2248a4436697373782474f3167'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:42.938853 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1114/2260] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:36:42 2022] DELETE /identity/v3/users/ae2c6c2248a4436697373782474f3167 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:36:43.242535 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff5707-6a6a-4103-a6d6-58e9126940bc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:43.244693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-35ff5707-6a6a-4103-a6d6-58e9126940bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:43.258328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff5707-6a6a-4103-a6d6-58e9126940bc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:43.317620 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2b8ed-ef56-460f-9239-be15ec3c5116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:43.318526 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2b8ed-ef56-460f-9239-be15ec3c5116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:43.318989 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2b8ed-ef56-460f-9239-be15ec3c5116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:43.319332 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2b8ed-ef56-460f-9239-be15ec3c5116 admin admin] PATH_INFO: `/v3/projects/294f5a265c7c4ced9846120c5ac5ffa9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:43.320643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2b8ed-ef56-460f-9239-be15ec3c5116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=294f5a265c7c4ced9846120c5ac5ffa9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:43.322590 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2b8ed-ef56-460f-9239-be15ec3c5116 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:43.339953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:43.433876 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-89c2b8ed-ef56-460f-9239-be15ec3c5116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294f5a265c7c4ced9846120c5ac5ffa9', 'request_id': 'req-89c2b8ed-ef56-460f-9239-be15ec3c5116'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:43.483656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-89c2b8ed-ef56-460f-9239-be15ec3c5116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294f5a265c7c4ced9846120c5ac5ffa9', 'request_id': 'req-89c2b8ed-ef56-460f-9239-be15ec3c5116'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:43.490688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-89c2b8ed-ef56-460f-9239-be15ec3c5116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294f5a265c7c4ced9846120c5ac5ffa9', 'request_id': 'req-89c2b8ed-ef56-460f-9239-be15ec3c5116'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:43.501807 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-89c2b8ed-ef56-460f-9239-be15ec3c5116 admin admin] The token cache is being invalidate because project 294f5a265c7c4ced9846120c5ac5ffa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:36:43.502102 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-89c2b8ed-ef56-460f-9239-be15ec3c5116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:43.502802 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-89c2b8ed-ef56-460f-9239-be15ec3c5116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:43.504729 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1147/2261] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:36:43 2022] DELETE /identity/v3/projects/294f5a265c7c4ced9846120c5ac5ffa9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:36:43.509869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0d97d-7341-41aa-a022-a467f29f84fa None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:43.510161 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0d97d-7341-41aa-a022-a467f29f84fa None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:43.510431 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0d97d-7341-41aa-a022-a467f29f84fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:43.561000 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6fb0d97d-7341-41aa-a022-a467f29f84fa None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:43.562331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6fb0d97d-7341-41aa-a022-a467f29f84fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:43.622627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1115/2262] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:43.633126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd6d5-2318-4fc9-99ae-f174cbd04890 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:43.633450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd6d5-2318-4fc9-99ae-f174cbd04890 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:43.633777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd6d5-2318-4fc9-99ae-f174cbd04890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:43.654222 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e71bd6d5-2318-4fc9-99ae-f174cbd04890 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:43.655568 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e71bd6d5-2318-4fc9-99ae-f174cbd04890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:43.663826 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1148/2263] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:43.668348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0d97d-7341-41aa-a022-a467f29f84fa None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:43.678620 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0d97d-7341-41aa-a022-a467f29f84fa None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:43.684529 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe18d3-68d8-4c45-9cd8-29611a424265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:43.684961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe18d3-68d8-4c45-9cd8-29611a424265 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:43.685248 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe18d3-68d8-4c45-9cd8-29611a424265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:43.685565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe18d3-68d8-4c45-9cd8-29611a424265 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:43.686301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe18d3-68d8-4c45-9cd8-29611a424265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:36:43.686609 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe18d3-68d8-4c45-9cd8-29611a424265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:43.688253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe18d3-68d8-4c45-9cd8-29611a424265 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:43.702714 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1116/2264] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:36:43.707166 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bd6d5-2318-4fc9-99ae-f174cbd04890 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:43.719313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bd6d5-2318-4fc9-99ae-f174cbd04890 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:43.724650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339ec0d-8f87-4678-a263-947b9229fefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:43.725473 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339ec0d-8f87-4678-a263-947b9229fefd admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:43.728097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339ec0d-8f87-4678-a263-947b9229fefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:43.728097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339ec0d-8f87-4678-a263-947b9229fefd admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:43.728097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339ec0d-8f87-4678-a263-947b9229fefd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:43.728754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339ec0d-8f87-4678-a263-947b9229fefd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:43.868067 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1149/2265] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:36:43 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:36:43.872538 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe18d3-68d8-4c45-9cd8-29611a424265 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:43.878008 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:43.884276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe18d3-68d8-4c45-9cd8-29611a424265 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:43.943429 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d163c43-e879-4778-a7d0-8b1b60b43f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:43.944171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d163c43-e879-4778-a7d0-8b1b60b43f42 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:43.946025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d163c43-e879-4778-a7d0-8b1b60b43f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:43.946025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d163c43-e879-4778-a7d0-8b1b60b43f42 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:43.946217 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d163c43-e879-4778-a7d0-8b1b60b43f42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:43.948213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d163c43-e879-4778-a7d0-8b1b60b43f42 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:44.010541 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1117/2266] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:36:43 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:36:44.014760 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339ec0d-8f87-4678-a263-947b9229fefd admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:44.025929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339ec0d-8f87-4678-a263-947b9229fefd admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:44.030697 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2ee45-eb48-4f30-8ae4-a348db7d55ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:44.031361 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2ee45-eb48-4f30-8ae4-a348db7d55ca admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:44.031655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2ee45-eb48-4f30-8ae4-a348db7d55ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:44.031959 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2ee45-eb48-4f30-8ae4-a348db7d55ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:44.032701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2ee45-eb48-4f30-8ae4-a348db7d55ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:44.034382 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2ee45-eb48-4f30-8ae4-a348db7d55ca admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:44.045588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1150/2267] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:36:44.049485 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d163c43-e879-4778-a7d0-8b1b60b43f42 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:44.061065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d163c43-e879-4778-a7d0-8b1b60b43f42 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:44.070311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ac2df-2d2a-408a-bd4a-74fda9fbaac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:44.070980 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ac2df-2d2a-408a-bd4a-74fda9fbaac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:44.071262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ac2df-2d2a-408a-bd4a-74fda9fbaac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:44.071553 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ac2df-2d2a-408a-bd4a-74fda9fbaac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:44.072277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ac2df-2d2a-408a-bd4a-74fda9fbaac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:44.073929 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ac2df-2d2a-408a-bd4a-74fda9fbaac6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:44.086592 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1118/2268] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:36:44.090408 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2ee45-eb48-4f30-8ae4-a348db7d55ca admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:44.102395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2ee45-eb48-4f30-8ae4-a348db7d55ca admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:44.107593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e9f79-d5c4-4ff4-a916-e51c81e809bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:44.108522 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e9f79-d5c4-4ff4-a916-e51c81e809bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:44.108804 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e9f79-d5c4-4ff4-a916-e51c81e809bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:44.109086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e9f79-d5c4-4ff4-a916-e51c81e809bd admin admin] PATH_INFO: `/v3/projects/5a629523752d406c89b83cbad82a347a/users/d884d50fb5d4441195ca7c8187b2d673/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:44.129679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e9f79-d5c4-4ff4-a916-e51c81e809bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a629523752d406c89b83cbad82a347a, user_id=d884d50fb5d4441195ca7c8187b2d673, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:44.133486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e9f79-d5c4-4ff4-a916-e51c81e809bd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:44.222679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1151/2269] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:36:44 2022] PUT /identity/v3/projects/5a629523752d406c89b83cbad82a347a/users/d884d50fb5d4441195ca7c8187b2d673/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:36:44.241708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1888457-b860-447c-a963-6c497cfef20e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:44.242064 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1888457-b860-447c-a963-6c497cfef20e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:44.242394 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1888457-b860-447c-a963-6c497cfef20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:44.276018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c1888457-b860-447c-a963-6c497cfef20e None None] MFA Rules not processed for user `d884d50fb5d4441195ca7c8187b2d673`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:44.277225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c1888457-b860-447c-a963-6c497cfef20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:44.351161 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1119/2270] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:44.355964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e9f79-d5c4-4ff4-a916-e51c81e809bd admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:44.421696 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e9f79-d5c4-4ff4-a916-e51c81e809bd admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:44.426445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701ff0a-0d55-4ca9-a106-7ceb14669d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:44.427108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701ff0a-0d55-4ca9-a106-7ceb14669d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:44.427392 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701ff0a-0d55-4ca9-a106-7ceb14669d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:44.427674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701ff0a-0d55-4ca9-a106-7ceb14669d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:44.428416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701ff0a-0d55-4ca9-a106-7ceb14669d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:44.430532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701ff0a-0d55-4ca9-a106-7ceb14669d52 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:44.551244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1152/2271] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:36:44 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:36:44.555469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1888457-b860-447c-a963-6c497cfef20e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:44.567519 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1888457-b860-447c-a963-6c497cfef20e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:44.632244 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a4b1d-73e2-4615-bdc8-614bc8321aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:44.632913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a4b1d-73e2-4615-bdc8-614bc8321aaf admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:44.633194 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a4b1d-73e2-4615-bdc8-614bc8321aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:44.633499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a4b1d-73e2-4615-bdc8-614bc8321aaf admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:44.634181 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a4b1d-73e2-4615-bdc8-614bc8321aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:44.636249 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a4b1d-73e2-4615-bdc8-614bc8321aaf admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:44.725662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:44.731146 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1120/2272] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:36:44 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:36:44.735068 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701ff0a-0d55-4ca9-a106-7ceb14669d52 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:44.746242 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701ff0a-0d55-4ca9-a106-7ceb14669d52 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:44.750926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d481b-f977-44d6-a33d-e1ca9947c9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:44.751591 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d481b-f977-44d6-a33d-e1ca9947c9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:44.751869 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d481b-f977-44d6-a33d-e1ca9947c9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:44.752151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d481b-f977-44d6-a33d-e1ca9947c9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:44.752871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d481b-f977-44d6-a33d-e1ca9947c9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:44.754487 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d481b-f977-44d6-a33d-e1ca9947c9f9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:44.766021 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1153/2273] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:36:44.770234 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a4b1d-73e2-4615-bdc8-614bc8321aaf admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:44.781533 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a4b1d-73e2-4615-bdc8-614bc8321aaf admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:44.787115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef170f-b012-4ce0-9bcf-844b0f1bac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:44.788116 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef170f-b012-4ce0-9bcf-844b0f1bac7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:44.788425 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef170f-b012-4ce0-9bcf-844b0f1bac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:44.788702 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef170f-b012-4ce0-9bcf-844b0f1bac7f admin admin] PATH_INFO: `/v3/projects/ed3e4c0715f9445c89b8a005c2526444/users/c26f4efb172843628e5a46885e23546f/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:44.805573 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef170f-b012-4ce0-9bcf-844b0f1bac7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3e4c0715f9445c89b8a005c2526444, user_id=c26f4efb172843628e5a46885e23546f, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:44.808240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef170f-b012-4ce0-9bcf-844b0f1bac7f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:44.874422 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1121/2274] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:36:44 2022] PUT /identity/v3/projects/ed3e4c0715f9445c89b8a005c2526444/users/c26f4efb172843628e5a46885e23546f/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:36:44.878376 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d481b-f977-44d6-a33d-e1ca9947c9f9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:44.889400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d481b-f977-44d6-a33d-e1ca9947c9f9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:44.898494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:44.951984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84092e0-027c-452e-90c4-7c6f60460c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:44.952665 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84092e0-027c-452e-90c4-7c6f60460c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:44.952949 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84092e0-027c-452e-90c4-7c6f60460c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:44.953228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84092e0-027c-452e-90c4-7c6f60460c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:44.954010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84092e0-027c-452e-90c4-7c6f60460c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:44.955638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84092e0-027c-452e-90c4-7c6f60460c63 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:44.966647 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1154/2275] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:36:44.970968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef170f-b012-4ce0-9bcf-844b0f1bac7f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:44.982964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef170f-b012-4ce0-9bcf-844b0f1bac7f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:44.987730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897e0be-d35a-4bdc-bf89-742a9f7f4285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:44.988611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897e0be-d35a-4bdc-bf89-742a9f7f4285 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:44.988893 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897e0be-d35a-4bdc-bf89-742a9f7f4285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:44.989166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897e0be-d35a-4bdc-bf89-742a9f7f4285 admin admin] PATH_INFO: `/v3/projects/ed3e4c0715f9445c89b8a005c2526444/users/c26f4efb172843628e5a46885e23546f/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:44.992052 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897e0be-d35a-4bdc-bf89-742a9f7f4285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3e4c0715f9445c89b8a005c2526444, user_id=c26f4efb172843628e5a46885e23546f, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:44.994813 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897e0be-d35a-4bdc-bf89-742a9f7f4285 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:45.005510 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1122/2276] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:36:44 2022] PUT /identity/v3/projects/ed3e4c0715f9445c89b8a005c2526444/users/c26f4efb172843628e5a46885e23546f/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:36:45.017837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c35d30-4a55-4cfa-82f8-badded7ceb2b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:45.018123 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c35d30-4a55-4cfa-82f8-badded7ceb2b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:45.018401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c35d30-4a55-4cfa-82f8-badded7ceb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:45.055670 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-47c35d30-4a55-4cfa-82f8-badded7ceb2b None None] MFA Rules not processed for user `c26f4efb172843628e5a46885e23546f`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:45.056897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-47c35d30-4a55-4cfa-82f8-badded7ceb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:45.142417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1155/2277] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:45.149924 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897e0be-d35a-4bdc-bf89-742a9f7f4285 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:45.151769 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9897e0be-d35a-4bdc-bf89-742a9f7f4285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:45.233194 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897e0be-d35a-4bdc-bf89-742a9f7f4285 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:45.237062 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595eaab1-25f5-476f-abe7-7f1380de2291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:45.237777 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eaab1-25f5-476f-abe7-7f1380de2291 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:45.238123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eaab1-25f5-476f-abe7-7f1380de2291 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:45.238544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eaab1-25f5-476f-abe7-7f1380de2291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:45.301824 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595eaab1-25f5-476f-abe7-7f1380de2291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:45.304128 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595eaab1-25f5-476f-abe7-7f1380de2291 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:45.314543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1123/2278] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:36:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:36:55.136102 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=57 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:55.309355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=70,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:55.664982 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c35d30-4a55-4cfa-82f8-badded7ceb2b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:55.675701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c35d30-4a55-4cfa-82f8-badded7ceb2b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:55.682307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eb906-79a5-46bb-b6b5-d497ee49dafc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:55.683016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eb906-79a5-46bb-b6b5-d497ee49dafc service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:55.683302 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eb906-79a5-46bb-b6b5-d497ee49dafc service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:55.683579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eb906-79a5-46bb-b6b5-d497ee49dafc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:55.694221 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eb906-79a5-46bb-b6b5-d497ee49dafc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:55.695701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eb906-79a5-46bb-b6b5-d497ee49dafc service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:55.705876 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1156/2279] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:36:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:36:56.307565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595eaab1-25f5-476f-abe7-7f1380de2291 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:56.308958 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-595eaab1-25f5-476f-abe7-7f1380de2291 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:56.376812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595eaab1-25f5-476f-abe7-7f1380de2291 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:56.382544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f2145-02fa-4482-94c9-101998dada92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:56.385800 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2145-02fa-4482-94c9-101998dada92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:56.385800 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2145-02fa-4482-94c9-101998dada92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:56.385800 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2145-02fa-4482-94c9-101998dada92 admin admin] PATH_INFO: `/v3/users/7e89b8dc30e5434b8b09de73e2bf83ba` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:56.385800 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f2145-02fa-4482-94c9-101998dada92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e89b8dc30e5434b8b09de73e2bf83ba)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:56.387236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f2145-02fa-4482-94c9-101998dada92 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:56.643723 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0d3f2145-02fa-4482-94c9-101998dada92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e89b8dc30e5434b8b09de73e2bf83ba'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:56.657705 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0d3f2145-02fa-4482-94c9-101998dada92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e89b8dc30e5434b8b09de73e2bf83ba'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:56.658753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0d3f2145-02fa-4482-94c9-101998dada92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e89b8dc30e5434b8b09de73e2bf83ba'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:56.659349 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0d3f2145-02fa-4482-94c9-101998dada92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e89b8dc30e5434b8b09de73e2bf83ba'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:56.667284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0d3f2145-02fa-4482-94c9-101998dada92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e89b8dc30e5434b8b09de73e2bf83ba'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:56.784268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1124/2280] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:36:56 2022] DELETE /identity/v3/users/7e89b8dc30e5434b8b09de73e2bf83ba => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:36:56.790169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666ffc4-67fc-4eca-b87a-0d9b2bd6d6f2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:56.790682 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666ffc4-67fc-4eca-b87a-0d9b2bd6d6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:56.790864 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666ffc4-67fc-4eca-b87a-0d9b2bd6d6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:56.808697 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1666ffc4-67fc-4eca-b87a-0d9b2bd6d6f2 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:56.809948 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1666ffc4-67fc-4eca-b87a-0d9b2bd6d6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:56.867867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1157/2281] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:56.877811 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f2145-02fa-4482-94c9-101998dada92 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:56.879214 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0d3f2145-02fa-4482-94c9-101998dada92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:56.961115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f2145-02fa-4482-94c9-101998dada92 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:56.964546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec031100-12e3-48b7-8831-d71f04233575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:56.965217 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec031100-12e3-48b7-8831-d71f04233575 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:56.965523 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec031100-12e3-48b7-8831-d71f04233575 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:56.965796 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec031100-12e3-48b7-8831-d71f04233575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:56.975484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec031100-12e3-48b7-8831-d71f04233575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:56.976917 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec031100-12e3-48b7-8831-d71f04233575 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:56.986279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1125/2282] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:36:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:36:57.485685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666ffc4-67fc-4eca-b87a-0d9b2bd6d6f2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:57.488071 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1666ffc4-67fc-4eca-b87a-0d9b2bd6d6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:57.537122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666ffc4-67fc-4eca-b87a-0d9b2bd6d6f2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:57.545582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc553733-8794-43ed-8ec6-71125e535161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:57.548460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc553733-8794-43ed-8ec6-71125e535161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:57.548460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc553733-8794-43ed-8ec6-71125e535161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:57.548460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc553733-8794-43ed-8ec6-71125e535161 admin admin] PATH_INFO: `/v3/projects/7909c0f990f24e7e8fab44e3d17a426c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:57.548460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc553733-8794-43ed-8ec6-71125e535161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7909c0f990f24e7e8fab44e3d17a426c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:57.550370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc553733-8794-43ed-8ec6-71125e535161 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:57.715722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cc553733-8794-43ed-8ec6-71125e535161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7909c0f990f24e7e8fab44e3d17a426c', 'request_id': 'req-cc553733-8794-43ed-8ec6-71125e535161'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:57.805979 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cc553733-8794-43ed-8ec6-71125e535161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7909c0f990f24e7e8fab44e3d17a426c', 'request_id': 'req-cc553733-8794-43ed-8ec6-71125e535161'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:57.812690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cc553733-8794-43ed-8ec6-71125e535161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7909c0f990f24e7e8fab44e3d17a426c', 'request_id': 'req-cc553733-8794-43ed-8ec6-71125e535161'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:57.826571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cc553733-8794-43ed-8ec6-71125e535161 admin admin] The token cache is being invalidate because project 7909c0f990f24e7e8fab44e3d17a426c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:36:57.826852 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cc553733-8794-43ed-8ec6-71125e535161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:57.827534 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cc553733-8794-43ed-8ec6-71125e535161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:36:57.829078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1158/2283] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:36:57 2022] DELETE /identity/v3/projects/7909c0f990f24e7e8fab44e3d17a426c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:36:57.836999 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055af3c9-d0b5-44a6-b1ef-fe4145141e9e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:57.837564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055af3c9-d0b5-44a6-b1ef-fe4145141e9e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:57.837564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055af3c9-d0b5-44a6-b1ef-fe4145141e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:57.841497 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:57.868244 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-055af3c9-d0b5-44a6-b1ef-fe4145141e9e None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:57.869512 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-055af3c9-d0b5-44a6-b1ef-fe4145141e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:57.935253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1126/2284] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:57.943922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62629065-2398-4f66-b03a-0f2ec1fc085c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:57.944208 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62629065-2398-4f66-b03a-0f2ec1fc085c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:57.944559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62629065-2398-4f66-b03a-0f2ec1fc085c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:57.963795 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-62629065-2398-4f66-b03a-0f2ec1fc085c None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:57.964997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-62629065-2398-4f66-b03a-0f2ec1fc085c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:57.972945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1159/2285] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:57.977142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055af3c9-d0b5-44a6-b1ef-fe4145141e9e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:57.987476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055af3c9-d0b5-44a6-b1ef-fe4145141e9e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:57.992499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb6d4c-c8a1-40a5-a930-c80d30ed0518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:57.994238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb6d4c-c8a1-40a5-a930-c80d30ed0518 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:57.994238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb6d4c-c8a1-40a5-a930-c80d30ed0518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:57.994238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb6d4c-c8a1-40a5-a930-c80d30ed0518 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:57.994513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb6d4c-c8a1-40a5-a930-c80d30ed0518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:36:57.994797 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb6d4c-c8a1-40a5-a930-c80d30ed0518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:57.996664 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb6d4c-c8a1-40a5-a930-c80d30ed0518 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:58.009577 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1127/2286] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:36:58.013988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62629065-2398-4f66-b03a-0f2ec1fc085c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:58.024424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62629065-2398-4f66-b03a-0f2ec1fc085c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:58.029118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87239d2-708b-46ed-b383-01b930093334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:58.029817 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87239d2-708b-46ed-b383-01b930093334 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:58.030120 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87239d2-708b-46ed-b383-01b930093334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:58.030393 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87239d2-708b-46ed-b383-01b930093334 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:58.031080 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87239d2-708b-46ed-b383-01b930093334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:58.032989 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87239d2-708b-46ed-b383-01b930093334 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:58.148443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1160/2287] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:36:58 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:36:58.152965 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb6d4c-c8a1-40a5-a930-c80d30ed0518 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:58.163704 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb6d4c-c8a1-40a5-a930-c80d30ed0518 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:58.222626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1ebdb-fc16-436a-a7c7-88856da198b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:58.223299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1ebdb-fc16-436a-a7c7-88856da198b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:58.223576 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1ebdb-fc16-436a-a7c7-88856da198b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:58.223847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1ebdb-fc16-436a-a7c7-88856da198b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:58.224664 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1ebdb-fc16-436a-a7c7-88856da198b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:58.226652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1ebdb-fc16-436a-a7c7-88856da198b0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:58.321725 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1128/2288] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:36:58 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:36:58.326094 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87239d2-708b-46ed-b383-01b930093334 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:58.338247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87239d2-708b-46ed-b383-01b930093334 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:58.343349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3749ff9-d575-469f-999d-ec2d665fedf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:58.344354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3749ff9-d575-469f-999d-ec2d665fedf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:58.344476 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3749ff9-d575-469f-999d-ec2d665fedf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:58.344832 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3749ff9-d575-469f-999d-ec2d665fedf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:58.345683 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3749ff9-d575-469f-999d-ec2d665fedf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:58.347357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3749ff9-d575-469f-999d-ec2d665fedf0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:58.359277 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1161/2289] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:36:58.364613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1ebdb-fc16-436a-a7c7-88856da198b0 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:58.377776 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1ebdb-fc16-436a-a7c7-88856da198b0 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:58.387796 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e836e2-1978-4b0b-8cc6-05481c07bb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:58.388472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e836e2-1978-4b0b-8cc6-05481c07bb8a admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:58.388755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e836e2-1978-4b0b-8cc6-05481c07bb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:58.389655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e836e2-1978-4b0b-8cc6-05481c07bb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:58.391275 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e836e2-1978-4b0b-8cc6-05481c07bb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:58.392577 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e836e2-1978-4b0b-8cc6-05481c07bb8a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:58.429782 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1129/2290] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:36:58.434811 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3749ff9-d575-469f-999d-ec2d665fedf0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:58.446877 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3749ff9-d575-469f-999d-ec2d665fedf0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:58.459757 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b199a0-8aaf-4814-b413-ccaacb2d5957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:58.460796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b199a0-8aaf-4814-b413-ccaacb2d5957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:58.460954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b199a0-8aaf-4814-b413-ccaacb2d5957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:58.461640 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b199a0-8aaf-4814-b413-ccaacb2d5957 admin admin] PATH_INFO: `/v3/projects/a111e2b2b89a408c8dc1857f3e2eeed5/users/b3efa30eb90749d789feab8de6a548d2/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:58.477952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b199a0-8aaf-4814-b413-ccaacb2d5957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a111e2b2b89a408c8dc1857f3e2eeed5, user_id=b3efa30eb90749d789feab8de6a548d2, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:58.480856 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b199a0-8aaf-4814-b413-ccaacb2d5957 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:58.593439 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1162/2291] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:36:58 2022] PUT /identity/v3/projects/a111e2b2b89a408c8dc1857f3e2eeed5/users/b3efa30eb90749d789feab8de6a548d2/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:36:58.604709 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540804e-5d01-4691-91ed-83405f339ea9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:58.605001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540804e-5d01-4691-91ed-83405f339ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:58.605281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540804e-5d01-4691-91ed-83405f339ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:58.633467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b540804e-5d01-4691-91ed-83405f339ea9 None None] MFA Rules not processed for user `b3efa30eb90749d789feab8de6a548d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:36:58.634683 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b540804e-5d01-4691-91ed-83405f339ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:58.682513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:58.700376 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1130/2292] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:36:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:36:58.712121 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b199a0-8aaf-4814-b413-ccaacb2d5957 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:36:58.713940 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-87b199a0-8aaf-4814-b413-ccaacb2d5957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:36:58.723880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:58.772406 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b199a0-8aaf-4814-b413-ccaacb2d5957 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:36:58.776040 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73729f-c692-493c-bbe0-f2a12985fd57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:36:58.776685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73729f-c692-493c-bbe0-f2a12985fd57 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:36:58.776968 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73729f-c692-493c-bbe0-f2a12985fd57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:36:58.777245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73729f-c692-493c-bbe0-f2a12985fd57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:36:58.785640 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73729f-c692-493c-bbe0-f2a12985fd57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:36:58.787213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73729f-c692-493c-bbe0-f2a12985fd57 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:36:58.796787 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1163/2293] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:36:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:37:08.737049 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:08.814399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=23 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:17.846454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6a968-8062-4d3b-8508-6c75b29630f9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:17.846966 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6a968-8062-4d3b-8508-6c75b29630f9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:17.847059 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6a968-8062-4d3b-8508-6c75b29630f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:17.866717 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e8a6a968-8062-4d3b-8508-6c75b29630f9 None None] MFA Rules not processed for user `8b753148f55e4fb0897bf9639e8d4d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:37:17.867946 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e8a6a968-8062-4d3b-8508-6c75b29630f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:17.923499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1131/2294] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:37:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:37:19.145507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73729f-c692-493c-bbe0-f2a12985fd57 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:19.147742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9a73729f-c692-493c-bbe0-f2a12985fd57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:19.250618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73729f-c692-493c-bbe0-f2a12985fd57 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:19.255478 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e919a-30d6-4fa3-b42a-f1988e2cfb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:19.256366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e919a-30d6-4fa3-b42a-f1988e2cfb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:19.256660 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e919a-30d6-4fa3-b42a-f1988e2cfb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:19.256935 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e919a-30d6-4fa3-b42a-f1988e2cfb0b admin admin] PATH_INFO: `/v3/users/d884d50fb5d4441195ca7c8187b2d673` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:19.258352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e919a-30d6-4fa3-b42a-f1988e2cfb0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d884d50fb5d4441195ca7c8187b2d673)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:19.261366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e919a-30d6-4fa3-b42a-f1988e2cfb0b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:19.524441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-da9e919a-30d6-4fa3-b42a-f1988e2cfb0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd884d50fb5d4441195ca7c8187b2d673'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:19.536368 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-da9e919a-30d6-4fa3-b42a-f1988e2cfb0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd884d50fb5d4441195ca7c8187b2d673'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:19.543977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-da9e919a-30d6-4fa3-b42a-f1988e2cfb0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd884d50fb5d4441195ca7c8187b2d673'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:19.544693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-da9e919a-30d6-4fa3-b42a-f1988e2cfb0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd884d50fb5d4441195ca7c8187b2d673'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:19.547240 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-da9e919a-30d6-4fa3-b42a-f1988e2cfb0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd884d50fb5d4441195ca7c8187b2d673'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:19.639614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1164/2295] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:37:19 2022] DELETE /identity/v3/users/d884d50fb5d4441195ca7c8187b2d673 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:37:19.644226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dccdd-5e5b-486c-b460-9de9ded3116f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:19.644759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dccdd-5e5b-486c-b460-9de9ded3116f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:19.644759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dccdd-5e5b-486c-b460-9de9ded3116f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:19.662734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-742dccdd-5e5b-486c-b460-9de9ded3116f None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:37:19.663957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-742dccdd-5e5b-486c-b460-9de9ded3116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:19.724848 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1132/2296] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:37:19.735756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e919a-30d6-4fa3-b42a-f1988e2cfb0b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:19.737183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-da9e919a-30d6-4fa3-b42a-f1988e2cfb0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:19.799382 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e919a-30d6-4fa3-b42a-f1988e2cfb0b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:19.802812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32974405-e6bc-4af1-bbb8-a96f37d1a33f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:19.803453 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32974405-e6bc-4af1-bbb8-a96f37d1a33f service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:19.803730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32974405-e6bc-4af1-bbb8-a96f37d1a33f service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:19.804004 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32974405-e6bc-4af1-bbb8-a96f37d1a33f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:19.813882 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32974405-e6bc-4af1-bbb8-a96f37d1a33f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:19.815327 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32974405-e6bc-4af1-bbb8-a96f37d1a33f service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:19.825552 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1165/2297] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:37:20.317733 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742dccdd-5e5b-486c-b460-9de9ded3116f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:20.319142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-742dccdd-5e5b-486c-b460-9de9ded3116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:20.331513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742dccdd-5e5b-486c-b460-9de9ded3116f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:20.336229 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e70085-f208-41ed-8807-e064edf8fc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:20.337138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e70085-f208-41ed-8807-e064edf8fc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:20.337396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e70085-f208-41ed-8807-e064edf8fc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:20.337678 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e70085-f208-41ed-8807-e064edf8fc92 admin admin] PATH_INFO: `/v3/projects/5a629523752d406c89b83cbad82a347a` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:20.339007 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e70085-f208-41ed-8807-e064edf8fc92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a629523752d406c89b83cbad82a347a)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:20.340935 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e70085-f208-41ed-8807-e064edf8fc92 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:20.442231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-61e70085-f208-41ed-8807-e064edf8fc92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a629523752d406c89b83cbad82a347a', 'request_id': 'req-61e70085-f208-41ed-8807-e064edf8fc92'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:20.448423 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-61e70085-f208-41ed-8807-e064edf8fc92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a629523752d406c89b83cbad82a347a', 'request_id': 'req-61e70085-f208-41ed-8807-e064edf8fc92'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:20.527794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-61e70085-f208-41ed-8807-e064edf8fc92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a629523752d406c89b83cbad82a347a', 'request_id': 'req-61e70085-f208-41ed-8807-e064edf8fc92'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:20.539227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-61e70085-f208-41ed-8807-e064edf8fc92 admin admin] The token cache is being invalidate because project 5a629523752d406c89b83cbad82a347a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:37:20.539518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-61e70085-f208-41ed-8807-e064edf8fc92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:20.540139 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-61e70085-f208-41ed-8807-e064edf8fc92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:20.542461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1133/2298] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:37:20 2022] DELETE /identity/v3/projects/5a629523752d406c89b83cbad82a347a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:37:20.546622 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32974405-e6bc-4af1-bbb8-a96f37d1a33f service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:20.556224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32974405-e6bc-4af1-bbb8-a96f37d1a33f service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:20.575502 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:20.616797 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd0aba-7f1a-4f46-83d0-185de2b8dcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:20.617635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd0aba-7f1a-4f46-83d0-185de2b8dcab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:20.617920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd0aba-7f1a-4f46-83d0-185de2b8dcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:20.618196 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd0aba-7f1a-4f46-83d0-185de2b8dcab admin admin] PATH_INFO: `/v3/users/c26f4efb172843628e5a46885e23546f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:20.619592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd0aba-7f1a-4f46-83d0-185de2b8dcab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c26f4efb172843628e5a46885e23546f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:20.621841 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd0aba-7f1a-4f46-83d0-185de2b8dcab admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:20.791635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-85fd0aba-7f1a-4f46-83d0-185de2b8dcab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c26f4efb172843628e5a46885e23546f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:20.803881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-85fd0aba-7f1a-4f46-83d0-185de2b8dcab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c26f4efb172843628e5a46885e23546f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:20.810873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-85fd0aba-7f1a-4f46-83d0-185de2b8dcab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c26f4efb172843628e5a46885e23546f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:20.811565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-85fd0aba-7f1a-4f46-83d0-185de2b8dcab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c26f4efb172843628e5a46885e23546f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:20.812173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-85fd0aba-7f1a-4f46-83d0-185de2b8dcab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c26f4efb172843628e5a46885e23546f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:20.881772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1166/2299] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:37:20 2022] DELETE /identity/v3/users/c26f4efb172843628e5a46885e23546f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:37:21.298344 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e70085-f208-41ed-8807-e064edf8fc92 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:21.299383 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-61e70085-f208-41ed-8807-e064edf8fc92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:21.328358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e70085-f208-41ed-8807-e064edf8fc92 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:21.373370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:21.405680 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19f677-f752-474d-a993-e26287153f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:21.406557 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19f677-f752-474d-a993-e26287153f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:21.406845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19f677-f752-474d-a993-e26287153f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:21.407121 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19f677-f752-474d-a993-e26287153f6d admin admin] PATH_INFO: `/v3/projects/ed3e4c0715f9445c89b8a005c2526444` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:21.408328 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19f677-f752-474d-a993-e26287153f6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3e4c0715f9445c89b8a005c2526444)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:21.410338 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19f677-f752-474d-a993-e26287153f6d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:21.562960 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3a19f677-f752-474d-a993-e26287153f6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3e4c0715f9445c89b8a005c2526444', 'request_id': 'req-3a19f677-f752-474d-a993-e26287153f6d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:21.568991 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3a19f677-f752-474d-a993-e26287153f6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3e4c0715f9445c89b8a005c2526444', 'request_id': 'req-3a19f677-f752-474d-a993-e26287153f6d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:21.642014 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3a19f677-f752-474d-a993-e26287153f6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3e4c0715f9445c89b8a005c2526444', 'request_id': 'req-3a19f677-f752-474d-a993-e26287153f6d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:21.653384 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3a19f677-f752-474d-a993-e26287153f6d admin admin] The token cache is being invalidate because project ed3e4c0715f9445c89b8a005c2526444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:37:21.653678 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3a19f677-f752-474d-a993-e26287153f6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:21.654319 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3a19f677-f752-474d-a993-e26287153f6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:21.655880 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1134/2300] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:37:21 2022] DELETE /identity/v3/projects/ed3e4c0715f9445c89b8a005c2526444 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:37:21.661980 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac19d00-e1dc-4ab7-a7df-9228b0468846 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:21.662454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac19d00-e1dc-4ab7-a7df-9228b0468846 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:21.662545 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac19d00-e1dc-4ab7-a7df-9228b0468846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:21.681941 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1ac19d00-e1dc-4ab7-a7df-9228b0468846 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:37:21.683172 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1ac19d00-e1dc-4ab7-a7df-9228b0468846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:21.745755 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1167/2301] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:37:21.754554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f731960-59e4-4c70-89d5-0693fb687154 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:21.754834 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f731960-59e4-4c70-89d5-0693fb687154 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:21.755109 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f731960-59e4-4c70-89d5-0693fb687154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:21.773439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4f731960-59e4-4c70-89d5-0693fb687154 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:37:21.774635 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4f731960-59e4-4c70-89d5-0693fb687154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:21.782487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1135/2302] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:37:21.786568 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac19d00-e1dc-4ab7-a7df-9228b0468846 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:21.797120 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac19d00-e1dc-4ab7-a7df-9228b0468846 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:21.801874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4510b-ac42-436f-9755-1715353a45a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:21.802533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4510b-ac42-436f-9755-1715353a45a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:21.802818 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4510b-ac42-436f-9755-1715353a45a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:21.803123 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4510b-ac42-436f-9755-1715353a45a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:21.803846 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4510b-ac42-436f-9755-1715353a45a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:37:21.804153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4510b-ac42-436f-9755-1715353a45a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:21.805786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4510b-ac42-436f-9755-1715353a45a8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:21.818255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1168/2303] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:37:21.822620 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f731960-59e4-4c70-89d5-0693fb687154 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:21.832694 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f731960-59e4-4c70-89d5-0693fb687154 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:21.837794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e9f10-002f-4c42-83ad-47b2961ceb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:21.838487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e9f10-002f-4c42-83ad-47b2961ceb23 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:21.838773 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e9f10-002f-4c42-83ad-47b2961ceb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:21.841439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e9f10-002f-4c42-83ad-47b2961ceb23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:21.841439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e9f10-002f-4c42-83ad-47b2961ceb23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:21.841793 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e9f10-002f-4c42-83ad-47b2961ceb23 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:21.964106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1136/2304] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:37:21 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:37:21.968227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4510b-ac42-436f-9755-1715353a45a8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:21.979072 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4510b-ac42-436f-9755-1715353a45a8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:22.005958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:22.044360 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6426db8-9106-40c4-b99d-40bab43c0e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:22.046266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6426db8-9106-40c4-b99d-40bab43c0e9d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:22.046266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6426db8-9106-40c4-b99d-40bab43c0e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:22.046266 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6426db8-9106-40c4-b99d-40bab43c0e9d admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:22.046558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6426db8-9106-40c4-b99d-40bab43c0e9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:22.048325 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6426db8-9106-40c4-b99d-40bab43c0e9d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:22.142890 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1169/2305] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:37:21 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:37:22.149023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e9f10-002f-4c42-83ad-47b2961ceb23 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:22.160445 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e9f10-002f-4c42-83ad-47b2961ceb23 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:22.165095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb235dd-4ccf-4dc1-8a1f-1621525b0550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:22.166508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb235dd-4ccf-4dc1-8a1f-1621525b0550 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:22.166789 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb235dd-4ccf-4dc1-8a1f-1621525b0550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:22.167171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb235dd-4ccf-4dc1-8a1f-1621525b0550 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:22.167891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb235dd-4ccf-4dc1-8a1f-1621525b0550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:22.169513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb235dd-4ccf-4dc1-8a1f-1621525b0550 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:22.188029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1137/2306] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:37:22.192219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6426db8-9106-40c4-b99d-40bab43c0e9d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:22.202485 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6426db8-9106-40c4-b99d-40bab43c0e9d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:22.207356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e901eb-a38d-421b-b710-d04907075d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:22.208335 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e901eb-a38d-421b-b710-d04907075d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:22.209032 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e901eb-a38d-421b-b710-d04907075d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:22.209410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e901eb-a38d-421b-b710-d04907075d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:22.210141 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e901eb-a38d-421b-b710-d04907075d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:22.211751 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e901eb-a38d-421b-b710-d04907075d81 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:22.222272 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1170/2307] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:37:22.226628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb235dd-4ccf-4dc1-8a1f-1621525b0550 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:22.237730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb235dd-4ccf-4dc1-8a1f-1621525b0550 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:22.242514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc702554-bcd6-47d5-8c3a-f86f1cd17518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:22.243508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc702554-bcd6-47d5-8c3a-f86f1cd17518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:22.243939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc702554-bcd6-47d5-8c3a-f86f1cd17518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:22.244273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc702554-bcd6-47d5-8c3a-f86f1cd17518 admin admin] PATH_INFO: `/v3/projects/d771883d851043b995792b804ded64d1/users/0ce3d90a5cfd4f0aa27451d7e64781e8/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:22.260026 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc702554-bcd6-47d5-8c3a-f86f1cd17518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d771883d851043b995792b804ded64d1, user_id=0ce3d90a5cfd4f0aa27451d7e64781e8, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:22.262768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc702554-bcd6-47d5-8c3a-f86f1cd17518 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:22.343726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1138/2308] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:37:22 2022] PUT /identity/v3/projects/d771883d851043b995792b804ded64d1/users/0ce3d90a5cfd4f0aa27451d7e64781e8/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:37:22.355843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c38d9-9b24-47f0-b350-fe44bcf47347 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:22.356139 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c38d9-9b24-47f0-b350-fe44bcf47347 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:22.356453 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c38d9-9b24-47f0-b350-fe44bcf47347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:22.395751 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a41c38d9-9b24-47f0-b350-fe44bcf47347 None None] MFA Rules not processed for user `0ce3d90a5cfd4f0aa27451d7e64781e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:37:22.398827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a41c38d9-9b24-47f0-b350-fe44bcf47347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:22.482827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1171/2309] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:37:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:37:22.494511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc702554-bcd6-47d5-8c3a-f86f1cd17518 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:22.496442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-bc702554-bcd6-47d5-8c3a-f86f1cd17518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:22.555515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:22.577592 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc702554-bcd6-47d5-8c3a-f86f1cd17518 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:22.581579 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be39a96-a70a-450e-aa83-e2d6a6e81782 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde4369f695745c199ce6c10d241b841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:22.582240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39a96-a70a-450e-aa83-e2d6a6e81782 service glance] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:22.582524 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39a96-a70a-450e-aa83-e2d6a6e81782 service glance] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:22.582805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39a96-a70a-450e-aa83-e2d6a6e81782 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:22.592006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be39a96-a70a-450e-aa83-e2d6a6e81782 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:22.593490 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be39a96-a70a-450e-aa83-e2d6a6e81782 service glance] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:22.602375 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1139/2310] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:37:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:37:28.440526 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c38d9-9b24-47f0-b350-fe44bcf47347 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:28.442530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a41c38d9-9b24-47f0-b350-fe44bcf47347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:28.509996 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c38d9-9b24-47f0-b350-fe44bcf47347 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:28.514749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96597c63-a7eb-489e-b581-3aae2843e6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:28.515637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96597c63-a7eb-489e-b581-3aae2843e6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:28.516054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96597c63-a7eb-489e-b581-3aae2843e6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:28.516422 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96597c63-a7eb-489e-b581-3aae2843e6fa admin admin] PATH_INFO: `/v3/users/b3efa30eb90749d789feab8de6a548d2` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:28.517609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96597c63-a7eb-489e-b581-3aae2843e6fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3efa30eb90749d789feab8de6a548d2)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:28.519562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96597c63-a7eb-489e-b581-3aae2843e6fa admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:28.817502 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:28.823829 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-96597c63-a7eb-489e-b581-3aae2843e6fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3efa30eb90749d789feab8de6a548d2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:28.837904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-96597c63-a7eb-489e-b581-3aae2843e6fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3efa30eb90749d789feab8de6a548d2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:28.845255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-96597c63-a7eb-489e-b581-3aae2843e6fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3efa30eb90749d789feab8de6a548d2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:28.846240 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-96597c63-a7eb-489e-b581-3aae2843e6fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3efa30eb90749d789feab8de6a548d2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:28.846944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-96597c63-a7eb-489e-b581-3aae2843e6fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3efa30eb90749d789feab8de6a548d2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:29.005524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1172/2311] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:37:28 2022] DELETE /identity/v3/users/b3efa30eb90749d789feab8de6a548d2 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:37:29.008907 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caf9d1-feda-44a7-953b-3baf560b6c30 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:29.009405 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caf9d1-feda-44a7-953b-3baf560b6c30 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:29.009500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caf9d1-feda-44a7-953b-3baf560b6c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:29.033191 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-60caf9d1-feda-44a7-953b-3baf560b6c30 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:37:29.034563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-60caf9d1-feda-44a7-953b-3baf560b6c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:29.101531 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1140/2312] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:37:29.112861 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96597c63-a7eb-489e-b581-3aae2843e6fa admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:29.114303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-96597c63-a7eb-489e-b581-3aae2843e6fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:29.174625 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96597c63-a7eb-489e-b581-3aae2843e6fa admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:29.178151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a1245-bd17-42ed-884c-3d29b8347e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:29.178793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a1245-bd17-42ed-884c-3d29b8347e69 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:29.179074 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a1245-bd17-42ed-884c-3d29b8347e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:29.179347 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a1245-bd17-42ed-884c-3d29b8347e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:29.188391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a1245-bd17-42ed-884c-3d29b8347e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:29.190590 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a1245-bd17-42ed-884c-3d29b8347e69 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:29.202114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1173/2313] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:37:29.694427 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caf9d1-feda-44a7-953b-3baf560b6c30 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:29.695953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-60caf9d1-feda-44a7-953b-3baf560b6c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:29.710123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caf9d1-feda-44a7-953b-3baf560b6c30 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:29.714961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03093453-ba63-4550-a478-a4dfc2b43dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:29.715995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03093453-ba63-4550-a478-a4dfc2b43dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:29.716277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03093453-ba63-4550-a478-a4dfc2b43dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:29.716556 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03093453-ba63-4550-a478-a4dfc2b43dd2 admin admin] PATH_INFO: `/v3/projects/a111e2b2b89a408c8dc1857f3e2eeed5` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:29.725067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03093453-ba63-4550-a478-a4dfc2b43dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a111e2b2b89a408c8dc1857f3e2eeed5)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:29.727158 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03093453-ba63-4550-a478-a4dfc2b43dd2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:29.847654 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-03093453-ba63-4550-a478-a4dfc2b43dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a111e2b2b89a408c8dc1857f3e2eeed5', 'request_id': 'req-03093453-ba63-4550-a478-a4dfc2b43dd2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:29.853765 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-03093453-ba63-4550-a478-a4dfc2b43dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a111e2b2b89a408c8dc1857f3e2eeed5', 'request_id': 'req-03093453-ba63-4550-a478-a4dfc2b43dd2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:29.933025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-03093453-ba63-4550-a478-a4dfc2b43dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a111e2b2b89a408c8dc1857f3e2eeed5', 'request_id': 'req-03093453-ba63-4550-a478-a4dfc2b43dd2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:29.944921 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-03093453-ba63-4550-a478-a4dfc2b43dd2 admin admin] The token cache is being invalidate because project a111e2b2b89a408c8dc1857f3e2eeed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:37:29.945211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-03093453-ba63-4550-a478-a4dfc2b43dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:29.945913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-03093453-ba63-4550-a478-a4dfc2b43dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:29.947481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1141/2314] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:37:29 2022] DELETE /identity/v3/projects/a111e2b2b89a408c8dc1857f3e2eeed5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:37:35.133867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c6f7b-d889-4fc3-9f76-ad25a30cb6a9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:35.134461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c6f7b-d889-4fc3-9f76-ad25a30cb6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:35.134569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c6f7b-d889-4fc3-9f76-ad25a30cb6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:35.153949 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-364c6f7b-d889-4fc3-9f76-ad25a30cb6a9 None None] MFA Rules not processed for user `781e29f49f27417a96cfc4ba00af95dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:37:35.155182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-364c6f7b-d889-4fc3-9f76-ad25a30cb6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:35.214186 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1174/2315] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:37:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:37:39.941849 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=64,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:45.207065 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=5,keystone:SELECT=65,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:53.192098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03093453-ba63-4550-a478-a4dfc2b43dd2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:53.193587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-03093453-ba63-4550-a478-a4dfc2b43dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:53.258747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03093453-ba63-4550-a478-a4dfc2b43dd2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:53.263427 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0364f-1a52-4245-8d1d-693ac4212d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:53.265154 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0364f-1a52-4245-8d1d-693ac4212d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:53.265468 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0364f-1a52-4245-8d1d-693ac4212d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:53.265748 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0364f-1a52-4245-8d1d-693ac4212d1c admin admin] PATH_INFO: `/v3/users/5857c02b3422415fb7627da8c1a50be6` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:53.266977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0364f-1a52-4245-8d1d-693ac4212d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5857c02b3422415fb7627da8c1a50be6)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:53.268966 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0364f-1a52-4245-8d1d-693ac4212d1c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:53.453873 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-15d0364f-1a52-4245-8d1d-693ac4212d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5857c02b3422415fb7627da8c1a50be6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:53.466079 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-15d0364f-1a52-4245-8d1d-693ac4212d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5857c02b3422415fb7627da8c1a50be6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:53.467330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-15d0364f-1a52-4245-8d1d-693ac4212d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5857c02b3422415fb7627da8c1a50be6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:53.467951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-15d0364f-1a52-4245-8d1d-693ac4212d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5857c02b3422415fb7627da8c1a50be6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:53.474884 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-15d0364f-1a52-4245-8d1d-693ac4212d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5857c02b3422415fb7627da8c1a50be6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:53.567685 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1142/2316] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:37:53 2022] DELETE /identity/v3/users/5857c02b3422415fb7627da8c1a50be6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:37:53.572333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b704f-2cc0-4866-8a1e-0381c3dc0432 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:53.572847 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b704f-2cc0-4866-8a1e-0381c3dc0432 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:53.572957 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b704f-2cc0-4866-8a1e-0381c3dc0432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:53.591523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0b9b704f-2cc0-4866-8a1e-0381c3dc0432 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:37:53.593522 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0b9b704f-2cc0-4866-8a1e-0381c3dc0432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:53.657783 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1175/2317] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:37:53.667370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0364f-1a52-4245-8d1d-693ac4212d1c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:53.668935 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-15d0364f-1a52-4245-8d1d-693ac4212d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:53.727380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0364f-1a52-4245-8d1d-693ac4212d1c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:53.731005 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1af51-e6b6-4543-9ed0-b985f5dada1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:53.731650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1af51-e6b6-4543-9ed0-b985f5dada1a service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:53.731933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1af51-e6b6-4543-9ed0-b985f5dada1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:53.732208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1af51-e6b6-4543-9ed0-b985f5dada1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:53.742326 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1af51-e6b6-4543-9ed0-b985f5dada1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:53.744018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1af51-e6b6-4543-9ed0-b985f5dada1a service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:53.754175 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1143/2318] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:37:54.251270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b704f-2cc0-4866-8a1e-0381c3dc0432 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:54.252800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0b9b704f-2cc0-4866-8a1e-0381c3dc0432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:54.265928 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b704f-2cc0-4866-8a1e-0381c3dc0432 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:54.271126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79693aa4-af93-41fd-b35e-77b6d82cf8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:54.272004 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79693aa4-af93-41fd-b35e-77b6d82cf8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:54.272282 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79693aa4-af93-41fd-b35e-77b6d82cf8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:54.272563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79693aa4-af93-41fd-b35e-77b6d82cf8cd admin admin] PATH_INFO: `/v3/projects/74b4c8d1a9d046c3b3639ddec5d8459d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:54.273835 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79693aa4-af93-41fd-b35e-77b6d82cf8cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b4c8d1a9d046c3b3639ddec5d8459d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:54.275820 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79693aa4-af93-41fd-b35e-77b6d82cf8cd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:54.375359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-79693aa4-af93-41fd-b35e-77b6d82cf8cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b4c8d1a9d046c3b3639ddec5d8459d', 'request_id': 'req-79693aa4-af93-41fd-b35e-77b6d82cf8cd'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:54.460720 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-79693aa4-af93-41fd-b35e-77b6d82cf8cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b4c8d1a9d046c3b3639ddec5d8459d', 'request_id': 'req-79693aa4-af93-41fd-b35e-77b6d82cf8cd'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:54.467868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-79693aa4-af93-41fd-b35e-77b6d82cf8cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b4c8d1a9d046c3b3639ddec5d8459d', 'request_id': 'req-79693aa4-af93-41fd-b35e-77b6d82cf8cd'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:54.479023 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-79693aa4-af93-41fd-b35e-77b6d82cf8cd admin admin] The token cache is being invalidate because project 74b4c8d1a9d046c3b3639ddec5d8459d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:37:54.479311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-79693aa4-af93-41fd-b35e-77b6d82cf8cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:54.479935 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-79693aa4-af93-41fd-b35e-77b6d82cf8cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:37:54.481636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1176/2319] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:37:54 2022] DELETE /identity/v3/projects/74b4c8d1a9d046c3b3639ddec5d8459d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:37:54.488122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b81c1-4bfb-4839-b7c5-676f1ce8a0c8 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:54.488590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b81c1-4bfb-4839-b7c5-676f1ce8a0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:54.488696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b81c1-4bfb-4839-b7c5-676f1ce8a0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:54.508849 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b02b81c1-4bfb-4839-b7c5-676f1ce8a0c8 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:37:54.510135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b02b81c1-4bfb-4839-b7c5-676f1ce8a0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:54.528859 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:54.575275 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1144/2320] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:37:54.583632 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c87ce-438e-4d58-aaef-7368914a89db None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:54.584112 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c87ce-438e-4d58-aaef-7368914a89db None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:54.584228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c87ce-438e-4d58-aaef-7368914a89db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:54.605756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0c0c87ce-438e-4d58-aaef-7368914a89db None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:37:54.606523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0c0c87ce-438e-4d58-aaef-7368914a89db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:54.615887 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1177/2321] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:37:54.621170 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b81c1-4bfb-4839-b7c5-676f1ce8a0c8 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:54.631240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b81c1-4bfb-4839-b7c5-676f1ce8a0c8 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:54.636006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f81580-499e-4b48-954d-6a86f22b2754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:54.636673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f81580-499e-4b48-954d-6a86f22b2754 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:54.636961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f81580-499e-4b48-954d-6a86f22b2754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:54.637238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f81580-499e-4b48-954d-6a86f22b2754 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:54.638126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f81580-499e-4b48-954d-6a86f22b2754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:37:54.638442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f81580-499e-4b48-954d-6a86f22b2754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:54.640087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f81580-499e-4b48-954d-6a86f22b2754 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:54.652645 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1145/2322] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:37:54.659593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c87ce-438e-4d58-aaef-7368914a89db None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:54.668940 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c87ce-438e-4d58-aaef-7368914a89db None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:54.673970 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e046d-40a2-4a11-ad69-10028f58ec6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:54.674635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e046d-40a2-4a11-ad69-10028f58ec6d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:54.674921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e046d-40a2-4a11-ad69-10028f58ec6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:54.675199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e046d-40a2-4a11-ad69-10028f58ec6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:54.675905 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e046d-40a2-4a11-ad69-10028f58ec6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:54.677880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e046d-40a2-4a11-ad69-10028f58ec6d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:54.802763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1178/2323] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:37:54 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:37:54.807064 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f81580-499e-4b48-954d-6a86f22b2754 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:54.817228 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f81580-499e-4b48-954d-6a86f22b2754 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:54.874317 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68a434-cd99-425c-964b-789e9e1cb186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:54.875007 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a434-cd99-425c-964b-789e9e1cb186 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:54.875287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a434-cd99-425c-964b-789e9e1cb186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:54.876064 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a434-cd99-425c-964b-789e9e1cb186 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:54.876754 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68a434-cd99-425c-964b-789e9e1cb186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:54.878717 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68a434-cd99-425c-964b-789e9e1cb186 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:54.975875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1146/2324] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:37:54 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:37:54.977767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e046d-40a2-4a11-ad69-10028f58ec6d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:54.987926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e046d-40a2-4a11-ad69-10028f58ec6d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:54.992499 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e57ca-418d-46fb-b9a1-01332e9912a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:54.993162 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e57ca-418d-46fb-b9a1-01332e9912a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:54.993485 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e57ca-418d-46fb-b9a1-01332e9912a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:54.994048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e57ca-418d-46fb-b9a1-01332e9912a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:54.994742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e57ca-418d-46fb-b9a1-01332e9912a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:54.996328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e57ca-418d-46fb-b9a1-01332e9912a8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:55.007690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1179/2325] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:37:55.012400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68a434-cd99-425c-964b-789e9e1cb186 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:55.023630 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68a434-cd99-425c-964b-789e9e1cb186 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:55.028532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9685f8-bb25-4760-93da-12a303d57210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:55.029188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9685f8-bb25-4760-93da-12a303d57210 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:55.029504 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9685f8-bb25-4760-93da-12a303d57210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:55.029785 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9685f8-bb25-4760-93da-12a303d57210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:55.030559 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9685f8-bb25-4760-93da-12a303d57210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:55.032613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9685f8-bb25-4760-93da-12a303d57210 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:55.043724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1147/2326] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:37:55.047641 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e57ca-418d-46fb-b9a1-01332e9912a8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:55.059736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e57ca-418d-46fb-b9a1-01332e9912a8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:55.066036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c031e2-200c-40eb-9048-129a7bc3bb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:55.067582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c031e2-200c-40eb-9048-129a7bc3bb65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:55.068147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c031e2-200c-40eb-9048-129a7bc3bb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:55.068542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c031e2-200c-40eb-9048-129a7bc3bb65 admin admin] PATH_INFO: `/v3/projects/5de5c6b438594f4eae8e7010ccf0ca65/users/5e9fc215b64a44c2b989e68c788c1534/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:55.085187 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c031e2-200c-40eb-9048-129a7bc3bb65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de5c6b438594f4eae8e7010ccf0ca65, user_id=5e9fc215b64a44c2b989e68c788c1534, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:55.087996 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c031e2-200c-40eb-9048-129a7bc3bb65 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:55.201345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1180/2327] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:37:55 2022] PUT /identity/v3/projects/5de5c6b438594f4eae8e7010ccf0ca65/users/5e9fc215b64a44c2b989e68c788c1534/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:37:55.207263 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49241852-8a48-4567-b828-fca611ceef48 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:55.207637 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49241852-8a48-4567-b828-fca611ceef48 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:55.207920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49241852-8a48-4567-b828-fca611ceef48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:55.226177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-49241852-8a48-4567-b828-fca611ceef48 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:37:55.227383 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-49241852-8a48-4567-b828-fca611ceef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:55.288108 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1148/2328] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:37:55.298928 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c031e2-200c-40eb-9048-129a7bc3bb65 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:55.300868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a6c031e2-200c-40eb-9048-129a7bc3bb65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:55.326491 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:55.360507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c031e2-200c-40eb-9048-129a7bc3bb65 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:55.365432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc00e8f-9037-4ad9-b519-893d6dc05478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:55.366072 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc00e8f-9037-4ad9-b519-893d6dc05478 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:55.366352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc00e8f-9037-4ad9-b519-893d6dc05478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:55.366625 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc00e8f-9037-4ad9-b519-893d6dc05478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:55.375849 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc00e8f-9037-4ad9-b519-893d6dc05478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:55.378001 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc00e8f-9037-4ad9-b519-893d6dc05478 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:55.387429 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1181/2329] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:37:58.908905 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49241852-8a48-4567-b828-fca611ceef48 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:37:58.910309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-49241852-8a48-4567-b828-fca611ceef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:58.942297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:59.008310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49241852-8a48-4567-b828-fca611ceef48 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:37:59.018828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601c067-426d-4e16-9a0f-c57524ddfaf4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adc8b93e5c41929b928002e004df6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:37:59.020089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601c067-426d-4e16-9a0f-c57524ddfaf4 service placement] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:37:59.020526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601c067-426d-4e16-9a0f-c57524ddfaf4 service placement] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:37:59.020801 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601c067-426d-4e16-9a0f-c57524ddfaf4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:37:59.023018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a601c067-426d-4e16-9a0f-c57524ddfaf4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:37:59.037963 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601c067-426d-4e16-9a0f-c57524ddfaf4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:37:59.039941 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601c067-426d-4e16-9a0f-c57524ddfaf4 service placement] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:37:59.054646 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1149/2330] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:37:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:38:01.956415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa13e5-a982-4532-97af-1c2becc0f77d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:01.956909 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa13e5-a982-4532-97af-1c2becc0f77d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:01.957006 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa13e5-a982-4532-97af-1c2becc0f77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:01.991741 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-fbaa13e5-a982-4532-97af-1c2becc0f77d None None] MFA Rules not processed for user `5e9fc215b64a44c2b989e68c788c1534`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:38:01.993035 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fbaa13e5-a982-4532-97af-1c2becc0f77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:38:02.118702 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1182/2331] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:38:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:38:02.123244 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601c067-426d-4e16-9a0f-c57524ddfaf4 service placement] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:02.135522 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601c067-426d-4e16-9a0f-c57524ddfaf4 service placement] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:02.146119 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378d669-51ab-455c-9fcb-40d0c704cb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:02.147107 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378d669-51ab-455c-9fcb-40d0c704cb3d admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:02.147487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378d669-51ab-455c-9fcb-40d0c704cb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:02.147859 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378d669-51ab-455c-9fcb-40d0c704cb3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:02.148675 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378d669-51ab-455c-9fcb-40d0c704cb3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:02.151488 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378d669-51ab-455c-9fcb-40d0c704cb3d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:02.266347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1150/2332] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:38:02 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:38:02.271028 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa13e5-a982-4532-97af-1c2becc0f77d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:02.283101 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa13e5-a982-4532-97af-1c2becc0f77d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:02.342932 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381f458-ef0c-4aed-afdb-c86d59ce42ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:02.343655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381f458-ef0c-4aed-afdb-c86d59ce42ca admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:02.344219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381f458-ef0c-4aed-afdb-c86d59ce42ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:02.344219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381f458-ef0c-4aed-afdb-c86d59ce42ca admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:02.345646 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381f458-ef0c-4aed-afdb-c86d59ce42ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:02.347567 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381f458-ef0c-4aed-afdb-c86d59ce42ca admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:02.425562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1183/2333] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:38:02 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:38:02.435103 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378d669-51ab-455c-9fcb-40d0c704cb3d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:02.441797 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378d669-51ab-455c-9fcb-40d0c704cb3d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:02.450124 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574ca9c-4acf-4368-b97b-40c7cf5e6b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:02.450835 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574ca9c-4acf-4368-b97b-40c7cf5e6b82 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:02.451118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574ca9c-4acf-4368-b97b-40c7cf5e6b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:02.451415 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574ca9c-4acf-4368-b97b-40c7cf5e6b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:02.452194 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574ca9c-4acf-4368-b97b-40c7cf5e6b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:02.456274 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574ca9c-4acf-4368-b97b-40c7cf5e6b82 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:02.467788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1151/2334] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:38:02.473588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381f458-ef0c-4aed-afdb-c86d59ce42ca admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:02.483842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381f458-ef0c-4aed-afdb-c86d59ce42ca admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:02.489281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad994ae-32f2-44e5-9838-f8e306c7d942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:02.490230 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad994ae-32f2-44e5-9838-f8e306c7d942 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:02.492211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad994ae-32f2-44e5-9838-f8e306c7d942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:02.492211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad994ae-32f2-44e5-9838-f8e306c7d942 admin admin] PATH_INFO: `/v3/projects/91447dc0150c49ee9f9a187a940d8641/users/7f089a8d045a4a82acdda7a622a65e2c/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:02.508935 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad994ae-32f2-44e5-9838-f8e306c7d942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91447dc0150c49ee9f9a187a940d8641, user_id=7f089a8d045a4a82acdda7a622a65e2c, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:02.511871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad994ae-32f2-44e5-9838-f8e306c7d942 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:02.652128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1184/2335] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:38:02 2022] PUT /identity/v3/projects/91447dc0150c49ee9f9a187a940d8641/users/7f089a8d045a4a82acdda7a622a65e2c/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:38:02.656092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574ca9c-4acf-4368-b97b-40c7cf5e6b82 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:02.667072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574ca9c-4acf-4368-b97b-40c7cf5e6b82 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:02.753740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb0f6f-f017-446f-891f-25405a22ad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:02.754869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb0f6f-f017-446f-891f-25405a22ad7d admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:02.755287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb0f6f-f017-446f-891f-25405a22ad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:02.755631 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb0f6f-f017-446f-891f-25405a22ad7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:02.756484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb0f6f-f017-446f-891f-25405a22ad7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:02.758447 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb0f6f-f017-446f-891f-25405a22ad7d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:02.774219 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1152/2336] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:38:02.778357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad994ae-32f2-44e5-9838-f8e306c7d942 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:02.793444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad994ae-32f2-44e5-9838-f8e306c7d942 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:02.801182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06aeeef-fe76-4b7a-8f98-d052d760d1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:02.802118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aeeef-fe76-4b7a-8f98-d052d760d1e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:02.802401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aeeef-fe76-4b7a-8f98-d052d760d1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:02.802769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aeeef-fe76-4b7a-8f98-d052d760d1e3 admin admin] PATH_INFO: `/v3/projects/91447dc0150c49ee9f9a187a940d8641/users/7f089a8d045a4a82acdda7a622a65e2c/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:02.805278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06aeeef-fe76-4b7a-8f98-d052d760d1e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91447dc0150c49ee9f9a187a940d8641, user_id=7f089a8d045a4a82acdda7a622a65e2c, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:02.812131 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06aeeef-fe76-4b7a-8f98-d052d760d1e3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:02.824513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1185/2337] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:38:02 2022] PUT /identity/v3/projects/91447dc0150c49ee9f9a187a940d8641/users/7f089a8d045a4a82acdda7a622a65e2c/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:38:10.365883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a474a-ddf6-4ad4-a0bf-fc01603b0b0d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:10.366448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a474a-ddf6-4ad4-a0bf-fc01603b0b0d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:10.366448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a474a-ddf6-4ad4-a0bf-fc01603b0b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:10.403079 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-084a474a-ddf6-4ad4-a0bf-fc01603b0b0d None None] MFA Rules not processed for user `7f089a8d045a4a82acdda7a622a65e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:38:10.403079 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-084a474a-ddf6-4ad4-a0bf-fc01603b0b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:38:10.466026 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:10.494081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1153/2338] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:38:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:38:10.517999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06aeeef-fe76-4b7a-8f98-d052d760d1e3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:10.521817 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f06aeeef-fe76-4b7a-8f98-d052d760d1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:38:10.532811 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:10.658182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06aeeef-fe76-4b7a-8f98-d052d760d1e3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:10.664559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f21ce-fa89-47c9-b851-ce0ad3b5b4bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:10.664843 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f21ce-fa89-47c9-b851-ce0ad3b5b4bd service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:10.665200 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f21ce-fa89-47c9-b851-ce0ad3b5b4bd service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:10.665563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f21ce-fa89-47c9-b851-ce0ad3b5b4bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:10.741697 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f21ce-fa89-47c9-b851-ce0ad3b5b4bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:10.744114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f21ce-fa89-47c9-b851-ce0ad3b5b4bd service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:10.753880 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1186/2339] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:38:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:38:11.895737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a474a-ddf6-4ad4-a0bf-fc01603b0b0d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:11.895737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-084a474a-ddf6-4ad4-a0bf-fc01603b0b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:38:11.975539 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a474a-ddf6-4ad4-a0bf-fc01603b0b0d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:11.980217 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eaf4f0-5897-4435-9138-993f45a05bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:11.981183 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaf4f0-5897-4435-9138-993f45a05bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:11.981565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaf4f0-5897-4435-9138-993f45a05bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:11.981969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaf4f0-5897-4435-9138-993f45a05bc6 admin admin] PATH_INFO: `/v3/users/0ce3d90a5cfd4f0aa27451d7e64781e8` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:11.983350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eaf4f0-5897-4435-9138-993f45a05bc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ce3d90a5cfd4f0aa27451d7e64781e8)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:11.985936 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eaf4f0-5897-4435-9138-993f45a05bc6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:12.195857 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-88eaf4f0-5897-4435-9138-993f45a05bc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ce3d90a5cfd4f0aa27451d7e64781e8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:38:12.212277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-88eaf4f0-5897-4435-9138-993f45a05bc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ce3d90a5cfd4f0aa27451d7e64781e8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:38:12.213345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-88eaf4f0-5897-4435-9138-993f45a05bc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ce3d90a5cfd4f0aa27451d7e64781e8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:38:12.214066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-88eaf4f0-5897-4435-9138-993f45a05bc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ce3d90a5cfd4f0aa27451d7e64781e8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:38:12.226525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-88eaf4f0-5897-4435-9138-993f45a05bc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ce3d90a5cfd4f0aa27451d7e64781e8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:38:12.346478 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1154/2340] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:38:11 2022] DELETE /identity/v3/users/0ce3d90a5cfd4f0aa27451d7e64781e8 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:38:12.347754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eb187-1e00-42e4-83b1-a785184b5270 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:12.348210 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eb187-1e00-42e4-83b1-a785184b5270 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:12.348507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eb187-1e00-42e4-83b1-a785184b5270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:12.370997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-321eb187-1e00-42e4-83b1-a785184b5270 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:38:12.372287 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-321eb187-1e00-42e4-83b1-a785184b5270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:38:12.462877 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1187/2341] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:38:12.472618 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eaf4f0-5897-4435-9138-993f45a05bc6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:12.474355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-88eaf4f0-5897-4435-9138-993f45a05bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:38:12.565634 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eaf4f0-5897-4435-9138-993f45a05bc6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:12.570910 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cefe56-0e3c-404e-9e79-43246d041604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:12.571442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cefe56-0e3c-404e-9e79-43246d041604 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:12.571832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cefe56-0e3c-404e-9e79-43246d041604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:12.572189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cefe56-0e3c-404e-9e79-43246d041604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:12.589997 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cefe56-0e3c-404e-9e79-43246d041604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:12.591710 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cefe56-0e3c-404e-9e79-43246d041604 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:12.603654 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1155/2342] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:38:13.071121 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321eb187-1e00-42e4-83b1-a785184b5270 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:13.075023 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-321eb187-1e00-42e4-83b1-a785184b5270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:38:13.092769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321eb187-1e00-42e4-83b1-a785184b5270 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:13.099214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286cb6f-8ea0-47d8-9a19-318ec2c77baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:13.100408 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286cb6f-8ea0-47d8-9a19-318ec2c77baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:13.100692 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286cb6f-8ea0-47d8-9a19-318ec2c77baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:13.100966 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286cb6f-8ea0-47d8-9a19-318ec2c77baf admin admin] PATH_INFO: `/v3/projects/d771883d851043b995792b804ded64d1` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:13.102537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286cb6f-8ea0-47d8-9a19-318ec2c77baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d771883d851043b995792b804ded64d1)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:13.104504 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286cb6f-8ea0-47d8-9a19-318ec2c77baf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:13.117432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:13.252466 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6286cb6f-8ea0-47d8-9a19-318ec2c77baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd771883d851043b995792b804ded64d1', 'request_id': 'req-6286cb6f-8ea0-47d8-9a19-318ec2c77baf'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:38:13.396434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6286cb6f-8ea0-47d8-9a19-318ec2c77baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd771883d851043b995792b804ded64d1', 'request_id': 'req-6286cb6f-8ea0-47d8-9a19-318ec2c77baf'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:38:13.402307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6286cb6f-8ea0-47d8-9a19-318ec2c77baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd771883d851043b995792b804ded64d1', 'request_id': 'req-6286cb6f-8ea0-47d8-9a19-318ec2c77baf'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:38:13.416362 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6286cb6f-8ea0-47d8-9a19-318ec2c77baf admin admin] The token cache is being invalidate because project d771883d851043b995792b804ded64d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:38:13.416932 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6286cb6f-8ea0-47d8-9a19-318ec2c77baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:38:13.417677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6286cb6f-8ea0-47d8-9a19-318ec2c77baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:38:13.421139 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1188/2343] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:38:13 2022] DELETE /identity/v3/projects/d771883d851043b995792b804ded64d1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:38:13.425807 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dc348-8630-492c-8807-42096a8a45b3 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:13.426302 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dc348-8630-492c-8807-42096a8a45b3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:13.426403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dc348-8630-492c-8807-42096a8a45b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:13.444155 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-223dc348-8630-492c-8807-42096a8a45b3 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:38:13.445381 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-223dc348-8630-492c-8807-42096a8a45b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:38:13.449912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:13.513862 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1156/2344] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:38:13.521719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daae12-bea3-46a1-a35b-7056d6c833af None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:13.522242 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daae12-bea3-46a1-a35b-7056d6c833af None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:13.522707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daae12-bea3-46a1-a35b-7056d6c833af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:13.547206 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-16daae12-bea3-46a1-a35b-7056d6c833af None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:38:13.549984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-16daae12-bea3-46a1-a35b-7056d6c833af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:38:13.571253 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1189/2345] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:38:13.575097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223dc348-8630-492c-8807-42096a8a45b3 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:13.588737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223dc348-8630-492c-8807-42096a8a45b3 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:13.601478 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985765f2-a3b0-4ae6-888b-f54bbab95848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:13.602968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985765f2-a3b0-4ae6-888b-f54bbab95848 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:13.602968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985765f2-a3b0-4ae6-888b-f54bbab95848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:13.602968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985765f2-a3b0-4ae6-888b-f54bbab95848 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:13.604909 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985765f2-a3b0-4ae6-888b-f54bbab95848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:38:13.605226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985765f2-a3b0-4ae6-888b-f54bbab95848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:13.610565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985765f2-a3b0-4ae6-888b-f54bbab95848 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:13.627622 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1157/2346] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:38:13.631623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16daae12-bea3-46a1-a35b-7056d6c833af None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:13.642451 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16daae12-bea3-46a1-a35b-7056d6c833af None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:13.649044 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b114b70-1770-4498-bb2f-03954d652030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:13.649881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b114b70-1770-4498-bb2f-03954d652030 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:13.650163 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b114b70-1770-4498-bb2f-03954d652030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:13.650433 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b114b70-1770-4498-bb2f-03954d652030 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:13.651349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b114b70-1770-4498-bb2f-03954d652030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:13.653536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b114b70-1770-4498-bb2f-03954d652030 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:13.804153 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1190/2347] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:38:13 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:38:13.805392 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985765f2-a3b0-4ae6-888b-f54bbab95848 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:13.816607 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985765f2-a3b0-4ae6-888b-f54bbab95848 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:13.878227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f2ecf-d9a6-402d-b444-1e7a85497e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:13.879027 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f2ecf-d9a6-402d-b444-1e7a85497e3a admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:13.879545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f2ecf-d9a6-402d-b444-1e7a85497e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:13.879988 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f2ecf-d9a6-402d-b444-1e7a85497e3a admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:13.880821 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f2ecf-d9a6-402d-b444-1e7a85497e3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:13.882936 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f2ecf-d9a6-402d-b444-1e7a85497e3a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:14.035905 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1158/2348] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:38:13 2022] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:38:14.039663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b114b70-1770-4498-bb2f-03954d652030 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:14.051630 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b114b70-1770-4498-bb2f-03954d652030 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:14.056273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c76b40-8947-4d6f-8517-526026ce1bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:14.056935 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76b40-8947-4d6f-8517-526026ce1bda admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:14.057215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76b40-8947-4d6f-8517-526026ce1bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:14.058613 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76b40-8947-4d6f-8517-526026ce1bda admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:14.058613 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c76b40-8947-4d6f-8517-526026ce1bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:14.060961 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c76b40-8947-4d6f-8517-526026ce1bda admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:14.075107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1191/2349] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:38:14.079956 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f2ecf-d9a6-402d-b444-1e7a85497e3a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:14.095658 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f2ecf-d9a6-402d-b444-1e7a85497e3a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:14.100944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17321f4e-3736-49e6-becf-a40364e0a013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:14.101792 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17321f4e-3736-49e6-becf-a40364e0a013 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:14.102259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17321f4e-3736-49e6-becf-a40364e0a013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:14.102737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17321f4e-3736-49e6-becf-a40364e0a013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:14.103619 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17321f4e-3736-49e6-becf-a40364e0a013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:14.105520 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17321f4e-3736-49e6-becf-a40364e0a013 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:14.124340 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1159/2350] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:38:14.125259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c76b40-8947-4d6f-8517-526026ce1bda admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:14.139590 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c76b40-8947-4d6f-8517-526026ce1bda admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:14.154027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1f448-70af-4791-bdee-54196c2f8a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:14.154027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1f448-70af-4791-bdee-54196c2f8a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:14.154027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1f448-70af-4791-bdee-54196c2f8a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:14.157757 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1f448-70af-4791-bdee-54196c2f8a31 admin admin] PATH_INFO: `/v3/projects/c549a90791fc40f1922a2d657f85a1da/users/7a9e3a1a46e745bebbcf021ded8ab97f/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:14.174972 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1f448-70af-4791-bdee-54196c2f8a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c549a90791fc40f1922a2d657f85a1da, user_id=7a9e3a1a46e745bebbcf021ded8ab97f, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:14.177971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1f448-70af-4791-bdee-54196c2f8a31 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:14.298467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1192/2351] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:38:14 2022] PUT /identity/v3/projects/c549a90791fc40f1922a2d657f85a1da/users/7a9e3a1a46e745bebbcf021ded8ab97f/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:38:14.310357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aea65-5dbc-46dc-a5da-40264eb37a4f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:14.310642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aea65-5dbc-46dc-a5da-40264eb37a4f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:14.310920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aea65-5dbc-46dc-a5da-40264eb37a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:14.342717 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b43aea65-5dbc-46dc-a5da-40264eb37a4f None None] MFA Rules not processed for user `7a9e3a1a46e745bebbcf021ded8ab97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:38:14.344027 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b43aea65-5dbc-46dc-a5da-40264eb37a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:38:14.440810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1160/2352] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:38:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:38:14.460451 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1f448-70af-4791-bdee-54196c2f8a31 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:14.462376 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-10c1f448-70af-4791-bdee-54196c2f8a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:38:14.485456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e21a53-dff7-47ed-8d0b-a22421144b37 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:14.486072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e21a53-dff7-47ed-8d0b-a22421144b37 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:14.486355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e21a53-dff7-47ed-8d0b-a22421144b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:14.495226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:14.510238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b9e21a53-dff7-47ed-8d0b-a22421144b37 None None] MFA Rules not processed for user `5e9fc215b64a44c2b989e68c788c1534`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:38:14.511650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b9e21a53-dff7-47ed-8d0b-a22421144b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:38:14.563716 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1f448-70af-4791-bdee-54196c2f8a31 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:14.568240 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef41e6-7753-4b6b-98fd-8558831361b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:14.568898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef41e6-7753-4b6b-98fd-8558831361b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:14.569455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef41e6-7753-4b6b-98fd-8558831361b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:14.569918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef41e6-7753-4b6b-98fd-8558831361b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:14.575694 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1161/2353] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:38:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:38:14.585499 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef41e6-7753-4b6b-98fd-8558831361b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:14.587202 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef41e6-7753-4b6b-98fd-8558831361b2 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:14.603319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1193/2354] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:38:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:38:24.594569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:24.798993 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=23 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:29.676682 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff8fa7-cd31-4333-927c-333be8e9baf1 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:29.677306 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff8fa7-cd31-4333-927c-333be8e9baf1 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:29.677306 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff8fa7-cd31-4333-927c-333be8e9baf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:29.696072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-88ff8fa7-cd31-4333-927c-333be8e9baf1 None None] MFA Rules not processed for user `d4eeb8684c1e4c8da065e92fc5f04c01`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:38:29.697904 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-88ff8fa7-cd31-4333-927c-333be8e9baf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:38:29.765797 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1162/2355] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:38:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:38:30.599377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef41e6-7753-4b6b-98fd-8558831361b2 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:38:30.600997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a1ef41e6-7753-4b6b-98fd-8558831361b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:38:30.675180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef41e6-7753-4b6b-98fd-8558831361b2 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:38:30.686324 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d427c80-8357-4c67-8770-1d3e39672462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:38:30.686937 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d427c80-8357-4c67-8770-1d3e39672462 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:38:30.687272 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d427c80-8357-4c67-8770-1d3e39672462 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:38:30.687500 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d427c80-8357-4c67-8770-1d3e39672462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:38:30.689375 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8d427c80-8357-4c67-8770-1d3e39672462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:38:30.765984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d427c80-8357-4c67-8770-1d3e39672462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:38:30.767508 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d427c80-8357-4c67-8770-1d3e39672462 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:38:30.783513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1194/2356] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:38:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:38:39.753652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=25 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:40.773062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=50 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:39:24.689285 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff8fa7-cd31-4333-927c-333be8e9baf1 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:39:24.699707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff8fa7-cd31-4333-927c-333be8e9baf1 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:39:24.705611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821a2cd-adf5-432f-af09-463b32ffab56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:39:24.707098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a2cd-adf5-432f-af09-463b32ffab56 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:39:24.707388 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a2cd-adf5-432f-af09-463b32ffab56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:39:24.708720 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a2cd-adf5-432f-af09-463b32ffab56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:39:24.711262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6821a2cd-adf5-432f-af09-463b32ffab56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:39:24.783764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a2cd-adf5-432f-af09-463b32ffab56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:39:24.786094 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a2cd-adf5-432f-af09-463b32ffab56 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:39:24.797344 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1163/2357] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:39:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:39:25.159757 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d427c80-8357-4c67-8770-1d3e39672462 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:39:25.169911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d427c80-8357-4c67-8770-1d3e39672462 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:39:25.173486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06952a2b-b39e-42a2-9a28-66ee8918caaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:39:25.174137 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06952a2b-b39e-42a2-9a28-66ee8918caaa service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:39:25.174420 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06952a2b-b39e-42a2-9a28-66ee8918caaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:39:25.175343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06952a2b-b39e-42a2-9a28-66ee8918caaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:39:25.177463 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-06952a2b-b39e-42a2-9a28-66ee8918caaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:39:25.191777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06952a2b-b39e-42a2-9a28-66ee8918caaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:39:25.193517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06952a2b-b39e-42a2-9a28-66ee8918caaa service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:39:25.205445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1195/2358] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:39:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:39:32.163018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821a2cd-adf5-432f-af09-463b32ffab56 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:39:32.164580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6821a2cd-adf5-432f-af09-463b32ffab56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:39:32.176084 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821a2cd-adf5-432f-af09-463b32ffab56 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:39:32.179786 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb90568-b122-456b-90fd-e01ca09f7424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:39:32.180458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb90568-b122-456b-90fd-e01ca09f7424 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:39:32.180764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb90568-b122-456b-90fd-e01ca09f7424 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:39:32.181023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb90568-b122-456b-90fd-e01ca09f7424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:39:32.186122 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6eb90568-b122-456b-90fd-e01ca09f7424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:39:32.261250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb90568-b122-456b-90fd-e01ca09f7424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:39:32.263444 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb90568-b122-456b-90fd-e01ca09f7424 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:39:32.274907 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1164/2359] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:39:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:39:35.199931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:39:36.461823 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06952a2b-b39e-42a2-9a28-66ee8918caaa service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:39:36.534048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06952a2b-b39e-42a2-9a28-66ee8918caaa service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:39:36.538687 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f504f79-3bee-4f1f-b61e-3de939864e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:39:36.539561 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f504f79-3bee-4f1f-b61e-3de939864e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:39:36.539844 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f504f79-3bee-4f1f-b61e-3de939864e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:39:36.540122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f504f79-3bee-4f1f-b61e-3de939864e68 admin admin] PATH_INFO: `/v3/users/7a9e3a1a46e745bebbcf021ded8ab97f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:39:36.541305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f504f79-3bee-4f1f-b61e-3de939864e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9e3a1a46e745bebbcf021ded8ab97f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:39:36.543274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f504f79-3bee-4f1f-b61e-3de939864e68 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:39:36.791035 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7f504f79-3bee-4f1f-b61e-3de939864e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9e3a1a46e745bebbcf021ded8ab97f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:39:36.804051 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7f504f79-3bee-4f1f-b61e-3de939864e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9e3a1a46e745bebbcf021ded8ab97f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:39:36.811257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7f504f79-3bee-4f1f-b61e-3de939864e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9e3a1a46e745bebbcf021ded8ab97f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:39:36.811979 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7f504f79-3bee-4f1f-b61e-3de939864e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9e3a1a46e745bebbcf021ded8ab97f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:39:36.812595 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7f504f79-3bee-4f1f-b61e-3de939864e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9e3a1a46e745bebbcf021ded8ab97f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:39:36.902534 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1196/2360] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:39:36 2022] DELETE /identity/v3/users/7a9e3a1a46e745bebbcf021ded8ab97f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:39:36.907149 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3e262-5fd1-411e-8e70-0cf8813c8fec None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:39:36.907658 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3e262-5fd1-411e-8e70-0cf8813c8fec None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:39:36.907768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3e262-5fd1-411e-8e70-0cf8813c8fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:39:36.926040 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e1f3e262-5fd1-411e-8e70-0cf8813c8fec None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:39:36.927227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e1f3e262-5fd1-411e-8e70-0cf8813c8fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:39:36.985662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1165/2361] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:39:36.996045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f504f79-3bee-4f1f-b61e-3de939864e68 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:39:36.997537 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7f504f79-3bee-4f1f-b61e-3de939864e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:39:37.055135 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f504f79-3bee-4f1f-b61e-3de939864e68 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:39:37.058711 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcf5b1-3641-4e2e-bb2d-01ce5b7bf332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:39:37.059357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcf5b1-3641-4e2e-bb2d-01ce5b7bf332 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:39:37.059642 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcf5b1-3641-4e2e-bb2d-01ce5b7bf332 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:39:37.059907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcf5b1-3641-4e2e-bb2d-01ce5b7bf332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:39:37.069640 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcf5b1-3641-4e2e-bb2d-01ce5b7bf332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:39:37.071067 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcf5b1-3641-4e2e-bb2d-01ce5b7bf332 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:39:37.080894 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1197/2362] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:39:37.320253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3e262-5fd1-411e-8e70-0cf8813c8fec None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:39:37.321682 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e1f3e262-5fd1-411e-8e70-0cf8813c8fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:39:37.350010 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:39:37.400385 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3e262-5fd1-411e-8e70-0cf8813c8fec None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:39:37.406121 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673215c-7197-46d0-b5ac-182cb01b6906 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:39:37.406775 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673215c-7197-46d0-b5ac-182cb01b6906 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:39:37.407055 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673215c-7197-46d0-b5ac-182cb01b6906 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:39:37.407327 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673215c-7197-46d0-b5ac-182cb01b6906 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:39:37.409107 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4673215c-7197-46d0-b5ac-182cb01b6906 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:39:37.469820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673215c-7197-46d0-b5ac-182cb01b6906 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:39:37.472436 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673215c-7197-46d0-b5ac-182cb01b6906 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:39:37.482057 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1166/2363] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:39:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:39:37.504658 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcf5b1-3641-4e2e-bb2d-01ce5b7bf332 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:39:37.506773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e4fcf5b1-3641-4e2e-bb2d-01ce5b7bf332 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:39:37.524770 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcf5b1-3641-4e2e-bb2d-01ce5b7bf332 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:39:37.527413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:39:37.528403 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:39:37.528782 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:39:37.529245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2 admin admin] PATH_INFO: `/v3/projects/c549a90791fc40f1922a2d657f85a1da` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:39:37.530753 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c549a90791fc40f1922a2d657f85a1da)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:39:37.532780 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:39:37.552225 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:39:37.675189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c549a90791fc40f1922a2d657f85a1da', 'request_id': 'req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:39:37.762508 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c549a90791fc40f1922a2d657f85a1da', 'request_id': 'req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:39:37.770122 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c549a90791fc40f1922a2d657f85a1da', 'request_id': 'req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:39:37.780571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2 admin admin] The token cache is being invalidate because project c549a90791fc40f1922a2d657f85a1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:39:37.780805 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:39:37.781503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:39:37.783047 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1198/2364] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:39:37 2022] DELETE /identity/v3/projects/c549a90791fc40f1922a2d657f85a1da => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:39:47.477760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=47 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:39:47.925996 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=17,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:40:09.154836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673215c-7197-46d0-b5ac-182cb01b6906 service nova] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:40:09.156295 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4673215c-7197-46d0-b5ac-182cb01b6906 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:09.170828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673215c-7197-46d0-b5ac-182cb01b6906 service nova] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:40:09.227707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbca47-2fdc-4137-a077-04cc9d4a1e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:40:09.228585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbca47-2fdc-4137-a077-04cc9d4a1e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:09.228864 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbca47-2fdc-4137-a077-04cc9d4a1e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:09.229139 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbca47-2fdc-4137-a077-04cc9d4a1e42 admin admin] PATH_INFO: `/v3/users/d4eeb8684c1e4c8da065e92fc5f04c01` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:09.230355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbca47-2fdc-4137-a077-04cc9d4a1e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4eeb8684c1e4c8da065e92fc5f04c01)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:40:09.232292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbca47-2fdc-4137-a077-04cc9d4a1e42 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:40:09.428188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0dbbca47-2fdc-4137-a077-04cc9d4a1e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4eeb8684c1e4c8da065e92fc5f04c01'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:40:09.443093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0dbbca47-2fdc-4137-a077-04cc9d4a1e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4eeb8684c1e4c8da065e92fc5f04c01'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:40:09.443824 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0dbbca47-2fdc-4137-a077-04cc9d4a1e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4eeb8684c1e4c8da065e92fc5f04c01'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:40:09.445218 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0dbbca47-2fdc-4137-a077-04cc9d4a1e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4eeb8684c1e4c8da065e92fc5f04c01'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:40:09.455064 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0dbbca47-2fdc-4137-a077-04cc9d4a1e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4eeb8684c1e4c8da065e92fc5f04c01'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:40:09.556283 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1167/2365] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:40:09 2022] DELETE /identity/v3/users/d4eeb8684c1e4c8da065e92fc5f04c01 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:40:09.873781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:40:09.875445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:09.889476 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193da75-bfc7-4080-aa9c-8225d4b1b4c2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:40:09.949036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3150a95-35e1-4735-a110-268b8e5af141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:40:09.949923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3150a95-35e1-4735-a110-268b8e5af141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:09.950629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3150a95-35e1-4735-a110-268b8e5af141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:09.950629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3150a95-35e1-4735-a110-268b8e5af141 admin admin] PATH_INFO: `/v3/projects/9e64e39b616246e6974808d3d435e8ea` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:09.951871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3150a95-35e1-4735-a110-268b8e5af141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e64e39b616246e6974808d3d435e8ea)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:40:09.953813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3150a95-35e1-4735-a110-268b8e5af141 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:40:10.098879 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f3150a95-35e1-4735-a110-268b8e5af141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e64e39b616246e6974808d3d435e8ea', 'request_id': 'req-f3150a95-35e1-4735-a110-268b8e5af141'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:40:10.175295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f3150a95-35e1-4735-a110-268b8e5af141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e64e39b616246e6974808d3d435e8ea', 'request_id': 'req-f3150a95-35e1-4735-a110-268b8e5af141'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:40:10.182351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f3150a95-35e1-4735-a110-268b8e5af141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e64e39b616246e6974808d3d435e8ea', 'request_id': 'req-f3150a95-35e1-4735-a110-268b8e5af141'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:40:10.192982 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f3150a95-35e1-4735-a110-268b8e5af141 admin admin] The token cache is being invalidate because project 9e64e39b616246e6974808d3d435e8ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:40:10.193271 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f3150a95-35e1-4735-a110-268b8e5af141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:40:10.193936 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f3150a95-35e1-4735-a110-268b8e5af141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:40:10.195631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1199/2366] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:40:09 2022] DELETE /identity/v3/projects/9e64e39b616246e6974808d3d435e8ea => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:40:14.346825 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df88056-a5b1-4646-a8ec-2a38db3ac79e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:14.347341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df88056-a5b1-4646-a8ec-2a38db3ac79e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:14.347443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df88056-a5b1-4646-a8ec-2a38db3ac79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:14.408983 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6df88056-a5b1-4646-a8ec-2a38db3ac79e None None] MFA Rules not processed for user `9144d74a341b4e08ae353b384fe1186e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:40:14.410242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6df88056-a5b1-4646-a8ec-2a38db3ac79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:14.453818 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:40:14.477025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1168/2367] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Jun 17 07:40:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:40:14.519279 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3150a95-35e1-4735-a110-268b8e5af141 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:40:14.520794 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f3150a95-35e1-4735-a110-268b8e5af141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:14.617350 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3150a95-35e1-4735-a110-268b8e5af141 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:40:14.623739 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a2dbb-5785-4dbd-8b09-e033252da0ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a18b07c033224d2085773936dad33eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:40:14.624397 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a2dbb-5785-4dbd-8b09-e033252da0ba service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:14.624681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a2dbb-5785-4dbd-8b09-e033252da0ba service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:14.624957 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a2dbb-5785-4dbd-8b09-e033252da0ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:14.634365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a2dbb-5785-4dbd-8b09-e033252da0ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:40:14.635961 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a2dbb-5785-4dbd-8b09-e033252da0ba service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:40:14.640624 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:40:14.644456 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1200/2368] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Jun 17 07:40:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:40:24.578156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=8 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:40:25.134940 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df88056-a5b1-4646-a8ec-2a38db3ac79e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:40:25.136733 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6df88056-a5b1-4646-a8ec-2a38db3ac79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:25.200731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df88056-a5b1-4646-a8ec-2a38db3ac79e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:40:25.204457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836fc57-da6b-4805-86d7-22e73ce44606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:40:25.205123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836fc57-da6b-4805-86d7-22e73ce44606 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:25.205439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836fc57-da6b-4805-86d7-22e73ce44606 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:25.205723 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836fc57-da6b-4805-86d7-22e73ce44606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:25.207548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7836fc57-da6b-4805-86d7-22e73ce44606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:25.218060 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836fc57-da6b-4805-86d7-22e73ce44606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:40:25.219528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836fc57-da6b-4805-86d7-22e73ce44606 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:40:25.228924 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1169/2369] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:40:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:40:33.811010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a2dbb-5785-4dbd-8b09-e033252da0ba service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:40:33.811010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-995a2dbb-5785-4dbd-8b09-e033252da0ba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:33.884917 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a2dbb-5785-4dbd-8b09-e033252da0ba service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:40:33.890406 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7b021-47da-4e62-a2d0-04dcd1efa9e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:40:33.891055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7b021-47da-4e62-a2d0-04dcd1efa9e6 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:33.891336 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7b021-47da-4e62-a2d0-04dcd1efa9e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:33.891611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7b021-47da-4e62-a2d0-04dcd1efa9e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:33.893428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7ed7b021-47da-4e62-a2d0-04dcd1efa9e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:33.906603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7b021-47da-4e62-a2d0-04dcd1efa9e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:40:33.908279 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7b021-47da-4e62-a2d0-04dcd1efa9e6 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:40:33.920009 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1201/2370] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:40:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:40:34.825442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836fc57-da6b-4805-86d7-22e73ce44606 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:40:34.834182 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836fc57-da6b-4805-86d7-22e73ce44606 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:40:34.838369 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ca6c0-bb0c-433a-be83-c259ed4cb17c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:40:34.839080 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ca6c0-bb0c-433a-be83-c259ed4cb17c service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:34.839361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ca6c0-bb0c-433a-be83-c259ed4cb17c service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:34.839637 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ca6c0-bb0c-433a-be83-c259ed4cb17c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:34.841442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5d7ca6c0-bb0c-433a-be83-c259ed4cb17c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:34.851275 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ca6c0-bb0c-433a-be83-c259ed4cb17c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:40:34.852705 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ca6c0-bb0c-433a-be83-c259ed4cb17c service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:40:34.861223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1170/2371] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:40:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:40:35.211026 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf92959-2fdd-4d00-afd5-2491090fd098 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:35.211578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf92959-2fdd-4d00-afd5-2491090fd098 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:35.211578 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf92959-2fdd-4d00-afd5-2491090fd098 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:35.212988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1202/2372] 10.222.0.52 () {54 vars in 921 bytes} [Fri Jun 17 07:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:40:35.219047 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb127fb1-a2dd-4d01-afe3-d921d54b54a8 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:35.219398 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb127fb1-a2dd-4d01-afe3-d921d54b54a8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:35.219688 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb127fb1-a2dd-4d01-afe3-d921d54b54a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:35.267282 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-eb127fb1-a2dd-4d01-afe3-d921d54b54a8 None None] MFA Rules not processed for user `88e1572d22c048b09699a2fe50900f92`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:40:35.268506 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-eb127fb1-a2dd-4d01-afe3-d921d54b54a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:35.277950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1171/2373] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Jun 17 07:40:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:40:35.289394 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf92959-2fdd-4d00-afd5-2491090fd098 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:40:35.291615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ccf92959-2fdd-4d00-afd5-2491090fd098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:35.349488 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf92959-2fdd-4d00-afd5-2491090fd098 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:40:35.353101 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a735d-c919-4250-912e-8fedfa34cb2b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde4369f695745c199ce6c10d241b841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:40:35.354489 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a735d-c919-4250-912e-8fedfa34cb2b service glance] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:35.354776 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a735d-c919-4250-912e-8fedfa34cb2b service glance] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:35.355055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a735d-c919-4250-912e-8fedfa34cb2b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:35.365612 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a735d-c919-4250-912e-8fedfa34cb2b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:40:35.367094 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a735d-c919-4250-912e-8fedfa34cb2b service glance] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:40:35.378543 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1203/2374] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:40:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:40:35.619882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261eda2-c0d0-40ed-ab61-095a1047a1f5 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:35.619882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261eda2-c0d0-40ed-ab61-095a1047a1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:35.619882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261eda2-c0d0-40ed-ab61-095a1047a1f5 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:35.619882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1172/2375] 10.222.0.52 () {54 vars in 921 bytes} [Fri Jun 17 07:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:40:35.623450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a122746-1b9b-47e6-a870-830be74e4658 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:35.623745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a122746-1b9b-47e6-a870-830be74e4658 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:35.624052 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a122746-1b9b-47e6-a870-830be74e4658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:35.648023 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7a122746-1b9b-47e6-a870-830be74e4658 None None] MFA Rules not processed for user `ad436c2fecba4754875b7c7cb26852a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:40:35.649235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7a122746-1b9b-47e6-a870-830be74e4658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:35.656465 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1204/2376] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Jun 17 07:40:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:40:35.668958 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261eda2-c0d0-40ed-ab61-095a1047a1f5 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:40:35.680108 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261eda2-c0d0-40ed-ab61-095a1047a1f5 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:40:35.685097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbe956-9ca5-41aa-a870-cddf197c541c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:40:35.685380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbe956-9ca5-41aa-a870-cddf197c541c service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:35.685660 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbe956-9ca5-41aa-a870-cddf197c541c service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:35.685930 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbe956-9ca5-41aa-a870-cddf197c541c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:35.693466 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbe956-9ca5-41aa-a870-cddf197c541c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:40:35.694922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbe956-9ca5-41aa-a870-cddf197c541c service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:40:35.703503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1173/2377] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:40:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:40:36.796402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2ceff-bc87-4505-8ead-2c95e14f9760 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:36.796863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2ceff-bc87-4505-8ead-2c95e14f9760 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:36.797066 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2ceff-bc87-4505-8ead-2c95e14f9760 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:36.798474 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1205/2378] 10.222.0.52 () {54 vars in 921 bytes} [Fri Jun 17 07:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:40:36.803740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258fa5f-43a5-480b-a9eb-4d43aaadef4f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:36.804165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258fa5f-43a5-480b-a9eb-4d43aaadef4f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:36.804311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258fa5f-43a5-480b-a9eb-4d43aaadef4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:36.823011 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c258fa5f-43a5-480b-a9eb-4d43aaadef4f None None] MFA Rules not processed for user `88e1572d22c048b09699a2fe50900f92`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:40:36.824196 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c258fa5f-43a5-480b-a9eb-4d43aaadef4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:36.833411 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1174/2379] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Jun 17 07:40:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:40:36.844419 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2ceff-bc87-4505-8ead-2c95e14f9760 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:40:36.846192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ecc2ceff-bc87-4505-8ead-2c95e14f9760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:36.859443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2ceff-bc87-4505-8ead-2c95e14f9760 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:40:36.863054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96bd46-f74d-4bc1-9550-02fc47a4637c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:40:36.863942 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96bd46-f74d-4bc1-9550-02fc47a4637c service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:36.864224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96bd46-f74d-4bc1-9550-02fc47a4637c service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:36.864503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96bd46-f74d-4bc1-9550-02fc47a4637c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:36.880177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96bd46-f74d-4bc1-9550-02fc47a4637c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:40:36.880177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96bd46-f74d-4bc1-9550-02fc47a4637c service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:40:36.888623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1206/2380] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:40:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:40:36.956074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258fa5f-43a5-480b-a9eb-4d43aaadef4f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:40:36.957479 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c258fa5f-43a5-480b-a9eb-4d43aaadef4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:37.024830 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258fa5f-43a5-480b-a9eb-4d43aaadef4f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:40:37.030644 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab44909-5849-44ea-b556-ff82449f16db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adc8b93e5c41929b928002e004df6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:40:37.031283 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab44909-5849-44ea-b556-ff82449f16db service placement] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:37.031563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab44909-5849-44ea-b556-ff82449f16db service placement] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:37.031832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab44909-5849-44ea-b556-ff82449f16db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:37.033624 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2ab44909-5849-44ea-b556-ff82449f16db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:37.045515 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab44909-5849-44ea-b556-ff82449f16db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:40:37.047095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab44909-5849-44ea-b556-ff82449f16db service placement] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:40:37.057454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1175/2381] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:40:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:40:44.357384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb5691-5f91-499c-93a3-cd642208481f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:44.357824 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb5691-5f91-499c-93a3-cd642208481f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:44.357956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb5691-5f91-499c-93a3-cd642208481f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:44.377177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a7fb5691-5f91-499c-93a3-cd642208481f None None] MFA Rules not processed for user `9144d74a341b4e08ae353b384fe1186e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:40:44.378418 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a7fb5691-5f91-499c-93a3-cd642208481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:44.386281 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1207/2382] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Jun 17 07:40:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:40:44.398096 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab44909-5849-44ea-b556-ff82449f16db service placement] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:40:44.409901 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab44909-5849-44ea-b556-ff82449f16db service placement] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:40:44.415171 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c47cfe-2d9b-4760-90f9-2a660a278817 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a18b07c033224d2085773936dad33eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:40:44.415809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c47cfe-2d9b-4760-90f9-2a660a278817 service swift] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:44.416090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c47cfe-2d9b-4760-90f9-2a660a278817 service swift] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:44.416360 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c47cfe-2d9b-4760-90f9-2a660a278817 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:44.424506 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c47cfe-2d9b-4760-90f9-2a660a278817 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:40:44.426129 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c47cfe-2d9b-4760-90f9-2a660a278817 service swift] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:40:44.434964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1176/2383] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Jun 17 07:40:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:40:54.371396 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=72 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:40:54.431610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=88 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:40:59.220842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb5691-5f91-499c-93a3-cd642208481f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:40:59.222250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a7fb5691-5f91-499c-93a3-cd642208481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:59.240803 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb5691-5f91-499c-93a3-cd642208481f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:40:59.250155 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57c5ab-4c50-4a5b-b842-8a673691f5bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:40:59.250824 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57c5ab-4c50-4a5b-b842-8a673691f5bd service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:40:59.251108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57c5ab-4c50-4a5b-b842-8a673691f5bd service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:40:59.251383 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57c5ab-4c50-4a5b-b842-8a673691f5bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:40:59.253178 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3b57c5ab-4c50-4a5b-b842-8a673691f5bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:40:59.314210 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57c5ab-4c50-4a5b-b842-8a673691f5bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:40:59.315816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57c5ab-4c50-4a5b-b842-8a673691f5bd service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:40:59.325710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1208/2384] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:40:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:41:09.321279 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=28 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:41:14.622130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df0205-adea-4a46-90d5-ac5a4442a7cd None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:41:14.622873 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df0205-adea-4a46-90d5-ac5a4442a7cd None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:41:14.622873 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df0205-adea-4a46-90d5-ac5a4442a7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:41:14.641846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-20df0205-adea-4a46-90d5-ac5a4442a7cd None None] MFA Rules not processed for user `9144d74a341b4e08ae353b384fe1186e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:41:14.643066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-20df0205-adea-4a46-90d5-ac5a4442a7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:41:14.654299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1177/2385] 10.222.0.52 () {58 vars in 967 bytes} [Fri Jun 17 07:41:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:41:14.679405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57c5ab-4c50-4a5b-b842-8a673691f5bd service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:41:14.691314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57c5ab-4c50-4a5b-b842-8a673691f5bd service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:41:14.696844 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a51bd1-643b-40fc-876e-31675e5307f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a18b07c033224d2085773936dad33eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:41:14.697629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a51bd1-643b-40fc-876e-31675e5307f8 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:41:14.697947 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a51bd1-643b-40fc-876e-31675e5307f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:41:14.698225 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a51bd1-643b-40fc-876e-31675e5307f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:41:14.707199 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a51bd1-643b-40fc-876e-31675e5307f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:41:14.708793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a51bd1-643b-40fc-876e-31675e5307f8 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:41:14.718432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1209/2386] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Jun 17 07:41:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:41:24.636147 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:41:24.714746 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:41:31.795040 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3573c-da12-465f-aeb1-1c040ed398b5 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:41:31.795549 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3573c-da12-465f-aeb1-1c040ed398b5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:41:31.795689 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3573c-da12-465f-aeb1-1c040ed398b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:41:31.813509 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0df3573c-da12-465f-aeb1-1c040ed398b5 None None] MFA Rules not processed for user `8b753148f55e4fb0897bf9639e8d4d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:41:31.814710 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0df3573c-da12-465f-aeb1-1c040ed398b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:41:31.822263 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1178/2387] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:41:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:41:38.012875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a51bd1-643b-40fc-876e-31675e5307f8 service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:41:38.026568 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a51bd1-643b-40fc-876e-31675e5307f8 service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:41:38.032991 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc281d-4f20-4bec-bfd8-c77b7a9f14e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:41:38.036043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc281d-4f20-4bec-bfd8-c77b7a9f14e2 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:41:38.036043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc281d-4f20-4bec-bfd8-c77b7a9f14e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:41:38.036043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc281d-4f20-4bec-bfd8-c77b7a9f14e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:41:38.038977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-54fc281d-4f20-4bec-bfd8-c77b7a9f14e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:41:38.059002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc281d-4f20-4bec-bfd8-c77b7a9f14e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:41:38.060643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc281d-4f20-4bec-bfd8-c77b7a9f14e2 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:41:38.073027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1210/2388] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:41:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:41:41.808415 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:41:48.067672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:41:54.784778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3573c-da12-465f-aeb1-1c040ed398b5 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:41:54.798297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3573c-da12-465f-aeb1-1c040ed398b5 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:41:54.803828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b982678-0fda-435c-a4ec-5d741f584583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:41:54.804481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b982678-0fda-435c-a4ec-5d741f584583 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:41:54.804795 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b982678-0fda-435c-a4ec-5d741f584583 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:41:54.805067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b982678-0fda-435c-a4ec-5d741f584583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:41:54.807049 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7b982678-0fda-435c-a4ec-5d741f584583 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:41:54.866638 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b982678-0fda-435c-a4ec-5d741f584583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:41:54.868284 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b982678-0fda-435c-a4ec-5d741f584583 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:41:54.877702 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1179/2389] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:41:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:41:58.415293 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc281d-4f20-4bec-bfd8-c77b7a9f14e2 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:41:58.427025 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc281d-4f20-4bec-bfd8-c77b7a9f14e2 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:41:58.433365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7363ff-bc21-41b7-b5d0-c926b75d5a09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:41:58.434112 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7363ff-bc21-41b7-b5d0-c926b75d5a09 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:41:58.434625 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7363ff-bc21-41b7-b5d0-c926b75d5a09 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:41:58.434973 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7363ff-bc21-41b7-b5d0-c926b75d5a09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:41:58.437275 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-af7363ff-bc21-41b7-b5d0-c926b75d5a09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:41:58.450936 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7363ff-bc21-41b7-b5d0-c926b75d5a09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:41:58.452758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7363ff-bc21-41b7-b5d0-c926b75d5a09 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:41:58.468794 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1211/2390] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:41:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:41:59.966153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c613dc-d3b9-47ce-b0dc-6627b7c30a94 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:41:59.966153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c613dc-d3b9-47ce-b0dc-6627b7c30a94 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:41:59.966153 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c613dc-d3b9-47ce-b0dc-6627b7c30a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:41:59.982977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-72c613dc-d3b9-47ce-b0dc-6627b7c30a94 None None] MFA Rules not processed for user `781e29f49f27417a96cfc4ba00af95dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:41:59.984264 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-72c613dc-d3b9-47ce-b0dc-6627b7c30a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:41:59.991580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1180/2391] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:41:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:42:00.308656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7363ff-bc21-41b7-b5d0-c926b75d5a09 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:42:00.318154 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7363ff-bc21-41b7-b5d0-c926b75d5a09 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:42:00.322618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a054d2f-f56e-4c3d-8745-3965e20e71a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:42:00.323278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a054d2f-f56e-4c3d-8745-3965e20e71a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:42:00.323572 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a054d2f-f56e-4c3d-8745-3965e20e71a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:42:00.323854 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a054d2f-f56e-4c3d-8745-3965e20e71a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:42:00.325668 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7a054d2f-f56e-4c3d-8745-3965e20e71a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:42:00.335461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a054d2f-f56e-4c3d-8745-3965e20e71a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:42:00.337134 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a054d2f-f56e-4c3d-8745-3965e20e71a5 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:42:00.345187 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1212/2392] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:42:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:42:09.977846 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=31 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:10.341668 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=12 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:11.492138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c613dc-d3b9-47ce-b0dc-6627b7c30a94 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:42:11.505092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c613dc-d3b9-47ce-b0dc-6627b7c30a94 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:42:11.511550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5fcce-0494-4ce4-97df-c4bb4014f930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:42:11.512208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5fcce-0494-4ce4-97df-c4bb4014f930 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:42:11.512488 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5fcce-0494-4ce4-97df-c4bb4014f930 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:42:11.512759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5fcce-0494-4ce4-97df-c4bb4014f930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:42:11.514596 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8bb5fcce-0494-4ce4-97df-c4bb4014f930 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:42:11.573707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5fcce-0494-4ce4-97df-c4bb4014f930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:42:11.575312 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5fcce-0494-4ce4-97df-c4bb4014f930 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:42:11.584570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1181/2393] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:42:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:42:21.580188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=28 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:40.400787 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1423-5f91-48ea-bce7-1524884004bb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:42:40.401400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1423-5f91-48ea-bce7-1524884004bb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:42:40.401524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1423-5f91-48ea-bce7-1524884004bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:42:40.421399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-663a1423-5f91-48ea-bce7-1524884004bb None None] MFA Rules not processed for user `a3ea40ad7d7546449f60539341abc545`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:42:40.422645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-663a1423-5f91-48ea-bce7-1524884004bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:42:40.497188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1213/2394] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:42:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:42:50.492756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=25 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:02.842704 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5fcce-0494-4ce4-97df-c4bb4014f930 service nova] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:02.854364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5fcce-0494-4ce4-97df-c4bb4014f930 service nova] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:02.859590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56f307-0a4f-4073-81ff-d4a49cbda371 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adc8b93e5c41929b928002e004df6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:02.860221 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56f307-0a4f-4073-81ff-d4a49cbda371 service placement] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:02.860501 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56f307-0a4f-4073-81ff-d4a49cbda371 service placement] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:02.860776 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56f307-0a4f-4073-81ff-d4a49cbda371 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:02.862954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cb56f307-0a4f-4073-81ff-d4a49cbda371 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:02.875717 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56f307-0a4f-4073-81ff-d4a49cbda371 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:02.877259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56f307-0a4f-4073-81ff-d4a49cbda371 service placement] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:02.888203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1182/2395] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:43:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:43:08.404688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a1423-5f91-48ea-bce7-1524884004bb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:08.414597 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a1423-5f91-48ea-bce7-1524884004bb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:08.418723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0fa8c-8b75-4d40-be9f-70df59d74a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:08.419366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0fa8c-8b75-4d40-be9f-70df59d74a8c service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:08.419645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0fa8c-8b75-4d40-be9f-70df59d74a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:08.419919 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0fa8c-8b75-4d40-be9f-70df59d74a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:08.421737 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-21c0fa8c-8b75-4d40-be9f-70df59d74a8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:08.486866 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0fa8c-8b75-4d40-be9f-70df59d74a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:08.488313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0fa8c-8b75-4d40-be9f-70df59d74a8c service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:08.498588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1214/2396] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:43:12.162361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56f307-0a4f-4073-81ff-d4a49cbda371 service placement] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:12.174467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56f307-0a4f-4073-81ff-d4a49cbda371 service placement] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:12.180607 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ee825-732d-4d3e-94db-d6923fd502b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adc8b93e5c41929b928002e004df6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:12.182183 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee825-732d-4d3e-94db-d6923fd502b3 service placement] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:12.182744 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee825-732d-4d3e-94db-d6923fd502b3 service placement] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:12.183234 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee825-732d-4d3e-94db-d6923fd502b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:12.190124 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-971ee825-732d-4d3e-94db-d6923fd502b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:12.204447 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ee825-732d-4d3e-94db-d6923fd502b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:12.206512 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ee825-732d-4d3e-94db-d6923fd502b3 service placement] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:12.218643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1183/2397] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:43:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:43:12.309680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0fa8c-8b75-4d40-be9f-70df59d74a8c service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:12.311782 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-21c0fa8c-8b75-4d40-be9f-70df59d74a8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:12.326420 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0fa8c-8b75-4d40-be9f-70df59d74a8c service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:12.331261 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce155b-26a3-4e09-b316-61d7a77a2f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:12.332182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce155b-26a3-4e09-b316-61d7a77a2f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:12.332463 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce155b-26a3-4e09-b316-61d7a77a2f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:12.332736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce155b-26a3-4e09-b316-61d7a77a2f1f admin admin] PATH_INFO: `/v3/users/8b753148f55e4fb0897bf9639e8d4d70` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:12.333947 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce155b-26a3-4e09-b316-61d7a77a2f1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b753148f55e4fb0897bf9639e8d4d70)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:12.336027 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce155b-26a3-4e09-b316-61d7a77a2f1f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:12.499942 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-28ce155b-26a3-4e09-b316-61d7a77a2f1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b753148f55e4fb0897bf9639e8d4d70'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:12.511813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-28ce155b-26a3-4e09-b316-61d7a77a2f1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b753148f55e4fb0897bf9639e8d4d70'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:12.518593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-28ce155b-26a3-4e09-b316-61d7a77a2f1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b753148f55e4fb0897bf9639e8d4d70'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:12.519262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-28ce155b-26a3-4e09-b316-61d7a77a2f1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b753148f55e4fb0897bf9639e8d4d70'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:12.519853 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-28ce155b-26a3-4e09-b316-61d7a77a2f1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b753148f55e4fb0897bf9639e8d4d70'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:12.577171 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1215/2398] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:43:12 2022] DELETE /identity/v3/users/8b753148f55e4fb0897bf9639e8d4d70 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:12.818527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ee825-732d-4d3e-94db-d6923fd502b3 service placement] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:12.832089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ee825-732d-4d3e-94db-d6923fd502b3 service placement] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:12.894149 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e0fac-7443-4f91-9c31-9698716898e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:12.894930 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e0fac-7443-4f91-9c31-9698716898e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:12.895224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e0fac-7443-4f91-9c31-9698716898e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:12.895518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e0fac-7443-4f91-9c31-9698716898e0 admin admin] PATH_INFO: `/v3/projects/94fc753fb51e41acb3037d2ca7cd1394` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:12.896759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e0fac-7443-4f91-9c31-9698716898e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94fc753fb51e41acb3037d2ca7cd1394)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:12.898742 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e0fac-7443-4f91-9c31-9698716898e0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:13.041933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-014e0fac-7443-4f91-9c31-9698716898e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94fc753fb51e41acb3037d2ca7cd1394', 'request_id': 'req-014e0fac-7443-4f91-9c31-9698716898e0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:13.048225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-014e0fac-7443-4f91-9c31-9698716898e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94fc753fb51e41acb3037d2ca7cd1394', 'request_id': 'req-014e0fac-7443-4f91-9c31-9698716898e0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:13.151522 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-014e0fac-7443-4f91-9c31-9698716898e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94fc753fb51e41acb3037d2ca7cd1394', 'request_id': 'req-014e0fac-7443-4f91-9c31-9698716898e0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:13.162704 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-014e0fac-7443-4f91-9c31-9698716898e0 admin admin] The token cache is being invalidate because project 94fc753fb51e41acb3037d2ca7cd1394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:43:13.163830 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-014e0fac-7443-4f91-9c31-9698716898e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:13.163830 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-014e0fac-7443-4f91-9c31-9698716898e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:13.166157 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1184/2399] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:43:12 2022] DELETE /identity/v3/projects/94fc753fb51e41acb3037d2ca7cd1394 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:13.171426 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfdb16-cd20-488b-bffa-008c4062642d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:13.171776 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfdb16-cd20-488b-bffa-008c4062642d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:13.172056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfdb16-cd20-488b-bffa-008c4062642d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:13.191235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1fdfdb16-cd20-488b-bffa-008c4062642d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:13.192443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1fdfdb16-cd20-488b-bffa-008c4062642d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:13.254276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1216/2400] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:13.262198 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b752a30-4ad2-4688-8c01-6b2c7b7e6997 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:13.262486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b752a30-4ad2-4688-8c01-6b2c7b7e6997 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:13.262781 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b752a30-4ad2-4688-8c01-6b2c7b7e6997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:13.281513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6b752a30-4ad2-4688-8c01-6b2c7b7e6997 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:13.284346 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6b752a30-4ad2-4688-8c01-6b2c7b7e6997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:13.291475 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1185/2401] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:13.295836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfdb16-cd20-488b-bffa-008c4062642d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:13.305795 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfdb16-cd20-488b-bffa-008c4062642d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:13.311012 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa4074-d0da-4ea9-ad12-f91b89a52aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:13.311669 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa4074-d0da-4ea9-ad12-f91b89a52aec admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:13.311957 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa4074-d0da-4ea9-ad12-f91b89a52aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:13.312300 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa4074-d0da-4ea9-ad12-f91b89a52aec admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:13.313030 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa4074-d0da-4ea9-ad12-f91b89a52aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:43:13.313370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa4074-d0da-4ea9-ad12-f91b89a52aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:13.314981 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa4074-d0da-4ea9-ad12-f91b89a52aec admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:13.316472 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:13.327308 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1217/2402] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:43:13.333306 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b752a30-4ad2-4688-8c01-6b2c7b7e6997 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:13.342593 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b752a30-4ad2-4688-8c01-6b2c7b7e6997 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:13.347363 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358a0c6-9939-4dbe-940e-c7844993c99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:13.348009 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358a0c6-9939-4dbe-940e-c7844993c99b admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:13.348287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358a0c6-9939-4dbe-940e-c7844993c99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:13.348560 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358a0c6-9939-4dbe-940e-c7844993c99b admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:13.349248 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358a0c6-9939-4dbe-940e-c7844993c99b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:13.351202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358a0c6-9939-4dbe-940e-c7844993c99b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:13.441175 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1186/2403] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:43:13 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:43:13.445300 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa4074-d0da-4ea9-ad12-f91b89a52aec admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:13.455423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa4074-d0da-4ea9-ad12-f91b89a52aec admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:13.514421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fbd18-a654-4dd8-b910-f8037e5de372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:13.515092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fbd18-a654-4dd8-b910-f8037e5de372 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:13.515377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fbd18-a654-4dd8-b910-f8037e5de372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:13.515650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fbd18-a654-4dd8-b910-f8037e5de372 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:13.516342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fbd18-a654-4dd8-b910-f8037e5de372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:13.518337 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fbd18-a654-4dd8-b910-f8037e5de372 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:13.613580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1218/2404] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:43:13 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:43:13.613791 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358a0c6-9939-4dbe-940e-c7844993c99b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:13.622186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358a0c6-9939-4dbe-940e-c7844993c99b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:13.626830 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9ec1d-d954-4468-b170-34bd206bd793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:13.627481 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9ec1d-d954-4468-b170-34bd206bd793 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:13.627765 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9ec1d-d954-4468-b170-34bd206bd793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:13.628041 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9ec1d-d954-4468-b170-34bd206bd793 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:13.628757 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9ec1d-d954-4468-b170-34bd206bd793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:13.630448 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9ec1d-d954-4468-b170-34bd206bd793 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:13.640439 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1187/2405] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:43:13.644505 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fbd18-a654-4dd8-b910-f8037e5de372 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:13.655218 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fbd18-a654-4dd8-b910-f8037e5de372 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:13.660173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78fc73-df17-4c58-a582-e18a9a6ca6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:13.660835 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78fc73-df17-4c58-a582-e18a9a6ca6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:13.661100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78fc73-df17-4c58-a582-e18a9a6ca6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:13.661403 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78fc73-df17-4c58-a582-e18a9a6ca6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:13.662145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78fc73-df17-4c58-a582-e18a9a6ca6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:13.663789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78fc73-df17-4c58-a582-e18a9a6ca6c6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:13.675828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1219/2406] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:43:13.685129 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9ec1d-d954-4468-b170-34bd206bd793 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:13.695249 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9ec1d-d954-4468-b170-34bd206bd793 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:13.700072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7158ed8-c0f8-4819-8038-cdeeeda54735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:13.700945 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7158ed8-c0f8-4819-8038-cdeeeda54735 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:13.701227 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7158ed8-c0f8-4819-8038-cdeeeda54735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:13.701533 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7158ed8-c0f8-4819-8038-cdeeeda54735 admin admin] PATH_INFO: `/v3/projects/187686bdaf2f4b7b89b8875fb95579b3/users/72a0707d7c4f436884aeee0ad8b25c60/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:13.716548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:13.719550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7158ed8-c0f8-4819-8038-cdeeeda54735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=187686bdaf2f4b7b89b8875fb95579b3, user_id=72a0707d7c4f436884aeee0ad8b25c60, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:13.722250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7158ed8-c0f8-4819-8038-cdeeeda54735 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:13.802024 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1188/2407] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:43:13 2022] PUT /identity/v3/projects/187686bdaf2f4b7b89b8875fb95579b3/users/72a0707d7c4f436884aeee0ad8b25c60/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:13.819639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9babf-4eb9-4c38-82ce-40a21e45b680 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:13.819924 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9babf-4eb9-4c38-82ce-40a21e45b680 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:13.820219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9babf-4eb9-4c38-82ce-40a21e45b680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:13.848878 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4fb9babf-4eb9-4c38-82ce-40a21e45b680 None None] MFA Rules not processed for user `72a0707d7c4f436884aeee0ad8b25c60`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:13.850169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4fb9babf-4eb9-4c38-82ce-40a21e45b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:13.916147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1220/2408] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:13.927307 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7158ed8-c0f8-4819-8038-cdeeeda54735 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:13.928998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c7158ed8-c0f8-4819-8038-cdeeeda54735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:13.988880 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7158ed8-c0f8-4819-8038-cdeeeda54735 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:13.992507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce6628-389a-4a3c-9731-ebd9d65ba0c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:13.993154 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce6628-389a-4a3c-9731-ebd9d65ba0c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:13.994123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce6628-389a-4a3c-9731-ebd9d65ba0c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:13.994415 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce6628-389a-4a3c-9731-ebd9d65ba0c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:14.003009 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce6628-389a-4a3c-9731-ebd9d65ba0c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:14.004449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce6628-389a-4a3c-9731-ebd9d65ba0c3 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:14.013206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1189/2409] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:43:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:43:23.912436 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=69,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:24.009787 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:27.181159 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9babf-4eb9-4c38-82ce-40a21e45b680 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:27.248272 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9babf-4eb9-4c38-82ce-40a21e45b680 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:27.252752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada023a9-d32a-45f1-8f95-26c6bc767db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:27.253668 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada023a9-d32a-45f1-8f95-26c6bc767db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:27.253945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada023a9-d32a-45f1-8f95-26c6bc767db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:27.254217 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada023a9-d32a-45f1-8f95-26c6bc767db6 admin admin] PATH_INFO: `/v3/users/72a0707d7c4f436884aeee0ad8b25c60` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:27.255404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada023a9-d32a-45f1-8f95-26c6bc767db6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72a0707d7c4f436884aeee0ad8b25c60)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:27.257346 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada023a9-d32a-45f1-8f95-26c6bc767db6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:27.479209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ada023a9-d32a-45f1-8f95-26c6bc767db6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72a0707d7c4f436884aeee0ad8b25c60'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:27.491521 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ada023a9-d32a-45f1-8f95-26c6bc767db6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72a0707d7c4f436884aeee0ad8b25c60'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:27.498669 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ada023a9-d32a-45f1-8f95-26c6bc767db6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72a0707d7c4f436884aeee0ad8b25c60'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:27.499429 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ada023a9-d32a-45f1-8f95-26c6bc767db6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72a0707d7c4f436884aeee0ad8b25c60'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:27.500046 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ada023a9-d32a-45f1-8f95-26c6bc767db6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72a0707d7c4f436884aeee0ad8b25c60'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:27.579891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1221/2410] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:43:27 2022] DELETE /identity/v3/users/72a0707d7c4f436884aeee0ad8b25c60 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:27.584598 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da608743-5e1e-49d1-becf-de20494648d1 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:27.585071 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da608743-5e1e-49d1-becf-de20494648d1 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:27.585175 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da608743-5e1e-49d1-becf-de20494648d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:27.603442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-da608743-5e1e-49d1-becf-de20494648d1 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:27.604847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-da608743-5e1e-49d1-becf-de20494648d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:27.665998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1190/2411] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:27.675799 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada023a9-d32a-45f1-8f95-26c6bc767db6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:27.677244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ada023a9-d32a-45f1-8f95-26c6bc767db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:27.736783 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada023a9-d32a-45f1-8f95-26c6bc767db6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:27.740318 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ed467-ecd0-4b4e-b071-0c2fe2268f70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:27.740967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ed467-ecd0-4b4e-b071-0c2fe2268f70 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:27.741250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ed467-ecd0-4b4e-b071-0c2fe2268f70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:27.741558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ed467-ecd0-4b4e-b071-0c2fe2268f70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:27.751365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ed467-ecd0-4b4e-b071-0c2fe2268f70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:27.752815 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ed467-ecd0-4b4e-b071-0c2fe2268f70 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:27.765373 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1222/2412] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:43:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:43:28.199637 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da608743-5e1e-49d1-becf-de20494648d1 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:28.201252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-da608743-5e1e-49d1-becf-de20494648d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:28.221345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da608743-5e1e-49d1-becf-de20494648d1 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:28.226451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce71af-3865-4af2-b3aa-09c3715d9479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:28.227336 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce71af-3865-4af2-b3aa-09c3715d9479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:28.227615 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce71af-3865-4af2-b3aa-09c3715d9479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:28.228464 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce71af-3865-4af2-b3aa-09c3715d9479 admin admin] PATH_INFO: `/v3/projects/187686bdaf2f4b7b89b8875fb95579b3` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:28.229725 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce71af-3865-4af2-b3aa-09c3715d9479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=187686bdaf2f4b7b89b8875fb95579b3)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:28.231892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce71af-3865-4af2-b3aa-09c3715d9479 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:28.423377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-81ce71af-3865-4af2-b3aa-09c3715d9479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '187686bdaf2f4b7b89b8875fb95579b3', 'request_id': 'req-81ce71af-3865-4af2-b3aa-09c3715d9479'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:28.429669 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-81ce71af-3865-4af2-b3aa-09c3715d9479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '187686bdaf2f4b7b89b8875fb95579b3', 'request_id': 'req-81ce71af-3865-4af2-b3aa-09c3715d9479'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:28.513765 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-81ce71af-3865-4af2-b3aa-09c3715d9479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '187686bdaf2f4b7b89b8875fb95579b3', 'request_id': 'req-81ce71af-3865-4af2-b3aa-09c3715d9479'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:28.526243 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-81ce71af-3865-4af2-b3aa-09c3715d9479 admin admin] The token cache is being invalidate because project 187686bdaf2f4b7b89b8875fb95579b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:43:28.526527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-81ce71af-3865-4af2-b3aa-09c3715d9479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:28.527217 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-81ce71af-3865-4af2-b3aa-09c3715d9479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:28.529108 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1191/2413] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:43:28 2022] DELETE /identity/v3/projects/187686bdaf2f4b7b89b8875fb95579b3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:28.533875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374caa2c-00e0-4e85-84c7-1dc7cbee460b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:28.534392 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374caa2c-00e0-4e85-84c7-1dc7cbee460b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:28.534549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374caa2c-00e0-4e85-84c7-1dc7cbee460b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:28.553316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-374caa2c-00e0-4e85-84c7-1dc7cbee460b None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:28.557991 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-374caa2c-00e0-4e85-84c7-1dc7cbee460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:28.572344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:28.616216 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1223/2414] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:28.624315 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09de686-cbf4-4ae5-97ed-e884645ec43b None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:28.624831 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09de686-cbf4-4ae5-97ed-e884645ec43b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:28.625022 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09de686-cbf4-4ae5-97ed-e884645ec43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:28.644219 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b09de686-cbf4-4ae5-97ed-e884645ec43b None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:28.650225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b09de686-cbf4-4ae5-97ed-e884645ec43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:28.654271 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1192/2415] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:28.658744 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374caa2c-00e0-4e85-84c7-1dc7cbee460b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:28.669868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374caa2c-00e0-4e85-84c7-1dc7cbee460b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:28.676000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874e414-8e59-4790-8d94-cab848fef673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:28.676803 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874e414-8e59-4790-8d94-cab848fef673 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:28.677193 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874e414-8e59-4790-8d94-cab848fef673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:28.677634 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874e414-8e59-4790-8d94-cab848fef673 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:28.678524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874e414-8e59-4790-8d94-cab848fef673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:43:28.678937 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874e414-8e59-4790-8d94-cab848fef673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:28.680742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874e414-8e59-4790-8d94-cab848fef673 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:28.693242 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1224/2416] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:43:28.697910 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09de686-cbf4-4ae5-97ed-e884645ec43b None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:28.708012 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09de686-cbf4-4ae5-97ed-e884645ec43b None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:28.713159 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357a052-2604-42ac-95d7-79e331c33dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:28.713843 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357a052-2604-42ac-95d7-79e331c33dab admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:28.714961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357a052-2604-42ac-95d7-79e331c33dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:28.715234 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357a052-2604-42ac-95d7-79e331c33dab admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:28.716151 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357a052-2604-42ac-95d7-79e331c33dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:28.718096 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357a052-2604-42ac-95d7-79e331c33dab admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:28.804052 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1193/2417] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:43:28 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:43:28.808515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874e414-8e59-4790-8d94-cab848fef673 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:28.818841 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874e414-8e59-4790-8d94-cab848fef673 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:28.875345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61e1a1-ec3f-46a7-a718-0457b47534e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:28.875914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61e1a1-ec3f-46a7-a718-0457b47534e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:28.876195 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61e1a1-ec3f-46a7-a718-0457b47534e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:28.876468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61e1a1-ec3f-46a7-a718-0457b47534e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:28.877161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61e1a1-ec3f-46a7-a718-0457b47534e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:28.879100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61e1a1-ec3f-46a7-a718-0457b47534e8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:28.993409 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1225/2418] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:43:28 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:43:28.995692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357a052-2604-42ac-95d7-79e331c33dab admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:29.006324 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357a052-2604-42ac-95d7-79e331c33dab admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:29.011781 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb519671-2944-4f0c-8698-ce3344f202be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:29.012458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb519671-2944-4f0c-8698-ce3344f202be admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:29.012721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb519671-2944-4f0c-8698-ce3344f202be admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:29.012996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb519671-2944-4f0c-8698-ce3344f202be admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:29.013760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb519671-2944-4f0c-8698-ce3344f202be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:29.015363 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb519671-2944-4f0c-8698-ce3344f202be admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:29.026467 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1194/2419] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:43:29.030647 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61e1a1-ec3f-46a7-a718-0457b47534e8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:29.040638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61e1a1-ec3f-46a7-a718-0457b47534e8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:29.045204 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff03a0-7967-4e5c-8e7a-1d108343fc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:29.045900 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff03a0-7967-4e5c-8e7a-1d108343fc44 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:29.046175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff03a0-7967-4e5c-8e7a-1d108343fc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:29.046445 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff03a0-7967-4e5c-8e7a-1d108343fc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:29.047156 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff03a0-7967-4e5c-8e7a-1d108343fc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:29.048729 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff03a0-7967-4e5c-8e7a-1d108343fc44 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:29.058647 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1226/2420] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:43:29.062708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb519671-2944-4f0c-8698-ce3344f202be admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:29.073201 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb519671-2944-4f0c-8698-ce3344f202be admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:29.077918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d4aa1-da32-4d93-abb7-3e41670f686a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:29.078793 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d4aa1-da32-4d93-abb7-3e41670f686a admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:29.079078 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d4aa1-da32-4d93-abb7-3e41670f686a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:29.079358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d4aa1-da32-4d93-abb7-3e41670f686a admin admin] PATH_INFO: `/v3/projects/4944e32e336d47a8b61e6a16eda5a5ed/users/443801f079564ec784e8f144e9d5b4de/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:29.094536 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d4aa1-da32-4d93-abb7-3e41670f686a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4944e32e336d47a8b61e6a16eda5a5ed, user_id=443801f079564ec784e8f144e9d5b4de, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:29.097314 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d4aa1-da32-4d93-abb7-3e41670f686a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:29.170996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1195/2421] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:43:29 2022] PUT /identity/v3/projects/4944e32e336d47a8b61e6a16eda5a5ed/users/443801f079564ec784e8f144e9d5b4de/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:29.181471 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1c67c-1cd2-4622-a57c-5ca0c16097a5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:29.181896 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1c67c-1cd2-4622-a57c-5ca0c16097a5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:29.182179 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1c67c-1cd2-4622-a57c-5ca0c16097a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:29.209904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cde1c67c-1cd2-4622-a57c-5ca0c16097a5 None None] MFA Rules not processed for user `443801f079564ec784e8f144e9d5b4de`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:29.211103 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cde1c67c-1cd2-4622-a57c-5ca0c16097a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:29.276403 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1227/2422] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:29.280932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d4aa1-da32-4d93-abb7-3e41670f686a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:29.302368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:29.342516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d4aa1-da32-4d93-abb7-3e41670f686a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:29.347112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6664ed8-84c4-49f9-99db-6a2655dce99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:29.365025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6664ed8-84c4-49f9-99db-6a2655dce99e admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:29.365025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6664ed8-84c4-49f9-99db-6a2655dce99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:29.365025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6664ed8-84c4-49f9-99db-6a2655dce99e admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:29.365025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6664ed8-84c4-49f9-99db-6a2655dce99e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:29.365025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6664ed8-84c4-49f9-99db-6a2655dce99e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:29.446414 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1196/2423] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:43:29 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:43:29.451323 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1c67c-1cd2-4622-a57c-5ca0c16097a5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:29.462427 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1c67c-1cd2-4622-a57c-5ca0c16097a5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:29.474854 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:29.519850 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc952168-6abe-48b2-9e48-8543008d4928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:29.520527 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc952168-6abe-48b2-9e48-8543008d4928 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:29.520804 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc952168-6abe-48b2-9e48-8543008d4928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:29.521075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc952168-6abe-48b2-9e48-8543008d4928 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:29.521808 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc952168-6abe-48b2-9e48-8543008d4928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:29.523837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc952168-6abe-48b2-9e48-8543008d4928 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:29.631707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1228/2424] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:43:29 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:43:29.636434 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6664ed8-84c4-49f9-99db-6a2655dce99e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:29.647233 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6664ed8-84c4-49f9-99db-6a2655dce99e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:29.651989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2111d-3860-41e0-be9b-67f850bbf1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:29.652640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2111d-3860-41e0-be9b-67f850bbf1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:29.652921 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2111d-3860-41e0-be9b-67f850bbf1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:29.653196 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2111d-3860-41e0-be9b-67f850bbf1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:29.653945 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2111d-3860-41e0-be9b-67f850bbf1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:29.655546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2111d-3860-41e0-be9b-67f850bbf1d8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:29.666801 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1197/2425] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:43:29.671210 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc952168-6abe-48b2-9e48-8543008d4928 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:29.685339 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc952168-6abe-48b2-9e48-8543008d4928 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:29.690029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5d3fc-0b27-47c2-b95c-6a96d77bc05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:29.690914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5d3fc-0b27-47c2-b95c-6a96d77bc05f admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:29.691193 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5d3fc-0b27-47c2-b95c-6a96d77bc05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:29.691462 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5d3fc-0b27-47c2-b95c-6a96d77bc05f admin admin] PATH_INFO: `/v3/projects/ccb8d1a73bd4434c83c932752816e3a8/users/6d7f0d8b0c1e4951a9bdd04f64c8639f/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:29.706941 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5d3fc-0b27-47c2-b95c-6a96d77bc05f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb8d1a73bd4434c83c932752816e3a8, user_id=6d7f0d8b0c1e4951a9bdd04f64c8639f, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:29.709589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5d3fc-0b27-47c2-b95c-6a96d77bc05f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:29.797797 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1229/2426] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:43:29 2022] PUT /identity/v3/projects/ccb8d1a73bd4434c83c932752816e3a8/users/6d7f0d8b0c1e4951a9bdd04f64c8639f/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:43:29.802533 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2111d-3860-41e0-be9b-67f850bbf1d8 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:29.813819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2111d-3860-41e0-be9b-67f850bbf1d8 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:29.871285 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe66b60-dbca-4dd1-b8b1-e4d2fe35c27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:29.871978 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe66b60-dbca-4dd1-b8b1-e4d2fe35c27d admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:29.872318 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe66b60-dbca-4dd1-b8b1-e4d2fe35c27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:29.872600 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe66b60-dbca-4dd1-b8b1-e4d2fe35c27d admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:29.873353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe66b60-dbca-4dd1-b8b1-e4d2fe35c27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:29.874981 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe66b60-dbca-4dd1-b8b1-e4d2fe35c27d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:29.885220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1198/2427] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:43:29.889442 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5d3fc-0b27-47c2-b95c-6a96d77bc05f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:29.899580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5d3fc-0b27-47c2-b95c-6a96d77bc05f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:29.904303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7802906-d57d-4746-a42f-e4e8b3f87d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:29.905193 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7802906-d57d-4746-a42f-e4e8b3f87d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:29.905505 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7802906-d57d-4746-a42f-e4e8b3f87d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:29.905779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7802906-d57d-4746-a42f-e4e8b3f87d73 admin admin] PATH_INFO: `/v3/projects/ccb8d1a73bd4434c83c932752816e3a8/users/6d7f0d8b0c1e4951a9bdd04f64c8639f/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:29.907889 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7802906-d57d-4746-a42f-e4e8b3f87d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb8d1a73bd4434c83c932752816e3a8, user_id=6d7f0d8b0c1e4951a9bdd04f64c8639f, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:29.910559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7802906-d57d-4746-a42f-e4e8b3f87d73 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:29.921581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1230/2428] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:43:29 2022] PUT /identity/v3/projects/ccb8d1a73bd4434c83c932752816e3a8/users/6d7f0d8b0c1e4951a9bdd04f64c8639f/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:43:29.934076 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234f60d-fbda-4619-80d8-18ca63b935d6 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:29.934364 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234f60d-fbda-4619-80d8-18ca63b935d6 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:29.934666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234f60d-fbda-4619-80d8-18ca63b935d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:29.961082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4234f60d-fbda-4619-80d8-18ca63b935d6 None None] MFA Rules not processed for user `6d7f0d8b0c1e4951a9bdd04f64c8639f`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:29.962444 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4234f60d-fbda-4619-80d8-18ca63b935d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:30.030508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1199/2429] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:29 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:30.041923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7802906-d57d-4746-a42f-e4e8b3f87d73 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:30.043984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f7802906-d57d-4746-a42f-e4e8b3f87d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:30.102189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7802906-d57d-4746-a42f-e4e8b3f87d73 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:30.106868 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76594b9-ce0b-489f-927b-d8658187d7a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:30.107515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76594b9-ce0b-489f-927b-d8658187d7a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:30.107798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76594b9-ce0b-489f-927b-d8658187d7a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:30.108333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76594b9-ce0b-489f-927b-d8658187d7a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:30.117684 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76594b9-ce0b-489f-927b-d8658187d7a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:30.119483 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76594b9-ce0b-489f-927b-d8658187d7a3 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:30.129222 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1231/2430] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:43:30 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:43:33.206926 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234f60d-fbda-4619-80d8-18ca63b935d6 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:33.224419 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:33.272720 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234f60d-fbda-4619-80d8-18ca63b935d6 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:33.277655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abd18c-d064-4929-9c87-081c4c7a1c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:33.278529 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abd18c-d064-4929-9c87-081c4c7a1c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:33.278810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abd18c-d064-4929-9c87-081c4c7a1c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:33.279084 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abd18c-d064-4929-9c87-081c4c7a1c33 admin admin] PATH_INFO: `/v3/users/443801f079564ec784e8f144e9d5b4de` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:33.280264 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abd18c-d064-4929-9c87-081c4c7a1c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=443801f079564ec784e8f144e9d5b4de)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:33.282347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abd18c-d064-4929-9c87-081c4c7a1c33 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:33.467739 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-95abd18c-d064-4929-9c87-081c4c7a1c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443801f079564ec784e8f144e9d5b4de'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:33.480502 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-95abd18c-d064-4929-9c87-081c4c7a1c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443801f079564ec784e8f144e9d5b4de'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:33.481258 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-95abd18c-d064-4929-9c87-081c4c7a1c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443801f079564ec784e8f144e9d5b4de'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:33.481891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-95abd18c-d064-4929-9c87-081c4c7a1c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443801f079564ec784e8f144e9d5b4de'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:33.489073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-95abd18c-d064-4929-9c87-081c4c7a1c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443801f079564ec784e8f144e9d5b4de'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:33.576534 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1200/2431] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:43:33 2022] DELETE /identity/v3/users/443801f079564ec784e8f144e9d5b4de => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:33.581260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae56cc3-9eb2-4d8f-8453-ef5a63a21916 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:33.581751 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae56cc3-9eb2-4d8f-8453-ef5a63a21916 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:33.582033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae56cc3-9eb2-4d8f-8453-ef5a63a21916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:33.600896 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1ae56cc3-9eb2-4d8f-8453-ef5a63a21916 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:33.602177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1ae56cc3-9eb2-4d8f-8453-ef5a63a21916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:33.662854 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1232/2432] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:33.673582 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abd18c-d064-4929-9c87-081c4c7a1c33 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:33.675086 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-95abd18c-d064-4929-9c87-081c4c7a1c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:33.735494 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abd18c-d064-4929-9c87-081c4c7a1c33 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:33.739147 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6092322-55e2-4d29-b8a6-710dd129dc8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:33.739826 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6092322-55e2-4d29-b8a6-710dd129dc8f service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:33.740100 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6092322-55e2-4d29-b8a6-710dd129dc8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:33.740379 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6092322-55e2-4d29-b8a6-710dd129dc8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:33.750966 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6092322-55e2-4d29-b8a6-710dd129dc8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:33.752435 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6092322-55e2-4d29-b8a6-710dd129dc8f service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:33.762928 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1201/2433] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:43:34.183987 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae56cc3-9eb2-4d8f-8453-ef5a63a21916 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:34.185551 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1ae56cc3-9eb2-4d8f-8453-ef5a63a21916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:34.198910 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae56cc3-9eb2-4d8f-8453-ef5a63a21916 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:34.203677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:34.204556 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:34.204835 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:34.205108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2 admin admin] PATH_INFO: `/v3/projects/4944e32e336d47a8b61e6a16eda5a5ed` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:34.206348 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4944e32e336d47a8b61e6a16eda5a5ed)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:34.208271 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:34.218250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:34.319582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4944e32e336d47a8b61e6a16eda5a5ed', 'request_id': 'req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:34.419513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4944e32e336d47a8b61e6a16eda5a5ed', 'request_id': 'req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:34.426723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4944e32e336d47a8b61e6a16eda5a5ed', 'request_id': 'req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:34.438532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2 admin admin] The token cache is being invalidate because project 4944e32e336d47a8b61e6a16eda5a5ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:43:34.438806 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:34.439470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:34.441019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1233/2434] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:43:34 2022] DELETE /identity/v3/projects/4944e32e336d47a8b61e6a16eda5a5ed => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:34.445263 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6092322-55e2-4d29-b8a6-710dd129dc8f service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:34.455968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6092322-55e2-4d29-b8a6-710dd129dc8f service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:34.491160 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:34.515689 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bf2b4-a9ac-4608-b05a-e1072639d580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:34.516574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bf2b4-a9ac-4608-b05a-e1072639d580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:34.516851 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bf2b4-a9ac-4608-b05a-e1072639d580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:34.517123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bf2b4-a9ac-4608-b05a-e1072639d580 admin admin] PATH_INFO: `/v3/users/6d7f0d8b0c1e4951a9bdd04f64c8639f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:34.518343 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bf2b4-a9ac-4608-b05a-e1072639d580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7f0d8b0c1e4951a9bdd04f64c8639f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:34.520262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bf2b4-a9ac-4608-b05a-e1072639d580 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:34.697763 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-cf4bf2b4-a9ac-4608-b05a-e1072639d580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7f0d8b0c1e4951a9bdd04f64c8639f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:34.710088 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-cf4bf2b4-a9ac-4608-b05a-e1072639d580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7f0d8b0c1e4951a9bdd04f64c8639f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:34.710805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-cf4bf2b4-a9ac-4608-b05a-e1072639d580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7f0d8b0c1e4951a9bdd04f64c8639f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:34.711414 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-cf4bf2b4-a9ac-4608-b05a-e1072639d580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7f0d8b0c1e4951a9bdd04f64c8639f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:34.718807 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-cf4bf2b4-a9ac-4608-b05a-e1072639d580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7f0d8b0c1e4951a9bdd04f64c8639f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:34.788017 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1202/2435] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:43:34 2022] DELETE /identity/v3/users/6d7f0d8b0c1e4951a9bdd04f64c8639f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:35.255398 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:35.256917 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:35.273696 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24a522-1ffe-4b24-ab2e-00a3b825e9f2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:35.333706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a66a13-0bcc-4da1-9f92-892bcfd2ba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:35.334571 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a66a13-0bcc-4da1-9f92-892bcfd2ba99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:35.334851 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a66a13-0bcc-4da1-9f92-892bcfd2ba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:35.335126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a66a13-0bcc-4da1-9f92-892bcfd2ba99 admin admin] PATH_INFO: `/v3/projects/ccb8d1a73bd4434c83c932752816e3a8` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:35.336325 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a66a13-0bcc-4da1-9f92-892bcfd2ba99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb8d1a73bd4434c83c932752816e3a8)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:35.338518 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a66a13-0bcc-4da1-9f92-892bcfd2ba99 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:35.448591 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-93a66a13-0bcc-4da1-9f92-892bcfd2ba99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb8d1a73bd4434c83c932752816e3a8', 'request_id': 'req-93a66a13-0bcc-4da1-9f92-892bcfd2ba99'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:35.507470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-93a66a13-0bcc-4da1-9f92-892bcfd2ba99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb8d1a73bd4434c83c932752816e3a8', 'request_id': 'req-93a66a13-0bcc-4da1-9f92-892bcfd2ba99'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:35.515086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-93a66a13-0bcc-4da1-9f92-892bcfd2ba99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb8d1a73bd4434c83c932752816e3a8', 'request_id': 'req-93a66a13-0bcc-4da1-9f92-892bcfd2ba99'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:35.525650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-93a66a13-0bcc-4da1-9f92-892bcfd2ba99 admin admin] The token cache is being invalidate because project ccb8d1a73bd4434c83c932752816e3a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:43:35.525935 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-93a66a13-0bcc-4da1-9f92-892bcfd2ba99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:35.526595 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-93a66a13-0bcc-4da1-9f92-892bcfd2ba99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:35.528139 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1234/2436] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:43:35 2022] DELETE /identity/v3/projects/ccb8d1a73bd4434c83c932752816e3a8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:35.533046 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66f06e-61d8-42a7-bcad-cf58a410b228 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:35.533555 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66f06e-61d8-42a7-bcad-cf58a410b228 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:35.537382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66f06e-61d8-42a7-bcad-cf58a410b228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:35.551778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-9c66f06e-61d8-42a7-bcad-cf58a410b228 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:35.552986 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9c66f06e-61d8-42a7-bcad-cf58a410b228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:35.614961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1203/2437] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:35.623774 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bf9f8-d847-4df2-9181-c8b561f6c964 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:35.624056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bf9f8-d847-4df2-9181-c8b561f6c964 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:35.624333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bf9f8-d847-4df2-9181-c8b561f6c964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:35.643926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9c8bf9f8-d847-4df2-9181-c8b561f6c964 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:35.645145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9c8bf9f8-d847-4df2-9181-c8b561f6c964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:35.653533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1235/2438] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:35.657841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66f06e-61d8-42a7-bcad-cf58a410b228 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:35.668844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66f06e-61d8-42a7-bcad-cf58a410b228 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:35.673507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64faa43e-84f0-455b-b92f-c03c3e3e96fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:35.674182 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faa43e-84f0-455b-b92f-c03c3e3e96fe admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:35.674461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faa43e-84f0-455b-b92f-c03c3e3e96fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:35.674737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faa43e-84f0-455b-b92f-c03c3e3e96fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:35.675458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64faa43e-84f0-455b-b92f-c03c3e3e96fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:43:35.675761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64faa43e-84f0-455b-b92f-c03c3e3e96fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:35.677421 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64faa43e-84f0-455b-b92f-c03c3e3e96fe admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:35.690912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1204/2439] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:43:35.695354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bf9f8-d847-4df2-9181-c8b561f6c964 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:35.705628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bf9f8-d847-4df2-9181-c8b561f6c964 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:35.710294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bb4f6-728b-44c0-833f-046fabdbb16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:35.710963 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bb4f6-728b-44c0-833f-046fabdbb16b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:35.711244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bb4f6-728b-44c0-833f-046fabdbb16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:35.711519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bb4f6-728b-44c0-833f-046fabdbb16b admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:35.712897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bb4f6-728b-44c0-833f-046fabdbb16b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:35.716020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bb4f6-728b-44c0-833f-046fabdbb16b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:35.793885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:35.801517 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1236/2440] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:43:35 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:43:35.811809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64faa43e-84f0-455b-b92f-c03c3e3e96fe admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:35.822413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64faa43e-84f0-455b-b92f-c03c3e3e96fe admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:35.865584 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:35.881572 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc40ad-a3c1-4c6e-9b76-542efd9cc76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:35.882254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc40ad-a3c1-4c6e-9b76-542efd9cc76f admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:35.882538 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc40ad-a3c1-4c6e-9b76-542efd9cc76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:35.882817 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc40ad-a3c1-4c6e-9b76-542efd9cc76f admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:35.883570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc40ad-a3c1-4c6e-9b76-542efd9cc76f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:35.886573 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc40ad-a3c1-4c6e-9b76-542efd9cc76f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:35.966337 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1205/2441] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:43:35 2022] POST /identity/v3/users => generated 301 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:43:35.970592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bb4f6-728b-44c0-833f-046fabdbb16b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:35.981680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bb4f6-728b-44c0-833f-046fabdbb16b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:35.986743 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90a03c-e6d8-4104-adc5-08beb52edb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:35.987418 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90a03c-e6d8-4104-adc5-08beb52edb17 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:35.987704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90a03c-e6d8-4104-adc5-08beb52edb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:35.987983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90a03c-e6d8-4104-adc5-08beb52edb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:35.988707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90a03c-e6d8-4104-adc5-08beb52edb17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:35.990345 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90a03c-e6d8-4104-adc5-08beb52edb17 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:36.001807 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1237/2442] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:43:36.006020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc40ad-a3c1-4c6e-9b76-542efd9cc76f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:36.016989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc40ad-a3c1-4c6e-9b76-542efd9cc76f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:36.021798 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25e30c-b762-4620-aaee-f0cbca974187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:36.022499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25e30c-b762-4620-aaee-f0cbca974187 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:36.022785 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25e30c-b762-4620-aaee-f0cbca974187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:36.023064 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25e30c-b762-4620-aaee-f0cbca974187 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:36.023818 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25e30c-b762-4620-aaee-f0cbca974187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:36.026336 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25e30c-b762-4620-aaee-f0cbca974187 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:36.037666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1206/2443] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:43:36.042269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90a03c-e6d8-4104-adc5-08beb52edb17 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:36.052655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90a03c-e6d8-4104-adc5-08beb52edb17 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:36.058358 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81f04e-2dfc-4010-80ac-4fc6de737732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:36.059262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81f04e-2dfc-4010-80ac-4fc6de737732 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:36.059550 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81f04e-2dfc-4010-80ac-4fc6de737732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:36.059834 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81f04e-2dfc-4010-80ac-4fc6de737732 admin admin] PATH_INFO: `/v3/projects/a873e4c9d33f4d2ea0bd16cfeaa5abe1/users/c6b011db232c4fdb961e2b608dc90277/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:36.076817 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81f04e-2dfc-4010-80ac-4fc6de737732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a873e4c9d33f4d2ea0bd16cfeaa5abe1, user_id=c6b011db232c4fdb961e2b608dc90277, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:36.079758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81f04e-2dfc-4010-80ac-4fc6de737732 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:36.165552 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1238/2444] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:43:36 2022] PUT /identity/v3/projects/a873e4c9d33f4d2ea0bd16cfeaa5abe1/users/c6b011db232c4fdb961e2b608dc90277/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:43:36.177230 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f7215-b964-4bfe-840c-19aa5d3cd01c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:36.177577 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f7215-b964-4bfe-840c-19aa5d3cd01c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:36.177910 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f7215-b964-4bfe-840c-19aa5d3cd01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:36.207403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b75f7215-b964-4bfe-840c-19aa5d3cd01c None None] MFA Rules not processed for user `c6b011db232c4fdb961e2b608dc90277`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:36.208630 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b75f7215-b964-4bfe-840c-19aa5d3cd01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:36.276450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1207/2445] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:36.281377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81f04e-2dfc-4010-80ac-4fc6de737732 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:36.345905 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81f04e-2dfc-4010-80ac-4fc6de737732 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:36.350671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643ae24-ace8-4fc3-89b9-6541cc758e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:36.351404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643ae24-ace8-4fc3-89b9-6541cc758e82 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:36.351634 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643ae24-ace8-4fc3-89b9-6541cc758e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:36.351891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643ae24-ace8-4fc3-89b9-6541cc758e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:36.352655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643ae24-ace8-4fc3-89b9-6541cc758e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:36.354691 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643ae24-ace8-4fc3-89b9-6541cc758e82 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:36.463401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1239/2446] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:43:36 2022] POST /identity/v3/projects => generated 401 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:43:36.467706 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f7215-b964-4bfe-840c-19aa5d3cd01c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:36.479829 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f7215-b964-4bfe-840c-19aa5d3cd01c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:36.538836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139ab98-6972-40ce-a469-592e0d8b3175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:36.539550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139ab98-6972-40ce-a469-592e0d8b3175 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:36.539776 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139ab98-6972-40ce-a469-592e0d8b3175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:36.540636 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139ab98-6972-40ce-a469-592e0d8b3175 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:36.541421 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139ab98-6972-40ce-a469-592e0d8b3175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:36.543394 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139ab98-6972-40ce-a469-592e0d8b3175 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:36.662088 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1208/2447] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:43:36 2022] POST /identity/v3/users => generated 307 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:43:36.666622 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643ae24-ace8-4fc3-89b9-6541cc758e82 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:36.677311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643ae24-ace8-4fc3-89b9-6541cc758e82 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:36.685393 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f3103-c1f0-4742-870c-c49f3f9ef1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:36.685393 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f3103-c1f0-4742-870c-c49f3f9ef1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:36.685393 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f3103-c1f0-4742-870c-c49f3f9ef1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:36.685393 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f3103-c1f0-4742-870c-c49f3f9ef1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:36.686368 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f3103-c1f0-4742-870c-c49f3f9ef1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:36.687069 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f3103-c1f0-4742-870c-c49f3f9ef1a0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:36.699378 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1240/2448] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:43:36.704132 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139ab98-6972-40ce-a469-592e0d8b3175 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:36.715078 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139ab98-6972-40ce-a469-592e0d8b3175 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:36.719760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a50086-6493-40a8-88be-638d31ae4c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:36.720650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a50086-6493-40a8-88be-638d31ae4c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:36.720934 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a50086-6493-40a8-88be-638d31ae4c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:36.721212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a50086-6493-40a8-88be-638d31ae4c48 admin admin] PATH_INFO: `/v3/projects/5a61aa952aab44808b30b0e684324363/users/6253a951181242d6810114a011c8fe6f/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:36.736832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a50086-6493-40a8-88be-638d31ae4c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a61aa952aab44808b30b0e684324363, user_id=6253a951181242d6810114a011c8fe6f, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:36.739557 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a50086-6493-40a8-88be-638d31ae4c48 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:36.802493 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1209/2449] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:43:36 2022] PUT /identity/v3/projects/5a61aa952aab44808b30b0e684324363/users/6253a951181242d6810114a011c8fe6f/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:36.807246 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f3103-c1f0-4742-870c-c49f3f9ef1a0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:36.817478 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f3103-c1f0-4742-870c-c49f3f9ef1a0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:36.874930 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaa082-67be-4b7b-913f-729bed0d6223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:36.875583 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaa082-67be-4b7b-913f-729bed0d6223 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:36.875867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaa082-67be-4b7b-913f-729bed0d6223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:36.876138 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaa082-67be-4b7b-913f-729bed0d6223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:36.876865 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaa082-67be-4b7b-913f-729bed0d6223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:36.878504 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaa082-67be-4b7b-913f-729bed0d6223 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:36.892866 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1241/2450] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:43:36.894138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a50086-6493-40a8-88be-638d31ae4c48 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:36.905072 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a50086-6493-40a8-88be-638d31ae4c48 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:36.911987 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a676d-cbf4-413a-908b-208d74c35924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:36.912935 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a676d-cbf4-413a-908b-208d74c35924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:36.913159 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a676d-cbf4-413a-908b-208d74c35924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:36.913471 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a676d-cbf4-413a-908b-208d74c35924 admin admin] PATH_INFO: `/v3/projects/5a61aa952aab44808b30b0e684324363/users/6253a951181242d6810114a011c8fe6f/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:36.915681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a676d-cbf4-413a-908b-208d74c35924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a61aa952aab44808b30b0e684324363, user_id=6253a951181242d6810114a011c8fe6f, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:36.918431 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a676d-cbf4-413a-908b-208d74c35924 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:36.929582 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1210/2451] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:43:36 2022] PUT /identity/v3/projects/5a61aa952aab44808b30b0e684324363/users/6253a951181242d6810114a011c8fe6f/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:36.940736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026ec7d-78db-4a93-a3b1-bb81255ff044 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:36.941019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026ec7d-78db-4a93-a3b1-bb81255ff044 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:36.941296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026ec7d-78db-4a93-a3b1-bb81255ff044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:36.970101 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c026ec7d-78db-4a93-a3b1-bb81255ff044 None None] MFA Rules not processed for user `6253a951181242d6810114a011c8fe6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:36.971398 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c026ec7d-78db-4a93-a3b1-bb81255ff044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:36.992693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:37.043128 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1242/2452] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:37.054250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a676d-cbf4-413a-908b-208d74c35924 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:37.056643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-252a676d-cbf4-413a-908b-208d74c35924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:37.063459 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:37.120704 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a676d-cbf4-413a-908b-208d74c35924 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:37.124436 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af43620-2a84-46e9-a417-fcab6292b253 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:37.125112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af43620-2a84-46e9-a417-fcab6292b253 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:37.125409 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af43620-2a84-46e9-a417-fcab6292b253 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:37.125688 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af43620-2a84-46e9-a417-fcab6292b253 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:37.136310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af43620-2a84-46e9-a417-fcab6292b253 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:37.137801 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af43620-2a84-46e9-a417-fcab6292b253 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:37.148147 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1211/2453] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:43:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:43:37.402200 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026ec7d-78db-4a93-a3b1-bb81255ff044 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:37.411833 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026ec7d-78db-4a93-a3b1-bb81255ff044 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:37.416052 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36a50f-a817-420c-9b8c-a066dcd350dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:37.420251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36a50f-a817-420c-9b8c-a066dcd350dd service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:37.420251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36a50f-a817-420c-9b8c-a066dcd350dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:37.420251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36a50f-a817-420c-9b8c-a066dcd350dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:37.474515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36a50f-a817-420c-9b8c-a066dcd350dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:37.475955 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36a50f-a817-420c-9b8c-a066dcd350dd service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:37.485793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1243/2454] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:43:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:43:43.664671 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af43620-2a84-46e9-a417-fcab6292b253 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:43.729879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af43620-2a84-46e9-a417-fcab6292b253 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:43.735095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac017bef-78e7-451a-83b6-25f565f3f65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:43.735973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017bef-78e7-451a-83b6-25f565f3f65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:43.736280 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017bef-78e7-451a-83b6-25f565f3f65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:43.736555 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017bef-78e7-451a-83b6-25f565f3f65d admin admin] PATH_INFO: `/v3/users/c6b011db232c4fdb961e2b608dc90277` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:43.737790 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac017bef-78e7-451a-83b6-25f565f3f65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6b011db232c4fdb961e2b608dc90277)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:43.739773 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac017bef-78e7-451a-83b6-25f565f3f65d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:43.953628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ac017bef-78e7-451a-83b6-25f565f3f65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6b011db232c4fdb961e2b608dc90277'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:43.966420 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ac017bef-78e7-451a-83b6-25f565f3f65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6b011db232c4fdb961e2b608dc90277'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:43.967144 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ac017bef-78e7-451a-83b6-25f565f3f65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6b011db232c4fdb961e2b608dc90277'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:43.967745 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ac017bef-78e7-451a-83b6-25f565f3f65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6b011db232c4fdb961e2b608dc90277'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:43.976760 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ac017bef-78e7-451a-83b6-25f565f3f65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6b011db232c4fdb961e2b608dc90277'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:44.042575 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1212/2455] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:43:43 2022] DELETE /identity/v3/users/c6b011db232c4fdb961e2b608dc90277 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:44.047418 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58647f-e3f9-43a5-8618-015515c1f8f7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:44.047888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58647f-e3f9-43a5-8618-015515c1f8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:44.048017 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58647f-e3f9-43a5-8618-015515c1f8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:44.066526 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2f58647f-e3f9-43a5-8618-015515c1f8f7 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:44.067728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2f58647f-e3f9-43a5-8618-015515c1f8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:44.137544 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1244/2456] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:44.147237 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac017bef-78e7-451a-83b6-25f565f3f65d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:44.153984 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ac017bef-78e7-451a-83b6-25f565f3f65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:44.181108 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:44.208397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac017bef-78e7-451a-83b6-25f565f3f65d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:44.215556 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7830b5-2cf5-4f15-8a01-eaee547c1069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:44.220083 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7830b5-2cf5-4f15-8a01-eaee547c1069 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:44.220083 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7830b5-2cf5-4f15-8a01-eaee547c1069 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:44.220083 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7830b5-2cf5-4f15-8a01-eaee547c1069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:44.226778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7830b5-2cf5-4f15-8a01-eaee547c1069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:44.228232 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7830b5-2cf5-4f15-8a01-eaee547c1069 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:44.238505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1213/2457] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:43:44.620500 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58647f-e3f9-43a5-8618-015515c1f8f7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:44.623052 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2f58647f-e3f9-43a5-8618-015515c1f8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:44.638564 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58647f-e3f9-43a5-8618-015515c1f8f7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:44.643423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:44.647796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:44.647796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:44.647796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3 admin admin] PATH_INFO: `/v3/projects/a873e4c9d33f4d2ea0bd16cfeaa5abe1` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:44.647796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a873e4c9d33f4d2ea0bd16cfeaa5abe1)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:44.648926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:44.791548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a873e4c9d33f4d2ea0bd16cfeaa5abe1', 'request_id': 'req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:44.794267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:44.878225 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a873e4c9d33f4d2ea0bd16cfeaa5abe1', 'request_id': 'req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:44.884988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a873e4c9d33f4d2ea0bd16cfeaa5abe1', 'request_id': 'req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:44.896270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3 admin admin] The token cache is being invalidate because project a873e4c9d33f4d2ea0bd16cfeaa5abe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:43:44.896556 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:44.897200 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:44.898783 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1245/2458] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:43:44 2022] DELETE /identity/v3/projects/a873e4c9d33f4d2ea0bd16cfeaa5abe1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:44.903164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7830b5-2cf5-4f15-8a01-eaee547c1069 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:44.912959 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7830b5-2cf5-4f15-8a01-eaee547c1069 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:44.970898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fa217-fc97-42ab-978c-83659a11c802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:44.971723 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fa217-fc97-42ab-978c-83659a11c802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:44.972007 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fa217-fc97-42ab-978c-83659a11c802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:44.972281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fa217-fc97-42ab-978c-83659a11c802 admin admin] PATH_INFO: `/v3/users/6253a951181242d6810114a011c8fe6f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:44.973513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fa217-fc97-42ab-978c-83659a11c802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6253a951181242d6810114a011c8fe6f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:44.975460 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fa217-fc97-42ab-978c-83659a11c802 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:45.172740 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e61fa217-fc97-42ab-978c-83659a11c802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6253a951181242d6810114a011c8fe6f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:45.186069 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e61fa217-fc97-42ab-978c-83659a11c802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6253a951181242d6810114a011c8fe6f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:45.186814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e61fa217-fc97-42ab-978c-83659a11c802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6253a951181242d6810114a011c8fe6f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:45.187563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e61fa217-fc97-42ab-978c-83659a11c802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6253a951181242d6810114a011c8fe6f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:45.195527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e61fa217-fc97-42ab-978c-83659a11c802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6253a951181242d6810114a011c8fe6f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:45.296624 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1214/2459] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:43:44 2022] DELETE /identity/v3/users/6253a951181242d6810114a011c8fe6f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:45.724401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:45.726022 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:45.743054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a4953-cbba-4786-b0f5-2e7baf957eb3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:45.807957 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a56392-c660-4032-be46-646ee2e5357b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:45.809466 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a56392-c660-4032-be46-646ee2e5357b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:45.809745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a56392-c660-4032-be46-646ee2e5357b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:45.810018 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a56392-c660-4032-be46-646ee2e5357b admin admin] PATH_INFO: `/v3/projects/5a61aa952aab44808b30b0e684324363` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:45.811249 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a56392-c660-4032-be46-646ee2e5357b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a61aa952aab44808b30b0e684324363)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:45.813260 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a56392-c660-4032-be46-646ee2e5357b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:45.907461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b0a56392-c660-4032-be46-646ee2e5357b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a61aa952aab44808b30b0e684324363', 'request_id': 'req-b0a56392-c660-4032-be46-646ee2e5357b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:45.978740 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b0a56392-c660-4032-be46-646ee2e5357b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a61aa952aab44808b30b0e684324363', 'request_id': 'req-b0a56392-c660-4032-be46-646ee2e5357b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:45.987528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b0a56392-c660-4032-be46-646ee2e5357b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a61aa952aab44808b30b0e684324363', 'request_id': 'req-b0a56392-c660-4032-be46-646ee2e5357b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:46.000147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b0a56392-c660-4032-be46-646ee2e5357b admin admin] The token cache is being invalidate because project 5a61aa952aab44808b30b0e684324363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:43:46.000434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b0a56392-c660-4032-be46-646ee2e5357b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:46.001146 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b0a56392-c660-4032-be46-646ee2e5357b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:46.002898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1246/2460] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:43:45 2022] DELETE /identity/v3/projects/5a61aa952aab44808b30b0e684324363 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:46.007841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f580b64-5431-45ec-8345-ea973aefe5af None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:46.008706 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f580b64-5431-45ec-8345-ea973aefe5af None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:46.008706 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f580b64-5431-45ec-8345-ea973aefe5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:46.028438 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3f580b64-5431-45ec-8345-ea973aefe5af None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:46.029686 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3f580b64-5431-45ec-8345-ea973aefe5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:46.074954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:46.095138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1215/2461] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:46.103616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1be48-0c0d-4a31-afa3-4925f4dc5654 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:46.103891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1be48-0c0d-4a31-afa3-4925f4dc5654 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:46.104172 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1be48-0c0d-4a31-afa3-4925f4dc5654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:46.125510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-12b1be48-0c0d-4a31-afa3-4925f4dc5654 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:46.127706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-12b1be48-0c0d-4a31-afa3-4925f4dc5654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:46.140172 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1247/2462] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:46.145668 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f580b64-5431-45ec-8345-ea973aefe5af None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:46.156790 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f580b64-5431-45ec-8345-ea973aefe5af None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:46.162007 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e516cc0-2e91-4897-8d07-541114e9a509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:46.162681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e516cc0-2e91-4897-8d07-541114e9a509 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:46.162995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e516cc0-2e91-4897-8d07-541114e9a509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:46.163273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e516cc0-2e91-4897-8d07-541114e9a509 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:46.164026 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e516cc0-2e91-4897-8d07-541114e9a509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:43:46.164330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e516cc0-2e91-4897-8d07-541114e9a509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:46.166160 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e516cc0-2e91-4897-8d07-541114e9a509 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:46.182553 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1216/2463] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:43:46.185120 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1be48-0c0d-4a31-afa3-4925f4dc5654 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:46.195036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1be48-0c0d-4a31-afa3-4925f4dc5654 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:46.201385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1886b8-5fd8-4a94-823f-753ebf8ed967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:46.202137 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1886b8-5fd8-4a94-823f-753ebf8ed967 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:46.202415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1886b8-5fd8-4a94-823f-753ebf8ed967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:46.202689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1886b8-5fd8-4a94-823f-753ebf8ed967 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:46.203398 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1886b8-5fd8-4a94-823f-753ebf8ed967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:46.205355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1886b8-5fd8-4a94-823f-753ebf8ed967 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:46.294377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1248/2464] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:43:46 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:43:46.298903 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e516cc0-2e91-4897-8d07-541114e9a509 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:46.310897 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e516cc0-2e91-4897-8d07-541114e9a509 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:46.373847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffd107-f8e9-4e4a-867a-3ca6353937f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:46.374543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffd107-f8e9-4e4a-867a-3ca6353937f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:46.374825 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffd107-f8e9-4e4a-867a-3ca6353937f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:46.375097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffd107-f8e9-4e4a-867a-3ca6353937f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:46.375791 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffd107-f8e9-4e4a-867a-3ca6353937f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:46.377779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffd107-f8e9-4e4a-867a-3ca6353937f7 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:46.523620 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1217/2465] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:43:46 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:43:46.525353 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1886b8-5fd8-4a94-823f-753ebf8ed967 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:46.538261 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1886b8-5fd8-4a94-823f-753ebf8ed967 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:46.546333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c411055-77dc-4873-984c-891e9115bd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:46.547556 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c411055-77dc-4873-984c-891e9115bd28 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:46.548078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c411055-77dc-4873-984c-891e9115bd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:46.548522 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c411055-77dc-4873-984c-891e9115bd28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:46.549553 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c411055-77dc-4873-984c-891e9115bd28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:46.551822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c411055-77dc-4873-984c-891e9115bd28 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:46.576090 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1249/2466] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:43:46.577094 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffd107-f8e9-4e4a-867a-3ca6353937f7 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:46.588379 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffd107-f8e9-4e4a-867a-3ca6353937f7 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:46.597249 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c599dd5-5663-48aa-ace1-58f5b5aefb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:46.598184 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c599dd5-5663-48aa-ace1-58f5b5aefb49 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:46.598471 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c599dd5-5663-48aa-ace1-58f5b5aefb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:46.598747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c599dd5-5663-48aa-ace1-58f5b5aefb49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:46.599488 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c599dd5-5663-48aa-ace1-58f5b5aefb49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:46.601310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c599dd5-5663-48aa-ace1-58f5b5aefb49 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:46.619511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1218/2467] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:43:46.621107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c411055-77dc-4873-984c-891e9115bd28 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:46.631498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c411055-77dc-4873-984c-891e9115bd28 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:46.638016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d24f1-3a5e-43f9-a0e4-d4a757745567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:46.639236 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d24f1-3a5e-43f9-a0e4-d4a757745567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:46.639816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d24f1-3a5e-43f9-a0e4-d4a757745567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:46.640194 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d24f1-3a5e-43f9-a0e4-d4a757745567 admin admin] PATH_INFO: `/v3/projects/98f49bc85d934190bd38fa0372efd56c/users/cd2cd1f2da7341e2bacbee1ff8da66b0/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:46.666815 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d24f1-3a5e-43f9-a0e4-d4a757745567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f49bc85d934190bd38fa0372efd56c, user_id=cd2cd1f2da7341e2bacbee1ff8da66b0, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:46.670446 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d24f1-3a5e-43f9-a0e4-d4a757745567 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:46.737529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1250/2468] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:43:46 2022] PUT /identity/v3/projects/98f49bc85d934190bd38fa0372efd56c/users/cd2cd1f2da7341e2bacbee1ff8da66b0/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:46.749705 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64760ef8-1309-46a8-a9f2-d047bd15105f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:46.749997 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64760ef8-1309-46a8-a9f2-d047bd15105f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:46.750276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64760ef8-1309-46a8-a9f2-d047bd15105f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:46.780544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-64760ef8-1309-46a8-a9f2-d047bd15105f None None] MFA Rules not processed for user `cd2cd1f2da7341e2bacbee1ff8da66b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:46.781865 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-64760ef8-1309-46a8-a9f2-d047bd15105f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:46.852626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1219/2469] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:46.864960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d24f1-3a5e-43f9-a0e4-d4a757745567 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:46.866688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a53d24f1-3a5e-43f9-a0e4-d4a757745567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:46.877015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:46.932891 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d24f1-3a5e-43f9-a0e4-d4a757745567 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:46.937378 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4bb28-837f-47b8-9847-e701ba1278ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:46.938041 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4bb28-837f-47b8-9847-e701ba1278ba service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:46.938326 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4bb28-837f-47b8-9847-e701ba1278ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:46.938604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4bb28-837f-47b8-9847-e701ba1278ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:46.947805 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4bb28-837f-47b8-9847-e701ba1278ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:46.949936 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4bb28-837f-47b8-9847-e701ba1278ba service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:46.962587 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1251/2470] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:43:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:43:46.984836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64760ef8-1309-46a8-a9f2-d047bd15105f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:47.042870 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:47.061587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64760ef8-1309-46a8-a9f2-d047bd15105f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:47.066220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e17a26-09d5-4e37-bc46-764a3e8bbb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:47.067134 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e17a26-09d5-4e37-bc46-764a3e8bbb3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:47.067418 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e17a26-09d5-4e37-bc46-764a3e8bbb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:47.067686 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e17a26-09d5-4e37-bc46-764a3e8bbb3f admin admin] PATH_INFO: `/v3/users/cd2cd1f2da7341e2bacbee1ff8da66b0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:47.068893 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e17a26-09d5-4e37-bc46-764a3e8bbb3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2cd1f2da7341e2bacbee1ff8da66b0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:47.070921 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e17a26-09d5-4e37-bc46-764a3e8bbb3f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:47.236708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-57e17a26-09d5-4e37-bc46-764a3e8bbb3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2cd1f2da7341e2bacbee1ff8da66b0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:47.250781 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-57e17a26-09d5-4e37-bc46-764a3e8bbb3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2cd1f2da7341e2bacbee1ff8da66b0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:47.251626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-57e17a26-09d5-4e37-bc46-764a3e8bbb3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2cd1f2da7341e2bacbee1ff8da66b0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:47.252241 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-57e17a26-09d5-4e37-bc46-764a3e8bbb3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2cd1f2da7341e2bacbee1ff8da66b0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:47.260087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-57e17a26-09d5-4e37-bc46-764a3e8bbb3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2cd1f2da7341e2bacbee1ff8da66b0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:47.327862 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1220/2471] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:43:46 2022] DELETE /identity/v3/users/cd2cd1f2da7341e2bacbee1ff8da66b0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:47.332754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2767773-b71f-451a-8abb-6f17675a0651 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:47.333163 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2767773-b71f-451a-8abb-6f17675a0651 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:47.333570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2767773-b71f-451a-8abb-6f17675a0651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:47.355872 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a2767773-b71f-451a-8abb-6f17675a0651 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:47.357580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a2767773-b71f-451a-8abb-6f17675a0651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:47.423045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1252/2472] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:47.437277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e17a26-09d5-4e37-bc46-764a3e8bbb3f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:47.438777 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-57e17a26-09d5-4e37-bc46-764a3e8bbb3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:47.505763 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e17a26-09d5-4e37-bc46-764a3e8bbb3f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:47.512624 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33f337-77a7-4a7f-95ca-a546582b9c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:47.513301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33f337-77a7-4a7f-95ca-a546582b9c9b service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:47.513621 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33f337-77a7-4a7f-95ca-a546582b9c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:47.514248 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33f337-77a7-4a7f-95ca-a546582b9c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:47.540139 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33f337-77a7-4a7f-95ca-a546582b9c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:47.542332 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33f337-77a7-4a7f-95ca-a546582b9c9b service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:47.561082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1221/2473] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:43:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:43:48.006318 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2767773-b71f-451a-8abb-6f17675a0651 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:48.007829 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a2767773-b71f-451a-8abb-6f17675a0651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:48.023509 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2767773-b71f-451a-8abb-6f17675a0651 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:48.033167 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313d950-5268-488f-9705-22b6ea2ee285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:48.033167 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313d950-5268-488f-9705-22b6ea2ee285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:48.033611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313d950-5268-488f-9705-22b6ea2ee285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:48.033860 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313d950-5268-488f-9705-22b6ea2ee285 admin admin] PATH_INFO: `/v3/projects/98f49bc85d934190bd38fa0372efd56c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:48.035099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313d950-5268-488f-9705-22b6ea2ee285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98f49bc85d934190bd38fa0372efd56c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:48.037062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313d950-5268-488f-9705-22b6ea2ee285 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:48.133963 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2313d950-5268-488f-9705-22b6ea2ee285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98f49bc85d934190bd38fa0372efd56c', 'request_id': 'req-2313d950-5268-488f-9705-22b6ea2ee285'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:48.201899 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2313d950-5268-488f-9705-22b6ea2ee285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98f49bc85d934190bd38fa0372efd56c', 'request_id': 'req-2313d950-5268-488f-9705-22b6ea2ee285'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:48.209055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2313d950-5268-488f-9705-22b6ea2ee285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98f49bc85d934190bd38fa0372efd56c', 'request_id': 'req-2313d950-5268-488f-9705-22b6ea2ee285'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:48.220974 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2313d950-5268-488f-9705-22b6ea2ee285 admin admin] The token cache is being invalidate because project 98f49bc85d934190bd38fa0372efd56c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:43:48.221251 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2313d950-5268-488f-9705-22b6ea2ee285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:48.221949 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2313d950-5268-488f-9705-22b6ea2ee285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:43:48.223596 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1253/2474] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:43:48 2022] DELETE /identity/v3/projects/98f49bc85d934190bd38fa0372efd56c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:48.228489 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340a40c-48d9-4822-95a2-0d0085085000 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:48.229001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340a40c-48d9-4822-95a2-0d0085085000 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:48.229099 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340a40c-48d9-4822-95a2-0d0085085000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:48.247773 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f340a40c-48d9-4822-95a2-0d0085085000 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:48.249022 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f340a40c-48d9-4822-95a2-0d0085085000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:48.309831 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1222/2475] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:48.317588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7b5f0-5669-4ad8-8112-3d298f9a2ae0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:48.317923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7b5f0-5669-4ad8-8112-3d298f9a2ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:48.318147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7b5f0-5669-4ad8-8112-3d298f9a2ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:48.337355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-44c7b5f0-5669-4ad8-8112-3d298f9a2ae0 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:48.338604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-44c7b5f0-5669-4ad8-8112-3d298f9a2ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:48.347495 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1254/2476] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:48.351861 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340a40c-48d9-4822-95a2-0d0085085000 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:48.362874 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340a40c-48d9-4822-95a2-0d0085085000 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:48.367477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c7522-dcde-4bb2-9dc1-42ad4ed16080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:48.368131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c7522-dcde-4bb2-9dc1-42ad4ed16080 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:48.368411 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c7522-dcde-4bb2-9dc1-42ad4ed16080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:48.368687 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c7522-dcde-4bb2-9dc1-42ad4ed16080 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:48.369445 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c7522-dcde-4bb2-9dc1-42ad4ed16080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:43:48.369753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c7522-dcde-4bb2-9dc1-42ad4ed16080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:48.371367 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c7522-dcde-4bb2-9dc1-42ad4ed16080 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:48.372933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:48.383500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1223/2477] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:43:48.388124 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7b5f0-5669-4ad8-8112-3d298f9a2ae0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:48.398017 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7b5f0-5669-4ad8-8112-3d298f9a2ae0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:48.403385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36aa69d-b263-4d1b-bd24-adaedd3d5ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:48.404052 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aa69d-b263-4d1b-bd24-adaedd3d5ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:48.404338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aa69d-b263-4d1b-bd24-adaedd3d5ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:48.404617 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aa69d-b263-4d1b-bd24-adaedd3d5ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:48.405340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36aa69d-b263-4d1b-bd24-adaedd3d5ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:48.407259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36aa69d-b263-4d1b-bd24-adaedd3d5ef0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:48.486849 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1255/2478] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:43:48 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:43:48.491176 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c7522-dcde-4bb2-9dc1-42ad4ed16080 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:48.501514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c7522-dcde-4bb2-9dc1-42ad4ed16080 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:48.558370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf68306-09fd-4fe4-aa93-24dea22054d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:48.559143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf68306-09fd-4fe4-aa93-24dea22054d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:48.559420 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf68306-09fd-4fe4-aa93-24dea22054d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:48.559696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf68306-09fd-4fe4-aa93-24dea22054d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:48.560394 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf68306-09fd-4fe4-aa93-24dea22054d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:48.562462 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf68306-09fd-4fe4-aa93-24dea22054d0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:48.642696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1224/2479] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:43:48 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:43:48.647602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36aa69d-b263-4d1b-bd24-adaedd3d5ef0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:48.654975 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:48.658498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36aa69d-b263-4d1b-bd24-adaedd3d5ef0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:48.666546 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382f624-7b80-4cdc-b06f-621d232d5d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:48.667257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382f624-7b80-4cdc-b06f-621d232d5d31 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:48.667542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382f624-7b80-4cdc-b06f-621d232d5d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:48.668465 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382f624-7b80-4cdc-b06f-621d232d5d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:48.669215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382f624-7b80-4cdc-b06f-621d232d5d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:48.670895 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382f624-7b80-4cdc-b06f-621d232d5d31 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:48.683249 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1256/2480] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:43:48.687442 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf68306-09fd-4fe4-aa93-24dea22054d0 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:48.697990 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf68306-09fd-4fe4-aa93-24dea22054d0 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:48.703625 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e58fc-981c-4b77-b064-377408fcca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:48.704338 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e58fc-981c-4b77-b064-377408fcca20 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:48.704626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e58fc-981c-4b77-b064-377408fcca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:48.704903 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e58fc-981c-4b77-b064-377408fcca20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:48.705764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e58fc-981c-4b77-b064-377408fcca20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:48.707384 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e58fc-981c-4b77-b064-377408fcca20 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:48.719806 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1225/2481] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:43:48.723505 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382f624-7b80-4cdc-b06f-621d232d5d31 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:48.734915 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382f624-7b80-4cdc-b06f-621d232d5d31 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:48.739702 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211694c6-c0ed-4f03-ac37-5a9ed4729aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:48.740597 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211694c6-c0ed-4f03-ac37-5a9ed4729aac admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:48.740878 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211694c6-c0ed-4f03-ac37-5a9ed4729aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:48.741182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211694c6-c0ed-4f03-ac37-5a9ed4729aac admin admin] PATH_INFO: `/v3/projects/5fe594d24d9843acbec2e846c98c14ae/users/8be176511fa34aa6aa5fe83bc6a2b163/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:48.756683 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211694c6-c0ed-4f03-ac37-5a9ed4729aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe594d24d9843acbec2e846c98c14ae, user_id=8be176511fa34aa6aa5fe83bc6a2b163, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:48.759400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211694c6-c0ed-4f03-ac37-5a9ed4729aac admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:48.831417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1257/2482] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:43:48 2022] PUT /identity/v3/projects/5fe594d24d9843acbec2e846c98c14ae/users/8be176511fa34aa6aa5fe83bc6a2b163/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:43:48.837032 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c8b70-4135-4ef3-8f95-32015e7d5bcd None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:48.837342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c8b70-4135-4ef3-8f95-32015e7d5bcd None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:48.837640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c8b70-4135-4ef3-8f95-32015e7d5bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:48.856892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f03c8b70-4135-4ef3-8f95-32015e7d5bcd None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:48.858416 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f03c8b70-4135-4ef3-8f95-32015e7d5bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:48.921532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1226/2483] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:48.931224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211694c6-c0ed-4f03-ac37-5a9ed4729aac admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:48.932979 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-211694c6-c0ed-4f03-ac37-5a9ed4729aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:48.994584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211694c6-c0ed-4f03-ac37-5a9ed4729aac admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:48.999714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c574c1-f3dd-434b-b4e5-6fd456b8374c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:49.001723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c574c1-f3dd-434b-b4e5-6fd456b8374c service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:49.001723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c574c1-f3dd-434b-b4e5-6fd456b8374c service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:49.001723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c574c1-f3dd-434b-b4e5-6fd456b8374c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:49.013237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c574c1-f3dd-434b-b4e5-6fd456b8374c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:49.017685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c574c1-f3dd-434b-b4e5-6fd456b8374c service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:49.031698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1258/2484] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:43:50.503378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61b86-1db6-421b-9ea3-c974115a3388 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:50.503944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61b86-1db6-421b-9ea3-c974115a3388 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:50.503944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61b86-1db6-421b-9ea3-c974115a3388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:50.536396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6bc61b86-1db6-421b-9ea3-c974115a3388 None None] MFA Rules not processed for user `8be176511fa34aa6aa5fe83bc6a2b163`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:50.537662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6bc61b86-1db6-421b-9ea3-c974115a3388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:50.608610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1227/2485] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:43:50.619443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c574c1-f3dd-434b-b4e5-6fd456b8374c service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:43:50.621778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-85c574c1-f3dd-434b-b4e5-6fd456b8374c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:50.681793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c574c1-f3dd-434b-b4e5-6fd456b8374c service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:43:50.686549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ffabe-ca3b-4d87-9f8c-1ab07bb42b4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:43:50.687203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ffabe-ca3b-4d87-9f8c-1ab07bb42b4f service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:50.687481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ffabe-ca3b-4d87-9f8c-1ab07bb42b4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:50.687755 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ffabe-ca3b-4d87-9f8c-1ab07bb42b4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:50.696595 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ffabe-ca3b-4d87-9f8c-1ab07bb42b4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:43:50.698006 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ffabe-ca3b-4d87-9f8c-1ab07bb42b4f service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:43:50.708705 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1259/2486] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:43:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:43:51.995425 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dc455-e5a2-4035-bae4-69e0cfae45b7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:51.997021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dc455-e5a2-4035-bae4-69e0cfae45b7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:51.997021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dc455-e5a2-4035-bae4-69e0cfae45b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:52.002506 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:52.014776 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a18dc455-e5a2-4035-bae4-69e0cfae45b7 None None] MFA Rules not processed for user `c9c07cf08d9c45479f9530efe9dcad2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:52.016031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a18dc455-e5a2-4035-bae4-69e0cfae45b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:52.073596 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1228/2487] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:43:53.514133 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ff870-0924-46d1-9f44-138139f1cf3b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:43:53.514933 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ff870-0924-46d1-9f44-138139f1cf3b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:43:53.514933 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ff870-0924-46d1-9f44-138139f1cf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:43:53.533074 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a34ff870-0924-46d1-9f44-138139f1cf3b None None] MFA Rules not processed for user `8be176511fa34aa6aa5fe83bc6a2b163`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:43:53.534486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a34ff870-0924-46d1-9f44-138139f1cf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:43:53.541462 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1260/2488] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:43:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:44:02.087158 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=24 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:03.527749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=68,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:15.715244 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a1731-d6cd-484f-b524-2d9ccd21142f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:44:15.715835 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a1731-d6cd-484f-b524-2d9ccd21142f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:44:15.715835 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a1731-d6cd-484f-b524-2d9ccd21142f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:44:15.734644 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-fd7a1731-d6cd-484f-b524-2d9ccd21142f None None] MFA Rules not processed for user `8be176511fa34aa6aa5fe83bc6a2b163`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:44:15.735825 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fd7a1731-d6cd-484f-b524-2d9ccd21142f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:44:15.743336 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1229/2489] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:44:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:44:24.446611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ff870-0924-46d1-9f44-138139f1cf3b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:44:24.448045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a34ff870-0924-46d1-9f44-138139f1cf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:44:24.460187 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ff870-0924-46d1-9f44-138139f1cf3b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:44:24.463984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59cc788-d9b1-4e43-a41c-8ce04e4014d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:44:24.466566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cc788-d9b1-4e43-a41c-8ce04e4014d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:44:24.466566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cc788-d9b1-4e43-a41c-8ce04e4014d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:44:24.466566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cc788-d9b1-4e43-a41c-8ce04e4014d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:44:24.467075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f59cc788-d9b1-4e43-a41c-8ce04e4014d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:44:24.537385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59cc788-d9b1-4e43-a41c-8ce04e4014d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:44:24.538859 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59cc788-d9b1-4e43-a41c-8ce04e4014d0 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:44:24.549821 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1261/2490] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:44:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:44:25.726053 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a1731-d6cd-484f-b524-2d9ccd21142f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:44:25.736060 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a1731-d6cd-484f-b524-2d9ccd21142f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:44:25.739578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e06cbe-ff37-42a5-9eab-b7f1cea95241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:44:25.740207 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e06cbe-ff37-42a5-9eab-b7f1cea95241 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:44:25.740486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e06cbe-ff37-42a5-9eab-b7f1cea95241 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:44:25.740758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e06cbe-ff37-42a5-9eab-b7f1cea95241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:44:25.742799 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d9e06cbe-ff37-42a5-9eab-b7f1cea95241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:44:25.755723 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e06cbe-ff37-42a5-9eab-b7f1cea95241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:44:25.757710 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e06cbe-ff37-42a5-9eab-b7f1cea95241 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:44:25.769213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1230/2491] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:44:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:44:26.974451 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0d8b2-d00b-4c72-be50-c53bfcbea2a0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:44:26.978429 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0d8b2-d00b-4c72-be50-c53bfcbea2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:44:26.978429 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0d8b2-d00b-4c72-be50-c53bfcbea2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:44:26.994573 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a8a0d8b2-d00b-4c72-be50-c53bfcbea2a0 None None] MFA Rules not processed for user `781e29f49f27417a96cfc4ba00af95dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:44:26.995840 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a8a0d8b2-d00b-4c72-be50-c53bfcbea2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:44:27.064538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1262/2492] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:44:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:44:35.417839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e06cbe-ff37-42a5-9eab-b7f1cea95241 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:44:35.426679 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e06cbe-ff37-42a5-9eab-b7f1cea95241 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:44:35.430361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd10dda-fa98-4ee5-a16c-eb3f851a336b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:44:35.431712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd10dda-fa98-4ee5-a16c-eb3f851a336b service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:44:35.431998 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd10dda-fa98-4ee5-a16c-eb3f851a336b service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:44:35.432281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd10dda-fa98-4ee5-a16c-eb3f851a336b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:44:35.434209 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3cd10dda-fa98-4ee5-a16c-eb3f851a336b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:44:35.501441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd10dda-fa98-4ee5-a16c-eb3f851a336b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:44:35.502925 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd10dda-fa98-4ee5-a16c-eb3f851a336b service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:44:35.512641 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1231/2493] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:44:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:44:37.051860 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=59 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:38.170396 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0d8b2-d00b-4c72-be50-c53bfcbea2a0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:44:38.185426 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0d8b2-d00b-4c72-be50-c53bfcbea2a0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:44:38.191936 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc2efa-d6a9-467e-a961-4f6bf8f9a6c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:44:38.191936 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc2efa-d6a9-467e-a961-4f6bf8f9a6c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:44:38.191936 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc2efa-d6a9-467e-a961-4f6bf8f9a6c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:44:38.191936 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc2efa-d6a9-467e-a961-4f6bf8f9a6c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:44:38.193304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c0fc2efa-d6a9-467e-a961-4f6bf8f9a6c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:44:38.288583 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc2efa-d6a9-467e-a961-4f6bf8f9a6c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:44:38.290102 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc2efa-d6a9-467e-a961-4f6bf8f9a6c4 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:44:38.308789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1263/2494] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:44:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:44:45.507887 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=37 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:47.153649 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd10dda-fa98-4ee5-a16c-eb3f851a336b service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:44:47.162376 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd10dda-fa98-4ee5-a16c-eb3f851a336b service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:44:47.166011 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a42e7-6c40-4815-8a00-ec891dd34948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:44:47.166646 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a42e7-6c40-4815-8a00-ec891dd34948 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:44:47.167640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a42e7-6c40-4815-8a00-ec891dd34948 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:44:47.168142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a42e7-6c40-4815-8a00-ec891dd34948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:44:47.169959 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8b1a42e7-6c40-4815-8a00-ec891dd34948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:44:47.181728 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a42e7-6c40-4815-8a00-ec891dd34948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:44:47.183550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a42e7-6c40-4815-8a00-ec891dd34948 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:44:47.193377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1232/2495] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:44:48.305968 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=41 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:48.423623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e89a22-2ec6-4efb-95d8-c1e67847fcde None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:44:48.424177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e89a22-2ec6-4efb-95d8-c1e67847fcde None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:44:48.424718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e89a22-2ec6-4efb-95d8-c1e67847fcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:44:48.443406 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c2e89a22-2ec6-4efb-95d8-c1e67847fcde None None] MFA Rules not processed for user `9144d74a341b4e08ae353b384fe1186e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:44:48.444620 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c2e89a22-2ec6-4efb-95d8-c1e67847fcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:44:48.502044 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1264/2496] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Jun 17 07:44:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:44:48.664106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a42e7-6c40-4815-8a00-ec891dd34948 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:44:48.665730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8b1a42e7-6c40-4815-8a00-ec891dd34948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:44:48.756365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a42e7-6c40-4815-8a00-ec891dd34948 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:44:48.761758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9158ba-06a9-41fb-a876-b6cf19406cfe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a18b07c033224d2085773936dad33eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:44:48.762422 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9158ba-06a9-41fb-a876-b6cf19406cfe service swift] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:44:48.762695 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9158ba-06a9-41fb-a876-b6cf19406cfe service swift] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:44:48.762967 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9158ba-06a9-41fb-a876-b6cf19406cfe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:44:48.771756 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9158ba-06a9-41fb-a876-b6cf19406cfe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:44:48.773450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9158ba-06a9-41fb-a876-b6cf19406cfe service swift] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:44:48.782528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1233/2497] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Jun 17 07:44:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:44:52.088279 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e89a22-2ec6-4efb-95d8-c1e67847fcde None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:44:52.092066 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c2e89a22-2ec6-4efb-95d8-c1e67847fcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:44:52.207992 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e89a22-2ec6-4efb-95d8-c1e67847fcde None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:44:52.213088 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e03b2d-8553-48a4-b348-a8c133fea1b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adc8b93e5c41929b928002e004df6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:44:52.213962 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e03b2d-8553-48a4-b348-a8c133fea1b1 service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:44:52.214467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e03b2d-8553-48a4-b348-a8c133fea1b1 service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:44:52.214751 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e03b2d-8553-48a4-b348-a8c133fea1b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:44:52.216562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-16e03b2d-8553-48a4-b348-a8c133fea1b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:44:52.230564 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e03b2d-8553-48a4-b348-a8c133fea1b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:44:52.232429 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e03b2d-8553-48a4-b348-a8c133fea1b1 service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:44:52.251382 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1265/2498] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:44:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:44:57.759375 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9158ba-06a9-41fb-a876-b6cf19406cfe service swift] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:44:57.771563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9158ba-06a9-41fb-a876-b6cf19406cfe service swift] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:44:57.777648 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853be50-f3af-4139-9152-21020c006dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:44:57.778979 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853be50-f3af-4139-9152-21020c006dcb service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:44:57.779737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853be50-f3af-4139-9152-21020c006dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:44:57.780197 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853be50-f3af-4139-9152-21020c006dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:44:57.782843 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c853be50-f3af-4139-9152-21020c006dcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:44:57.817854 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e03b2d-8553-48a4-b348-a8c133fea1b1 service placement] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:44:57.819504 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-16e03b2d-8553-48a4-b348-a8c133fea1b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:44:57.864541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e03b2d-8553-48a4-b348-a8c133fea1b1 service placement] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:44:57.871329 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f7885-4481-4d77-8c24-594bfdbfe8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:44:57.872827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f7885-4481-4d77-8c24-594bfdbfe8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:44:57.873283 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f7885-4481-4d77-8c24-594bfdbfe8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:44:57.873761 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f7885-4481-4d77-8c24-594bfdbfe8ff admin admin] PATH_INFO: `/v3/users/5e9fc215b64a44c2b989e68c788c1534` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:44:57.875365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f7885-4481-4d77-8c24-594bfdbfe8ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e9fc215b64a44c2b989e68c788c1534)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:44:57.878479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f7885-4481-4d77-8c24-594bfdbfe8ff admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:44:57.888984 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853be50-f3af-4139-9152-21020c006dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:44:57.890627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853be50-f3af-4139-9152-21020c006dcb service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:44:57.905848 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1234/2499] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:44:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:44:58.115434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cc4f7885-4481-4d77-8c24-594bfdbfe8ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e9fc215b64a44c2b989e68c788c1534'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:44:58.136718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cc4f7885-4481-4d77-8c24-594bfdbfe8ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e9fc215b64a44c2b989e68c788c1534'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:44:58.151944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cc4f7885-4481-4d77-8c24-594bfdbfe8ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e9fc215b64a44c2b989e68c788c1534'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:44:58.153418 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cc4f7885-4481-4d77-8c24-594bfdbfe8ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e9fc215b64a44c2b989e68c788c1534'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:44:58.155159 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cc4f7885-4481-4d77-8c24-594bfdbfe8ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e9fc215b64a44c2b989e68c788c1534'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:44:58.270410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1266/2500] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:44:57 2022] DELETE /identity/v3/users/5e9fc215b64a44c2b989e68c788c1534 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:44:58.588511 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853be50-f3af-4139-9152-21020c006dcb service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:44:58.605806 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853be50-f3af-4139-9152-21020c006dcb service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:44:58.719169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:44:58.720603 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:44:58.721113 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:44:58.721664 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319 admin admin] PATH_INFO: `/v3/projects/5de5c6b438594f4eae8e7010ccf0ca65` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:44:58.723410 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de5c6b438594f4eae8e7010ccf0ca65)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:44:58.726791 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:44:58.742044 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:58.874406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de5c6b438594f4eae8e7010ccf0ca65', 'request_id': 'req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:44:58.885355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de5c6b438594f4eae8e7010ccf0ca65', 'request_id': 'req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:44:58.993294 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de5c6b438594f4eae8e7010ccf0ca65', 'request_id': 'req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:44:59.029595 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319 admin admin] The token cache is being invalidate because project 5de5c6b438594f4eae8e7010ccf0ca65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:44:59.030145 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:44:59.032546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:44:59.041447 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f7885-4481-4d77-8c24-594bfdbfe8ff admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:44:59.043902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cc4f7885-4481-4d77-8c24-594bfdbfe8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:44:59.046275 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1235/2501] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:44:58 2022] DELETE /identity/v3/projects/5de5c6b438594f4eae8e7010ccf0ca65 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:44:59.072211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f7885-4481-4d77-8c24-594bfdbfe8ff admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:44:59.084910 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:59.185132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7753b-1887-4d09-b450-216d307f5e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:44:59.186158 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7753b-1887-4d09-b450-216d307f5e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:44:59.186581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7753b-1887-4d09-b450-216d307f5e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:44:59.186858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7753b-1887-4d09-b450-216d307f5e4b admin admin] PATH_INFO: `/v3/users/7f089a8d045a4a82acdda7a622a65e2c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:44:59.188143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7753b-1887-4d09-b450-216d307f5e4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f089a8d045a4a82acdda7a622a65e2c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:44:59.190211 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7753b-1887-4d09-b450-216d307f5e4b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:44:59.471821 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1cf7753b-1887-4d09-b450-216d307f5e4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f089a8d045a4a82acdda7a622a65e2c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:44:59.490665 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1cf7753b-1887-4d09-b450-216d307f5e4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f089a8d045a4a82acdda7a622a65e2c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:44:59.500747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1cf7753b-1887-4d09-b450-216d307f5e4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f089a8d045a4a82acdda7a622a65e2c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:44:59.501620 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1cf7753b-1887-4d09-b450-216d307f5e4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f089a8d045a4a82acdda7a622a65e2c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:44:59.502244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1cf7753b-1887-4d09-b450-216d307f5e4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f089a8d045a4a82acdda7a622a65e2c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:44:59.603076 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1267/2502] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:44:59 2022] DELETE /identity/v3/users/7f089a8d045a4a82acdda7a622a65e2c => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:44:59.977783 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:44:59.979419 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:44:59.993006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f0c18-0ac9-4b98-b72b-f9d20e129319 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:00.094785 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39773f-a228-421e-831d-855f8b9780d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:00.095766 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39773f-a228-421e-831d-855f8b9780d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:00.096114 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39773f-a228-421e-831d-855f8b9780d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:00.096475 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39773f-a228-421e-831d-855f8b9780d4 admin admin] PATH_INFO: `/v3/projects/91447dc0150c49ee9f9a187a940d8641` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:00.097874 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39773f-a228-421e-831d-855f8b9780d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91447dc0150c49ee9f9a187a940d8641)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:00.100301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39773f-a228-421e-831d-855f8b9780d4 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:00.250407 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5a39773f-a228-421e-831d-855f8b9780d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91447dc0150c49ee9f9a187a940d8641', 'request_id': 'req-5a39773f-a228-421e-831d-855f8b9780d4'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:00.258484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5a39773f-a228-421e-831d-855f8b9780d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91447dc0150c49ee9f9a187a940d8641', 'request_id': 'req-5a39773f-a228-421e-831d-855f8b9780d4'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:00.356961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5a39773f-a228-421e-831d-855f8b9780d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91447dc0150c49ee9f9a187a940d8641', 'request_id': 'req-5a39773f-a228-421e-831d-855f8b9780d4'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:00.370384 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5a39773f-a228-421e-831d-855f8b9780d4 admin admin] The token cache is being invalidate because project 91447dc0150c49ee9f9a187a940d8641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:45:00.374933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5a39773f-a228-421e-831d-855f8b9780d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:00.374933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5a39773f-a228-421e-831d-855f8b9780d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:00.374933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1236/2503] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:44:59 2022] DELETE /identity/v3/projects/91447dc0150c49ee9f9a187a940d8641 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:45:05.721914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a086176-b15e-4b7d-b552-6a4eebe923c9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:05.722419 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a086176-b15e-4b7d-b552-6a4eebe923c9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:05.722702 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a086176-b15e-4b7d-b552-6a4eebe923c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:05.748455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0a086176-b15e-4b7d-b552-6a4eebe923c9 None None] MFA Rules not processed for user `9144d74a341b4e08ae353b384fe1186e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:45:05.751257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0a086176-b15e-4b7d-b552-6a4eebe923c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:05.837675 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1268/2504] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Jun 17 07:45:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:45:05.853156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39773f-a228-421e-831d-855f8b9780d4 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:05.855211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5a39773f-a228-421e-831d-855f8b9780d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:05.903461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:05.946236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39773f-a228-421e-831d-855f8b9780d4 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:05.960856 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fe22d-2f45-4e4a-9851-daa3e489bf85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a18b07c033224d2085773936dad33eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:05.960856 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fe22d-2f45-4e4a-9851-daa3e489bf85 service swift] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:05.960856 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fe22d-2f45-4e4a-9851-daa3e489bf85 service swift] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:05.960856 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fe22d-2f45-4e4a-9851-daa3e489bf85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:05.968332 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fe22d-2f45-4e4a-9851-daa3e489bf85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:05.970403 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fe22d-2f45-4e4a-9851-daa3e489bf85 service swift] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:05.982245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1237/2505] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Jun 17 07:45:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:45:08.676086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c81c43-f134-4e82-8e58-3000125cb3a0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:08.676585 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c81c43-f134-4e82-8e58-3000125cb3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:08.676874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c81c43-f134-4e82-8e58-3000125cb3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:08.696904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b8c81c43-f134-4e82-8e58-3000125cb3a0 None None] MFA Rules not processed for user `9144d74a341b4e08ae353b384fe1186e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:45:08.699254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b8c81c43-f134-4e82-8e58-3000125cb3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:08.712579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1269/2506] 10.222.0.52 () {58 vars in 967 bytes} [Fri Jun 17 07:45:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:45:08.723069 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fe22d-2f45-4e4a-9851-daa3e489bf85 service swift] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:08.734918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fe22d-2f45-4e4a-9851-daa3e489bf85 service swift] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:08.740296 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e3c86-f120-480a-bb5d-5ed8bab2225b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a18b07c033224d2085773936dad33eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:08.740942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e3c86-f120-480a-bb5d-5ed8bab2225b service swift] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:08.741230 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e3c86-f120-480a-bb5d-5ed8bab2225b service swift] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:08.741543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e3c86-f120-480a-bb5d-5ed8bab2225b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:08.752324 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e3c86-f120-480a-bb5d-5ed8bab2225b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:08.753986 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e3c86-f120-480a-bb5d-5ed8bab2225b service swift] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:08.763701 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1238/2507] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Jun 17 07:45:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:45:13.090044 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c81c43-f134-4e82-8e58-3000125cb3a0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:13.092232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b8c81c43-f134-4e82-8e58-3000125cb3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:13.146869 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:13.206060 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c81c43-f134-4e82-8e58-3000125cb3a0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:13.217773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558731f-13f7-4581-b971-659e6a9bc340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:13.217773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558731f-13f7-4581-b971-659e6a9bc340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:13.217773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558731f-13f7-4581-b971-659e6a9bc340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:13.217773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558731f-13f7-4581-b971-659e6a9bc340 admin admin] PATH_INFO: `/v3/users/8be176511fa34aa6aa5fe83bc6a2b163` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:13.218100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558731f-13f7-4581-b971-659e6a9bc340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8be176511fa34aa6aa5fe83bc6a2b163)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:13.219206 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558731f-13f7-4581-b971-659e6a9bc340 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:13.477786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8558731f-13f7-4581-b971-659e6a9bc340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8be176511fa34aa6aa5fe83bc6a2b163'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:13.495439 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8558731f-13f7-4581-b971-659e6a9bc340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8be176511fa34aa6aa5fe83bc6a2b163'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:13.502970 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8558731f-13f7-4581-b971-659e6a9bc340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8be176511fa34aa6aa5fe83bc6a2b163'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:13.503717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8558731f-13f7-4581-b971-659e6a9bc340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8be176511fa34aa6aa5fe83bc6a2b163'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:13.504342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8558731f-13f7-4581-b971-659e6a9bc340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8be176511fa34aa6aa5fe83bc6a2b163'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:13.578866 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1270/2508] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:45:13 2022] DELETE /identity/v3/users/8be176511fa34aa6aa5fe83bc6a2b163 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:45:14.283554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e3c86-f120-480a-bb5d-5ed8bab2225b service swift] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:14.304568 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e3c86-f120-480a-bb5d-5ed8bab2225b service swift] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:14.367642 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cd151-0695-45a7-b438-2b42550f2fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:14.368566 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cd151-0695-45a7-b438-2b42550f2fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:14.368847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cd151-0695-45a7-b438-2b42550f2fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:14.369123 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cd151-0695-45a7-b438-2b42550f2fae admin admin] PATH_INFO: `/v3/projects/5fe594d24d9843acbec2e846c98c14ae` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:14.370489 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cd151-0695-45a7-b438-2b42550f2fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe594d24d9843acbec2e846c98c14ae)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:14.372417 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cd151-0695-45a7-b438-2b42550f2fae admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:14.534580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0c0cd151-0695-45a7-b438-2b42550f2fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe594d24d9843acbec2e846c98c14ae', 'request_id': 'req-0c0cd151-0695-45a7-b438-2b42550f2fae'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:14.544596 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0c0cd151-0695-45a7-b438-2b42550f2fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe594d24d9843acbec2e846c98c14ae', 'request_id': 'req-0c0cd151-0695-45a7-b438-2b42550f2fae'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:14.612235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0c0cd151-0695-45a7-b438-2b42550f2fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe594d24d9843acbec2e846c98c14ae', 'request_id': 'req-0c0cd151-0695-45a7-b438-2b42550f2fae'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:14.627342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0c0cd151-0695-45a7-b438-2b42550f2fae admin admin] The token cache is being invalidate because project 5fe594d24d9843acbec2e846c98c14ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:45:14.627639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0c0cd151-0695-45a7-b438-2b42550f2fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:14.628323 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0c0cd151-0695-45a7-b438-2b42550f2fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:14.630184 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1239/2509] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:45:14 2022] DELETE /identity/v3/projects/5fe594d24d9843acbec2e846c98c14ae => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:45:14.635987 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3238df8-e1e1-4ea8-8754-b912d12f3ec2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:14.635987 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3238df8-e1e1-4ea8-8754-b912d12f3ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:14.636566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3238df8-e1e1-4ea8-8754-b912d12f3ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:14.659540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d3238df8-e1e1-4ea8-8754-b912d12f3ec2 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:45:14.663447 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d3238df8-e1e1-4ea8-8754-b912d12f3ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:14.741405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1271/2510] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:45:14.749949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd96eeb-fde5-4c46-a013-95505de4a4de None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:14.750773 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd96eeb-fde5-4c46-a013-95505de4a4de None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:14.751160 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd96eeb-fde5-4c46-a013-95505de4a4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:14.774841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3dd96eeb-fde5-4c46-a013-95505de4a4de None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:45:14.776964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3dd96eeb-fde5-4c46-a013-95505de4a4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:14.789346 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1240/2511] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:45:14.790903 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3238df8-e1e1-4ea8-8754-b912d12f3ec2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:14.805637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3238df8-e1e1-4ea8-8754-b912d12f3ec2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:14.810558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfde83-f297-4d30-a36f-59d22b784451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:14.811241 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfde83-f297-4d30-a36f-59d22b784451 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:14.811556 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfde83-f297-4d30-a36f-59d22b784451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:14.811836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfde83-f297-4d30-a36f-59d22b784451 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:14.812574 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfde83-f297-4d30-a36f-59d22b784451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:45:14.812885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfde83-f297-4d30-a36f-59d22b784451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:14.814547 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfde83-f297-4d30-a36f-59d22b784451 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:14.828919 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1272/2512] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:45:14.833094 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd96eeb-fde5-4c46-a013-95505de4a4de None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:14.845234 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd96eeb-fde5-4c46-a013-95505de4a4de None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:14.850424 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb9802-bc63-4380-8dd4-ac112b59097d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:14.851547 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb9802-bc63-4380-8dd4-ac112b59097d admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:14.851944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb9802-bc63-4380-8dd4-ac112b59097d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:14.852404 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb9802-bc63-4380-8dd4-ac112b59097d admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:14.853597 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb9802-bc63-4380-8dd4-ac112b59097d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:14.857680 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb9802-bc63-4380-8dd4-ac112b59097d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:15.014025 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfde83-f297-4d30-a36f-59d22b784451 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:15.014415 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1241/2513] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:45:14 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:45:15.024707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfde83-f297-4d30-a36f-59d22b784451 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:15.057682 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:15.090107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c923a3-c8d3-4792-a882-f411f2321e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:15.091069 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c923a3-c8d3-4792-a882-f411f2321e67 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:15.091962 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c923a3-c8d3-4792-a882-f411f2321e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:15.092248 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c923a3-c8d3-4792-a882-f411f2321e67 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:15.092984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c923a3-c8d3-4792-a882-f411f2321e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:15.095697 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c923a3-c8d3-4792-a882-f411f2321e67 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:15.236586 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1273/2514] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:45:15 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:45:15.241146 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb9802-bc63-4380-8dd4-ac112b59097d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:15.254502 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb9802-bc63-4380-8dd4-ac112b59097d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:15.259328 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a3311-bd84-4d25-b506-8579cfd8f4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:15.260050 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a3311-bd84-4d25-b506-8579cfd8f4bd admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:15.260374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a3311-bd84-4d25-b506-8579cfd8f4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:15.260685 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a3311-bd84-4d25-b506-8579cfd8f4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:15.261661 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a3311-bd84-4d25-b506-8579cfd8f4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:15.263279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a3311-bd84-4d25-b506-8579cfd8f4bd admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:15.271334 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:15.279210 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1242/2515] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:45:15.280468 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c923a3-c8d3-4792-a882-f411f2321e67 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:15.291841 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c923a3-c8d3-4792-a882-f411f2321e67 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:15.298628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb766ba0-547e-40a9-8f85-f799617022a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:15.299273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb766ba0-547e-40a9-8f85-f799617022a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:15.299602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb766ba0-547e-40a9-8f85-f799617022a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:15.299982 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb766ba0-547e-40a9-8f85-f799617022a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:15.300986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb766ba0-547e-40a9-8f85-f799617022a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:15.302656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb766ba0-547e-40a9-8f85-f799617022a0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:15.314246 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1274/2516] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:45:15.319942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a3311-bd84-4d25-b506-8579cfd8f4bd admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:15.330161 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a3311-bd84-4d25-b506-8579cfd8f4bd admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:15.334795 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9273d-7eca-4ca2-8cdf-ab1d95d6a0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:15.335667 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9273d-7eca-4ca2-8cdf-ab1d95d6a0d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:15.335943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9273d-7eca-4ca2-8cdf-ab1d95d6a0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:15.336213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9273d-7eca-4ca2-8cdf-ab1d95d6a0d7 admin admin] PATH_INFO: `/v3/projects/3189325aabca4c21a8da80b9190ac166/users/82bd3c8cef4448a9967874c01f52a26e/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:15.359918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9273d-7eca-4ca2-8cdf-ab1d95d6a0d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3189325aabca4c21a8da80b9190ac166, user_id=82bd3c8cef4448a9967874c01f52a26e, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:15.363331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9273d-7eca-4ca2-8cdf-ab1d95d6a0d7 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:15.450198 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1243/2517] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:45:15 2022] PUT /identity/v3/projects/3189325aabca4c21a8da80b9190ac166/users/82bd3c8cef4448a9967874c01f52a26e/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:45:15.461094 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a65e62-090e-4780-abd3-0a05159e6a38 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:15.461306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a65e62-090e-4780-abd3-0a05159e6a38 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:15.461610 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a65e62-090e-4780-abd3-0a05159e6a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:15.503656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-43a65e62-090e-4780-abd3-0a05159e6a38 None None] MFA Rules not processed for user `82bd3c8cef4448a9967874c01f52a26e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:45:15.505141 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-43a65e62-090e-4780-abd3-0a05159e6a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:15.597759 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1275/2518] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:45:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:45:15.610659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9273d-7eca-4ca2-8cdf-ab1d95d6a0d7 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:15.612434 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-1bf9273d-7eca-4ca2-8cdf-ab1d95d6a0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:15.697640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9273d-7eca-4ca2-8cdf-ab1d95d6a0d7 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:15.702265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76565cb-62f9-4130-8b95-b446a5bb5c34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:15.703044 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76565cb-62f9-4130-8b95-b446a5bb5c34 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:15.703350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76565cb-62f9-4130-8b95-b446a5bb5c34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:15.703697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76565cb-62f9-4130-8b95-b446a5bb5c34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:15.715666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76565cb-62f9-4130-8b95-b446a5bb5c34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:15.717604 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76565cb-62f9-4130-8b95-b446a5bb5c34 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:15.727752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1244/2519] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:45:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:45:20.191403 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a65e62-090e-4780-abd3-0a05159e6a38 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:20.255022 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a65e62-090e-4780-abd3-0a05159e6a38 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:20.259622 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b365c-0ddf-41f1-b92b-99c29f4ccd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:20.260501 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b365c-0ddf-41f1-b92b-99c29f4ccd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:20.260783 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b365c-0ddf-41f1-b92b-99c29f4ccd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:20.261057 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b365c-0ddf-41f1-b92b-99c29f4ccd13 admin admin] PATH_INFO: `/v3/users/82bd3c8cef4448a9967874c01f52a26e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:20.263011 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b365c-0ddf-41f1-b92b-99c29f4ccd13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82bd3c8cef4448a9967874c01f52a26e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:20.264951 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b365c-0ddf-41f1-b92b-99c29f4ccd13 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:20.438663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:20.444007 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fc3b365c-0ddf-41f1-b92b-99c29f4ccd13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82bd3c8cef4448a9967874c01f52a26e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:20.456050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fc3b365c-0ddf-41f1-b92b-99c29f4ccd13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82bd3c8cef4448a9967874c01f52a26e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:20.462784 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fc3b365c-0ddf-41f1-b92b-99c29f4ccd13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82bd3c8cef4448a9967874c01f52a26e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:20.463497 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fc3b365c-0ddf-41f1-b92b-99c29f4ccd13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82bd3c8cef4448a9967874c01f52a26e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:20.464328 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fc3b365c-0ddf-41f1-b92b-99c29f4ccd13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82bd3c8cef4448a9967874c01f52a26e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:20.532151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1276/2520] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:45:20 2022] DELETE /identity/v3/users/82bd3c8cef4448a9967874c01f52a26e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:45:20.534026 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5f4c5-6207-4598-97d9-2a7e310978c6 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:20.534530 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5f4c5-6207-4598-97d9-2a7e310978c6 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:20.534658 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5f4c5-6207-4598-97d9-2a7e310978c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:20.552310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-05f5f4c5-6207-4598-97d9-2a7e310978c6 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:45:20.553547 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-05f5f4c5-6207-4598-97d9-2a7e310978c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:20.615686 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1245/2521] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:45:20.626123 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b365c-0ddf-41f1-b92b-99c29f4ccd13 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:20.627712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fc3b365c-0ddf-41f1-b92b-99c29f4ccd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:20.686901 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b365c-0ddf-41f1-b92b-99c29f4ccd13 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:20.690588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823fbbe-45a6-4d77-8fac-4bef50d3316e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:20.691151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823fbbe-45a6-4d77-8fac-4bef50d3316e service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:20.691430 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823fbbe-45a6-4d77-8fac-4bef50d3316e service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:20.691705 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823fbbe-45a6-4d77-8fac-4bef50d3316e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:20.700697 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823fbbe-45a6-4d77-8fac-4bef50d3316e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:20.702152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823fbbe-45a6-4d77-8fac-4bef50d3316e service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:20.711324 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1277/2522] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:45:21.341063 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5f4c5-6207-4598-97d9-2a7e310978c6 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:21.342449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-05f5f4c5-6207-4598-97d9-2a7e310978c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:21.354942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5f4c5-6207-4598-97d9-2a7e310978c6 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:21.359703 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf9e41-b652-4c5f-a5f7-61b79d1dd33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:21.360568 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf9e41-b652-4c5f-a5f7-61b79d1dd33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:21.364225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf9e41-b652-4c5f-a5f7-61b79d1dd33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:21.364225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf9e41-b652-4c5f-a5f7-61b79d1dd33e admin admin] PATH_INFO: `/v3/projects/3189325aabca4c21a8da80b9190ac166` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:21.364225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf9e41-b652-4c5f-a5f7-61b79d1dd33e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3189325aabca4c21a8da80b9190ac166)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:21.364528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf9e41-b652-4c5f-a5f7-61b79d1dd33e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:21.493071 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-61cf9e41-b652-4c5f-a5f7-61b79d1dd33e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3189325aabca4c21a8da80b9190ac166', 'request_id': 'req-61cf9e41-b652-4c5f-a5f7-61b79d1dd33e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:21.500258 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-61cf9e41-b652-4c5f-a5f7-61b79d1dd33e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3189325aabca4c21a8da80b9190ac166', 'request_id': 'req-61cf9e41-b652-4c5f-a5f7-61b79d1dd33e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:21.565729 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-61cf9e41-b652-4c5f-a5f7-61b79d1dd33e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3189325aabca4c21a8da80b9190ac166', 'request_id': 'req-61cf9e41-b652-4c5f-a5f7-61b79d1dd33e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:21.568255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:21.572211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-61cf9e41-b652-4c5f-a5f7-61b79d1dd33e admin admin] The token cache is being invalidate because project 3189325aabca4c21a8da80b9190ac166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:45:21.572488 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-61cf9e41-b652-4c5f-a5f7-61b79d1dd33e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:21.573104 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-61cf9e41-b652-4c5f-a5f7-61b79d1dd33e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:45:21.575224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1246/2523] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:45:21 2022] DELETE /identity/v3/projects/3189325aabca4c21a8da80b9190ac166 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:45:21.580100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d12408-0184-4e74-9d2c-8079b35cf91e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:21.580552 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d12408-0184-4e74-9d2c-8079b35cf91e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:21.580706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d12408-0184-4e74-9d2c-8079b35cf91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:21.599462 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-14d12408-0184-4e74-9d2c-8079b35cf91e None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:45:21.600648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-14d12408-0184-4e74-9d2c-8079b35cf91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:21.660524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1278/2524] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:45:21.668411 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e67ec9-67ce-4cee-a172-cc8e466b167c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:21.668799 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e67ec9-67ce-4cee-a172-cc8e466b167c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:21.669085 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e67ec9-67ce-4cee-a172-cc8e466b167c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:21.688152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b9e67ec9-67ce-4cee-a172-cc8e466b167c None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:45:21.689362 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b9e67ec9-67ce-4cee-a172-cc8e466b167c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:21.697301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1247/2525] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:45:21.702414 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d12408-0184-4e74-9d2c-8079b35cf91e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:21.711937 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d12408-0184-4e74-9d2c-8079b35cf91e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:21.717552 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a5a67-8c16-43d3-8ead-9410b346a182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:21.718200 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a5a67-8c16-43d3-8ead-9410b346a182 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:21.718479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a5a67-8c16-43d3-8ead-9410b346a182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:21.718751 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a5a67-8c16-43d3-8ead-9410b346a182 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:21.719466 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a5a67-8c16-43d3-8ead-9410b346a182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:45:21.719769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a5a67-8c16-43d3-8ead-9410b346a182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:21.721371 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a5a67-8c16-43d3-8ead-9410b346a182 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:21.733787 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1279/2526] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:45:21.738220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e67ec9-67ce-4cee-a172-cc8e466b167c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:21.747788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e67ec9-67ce-4cee-a172-cc8e466b167c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:21.752430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cb953-6f12-4b0c-b2e3-83680042e69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:21.753076 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cb953-6f12-4b0c-b2e3-83680042e69a admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:21.753380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cb953-6f12-4b0c-b2e3-83680042e69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:21.753658 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cb953-6f12-4b0c-b2e3-83680042e69a admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:21.754337 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cb953-6f12-4b0c-b2e3-83680042e69a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:21.756520 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cb953-6f12-4b0c-b2e3-83680042e69a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:21.856143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1248/2527] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:45:21 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:45:21.860481 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a5a67-8c16-43d3-8ead-9410b346a182 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:21.870589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a5a67-8c16-43d3-8ead-9410b346a182 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:21.919298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:21.931325 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c774921-626b-40c9-a345-6b3b2751583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:21.932057 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c774921-626b-40c9-a345-6b3b2751583e admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:21.932344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c774921-626b-40c9-a345-6b3b2751583e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:21.932621 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c774921-626b-40c9-a345-6b3b2751583e admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:21.933338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c774921-626b-40c9-a345-6b3b2751583e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:21.935812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c774921-626b-40c9-a345-6b3b2751583e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:22.023430 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1280/2528] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:45:21 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:45:22.027969 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cb953-6f12-4b0c-b2e3-83680042e69a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:22.038796 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cb953-6f12-4b0c-b2e3-83680042e69a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:22.044338 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337807db-d304-4268-8252-d74ead1d09d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:22.045069 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337807db-d304-4268-8252-d74ead1d09d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:22.045374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337807db-d304-4268-8252-d74ead1d09d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:22.045674 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337807db-d304-4268-8252-d74ead1d09d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:22.046393 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337807db-d304-4268-8252-d74ead1d09d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:22.047989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337807db-d304-4268-8252-d74ead1d09d2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:22.060093 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1249/2529] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:45:22.064248 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c774921-626b-40c9-a345-6b3b2751583e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:22.074735 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c774921-626b-40c9-a345-6b3b2751583e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:22.079516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41d8fd-9066-4d7b-8e55-8005ef155bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:22.080182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41d8fd-9066-4d7b-8e55-8005ef155bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:22.080441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41d8fd-9066-4d7b-8e55-8005ef155bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:22.080714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41d8fd-9066-4d7b-8e55-8005ef155bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:22.081533 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41d8fd-9066-4d7b-8e55-8005ef155bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:22.083106 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41d8fd-9066-4d7b-8e55-8005ef155bfd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:22.093663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1281/2530] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:45:22.097940 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337807db-d304-4268-8252-d74ead1d09d2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:22.109583 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337807db-d304-4268-8252-d74ead1d09d2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:22.113709 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f8885-55c5-465a-b415-1d27975c0b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:22.114612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f8885-55c5-465a-b415-1d27975c0b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:22.114900 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f8885-55c5-465a-b415-1d27975c0b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:22.115165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f8885-55c5-465a-b415-1d27975c0b89 admin admin] PATH_INFO: `/v3/projects/d9f9c143851645a39e5ca41536f49adf/users/81a8586f087b4adca4056a9ee19dd329/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:22.134547 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f8885-55c5-465a-b415-1d27975c0b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f9c143851645a39e5ca41536f49adf, user_id=81a8586f087b4adca4056a9ee19dd329, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:22.138177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f8885-55c5-465a-b415-1d27975c0b89 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:22.246580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1250/2531] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:45:22 2022] PUT /identity/v3/projects/d9f9c143851645a39e5ca41536f49adf/users/81a8586f087b4adca4056a9ee19dd329/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:45:22.310663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a27f31-8f72-449d-a399-de7e12f5eb19 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:22.311089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a27f31-8f72-449d-a399-de7e12f5eb19 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:22.311367 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a27f31-8f72-449d-a399-de7e12f5eb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:22.338071 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-11a27f31-8f72-449d-a399-de7e12f5eb19 None None] MFA Rules not processed for user `81a8586f087b4adca4056a9ee19dd329`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:45:22.339279 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-11a27f31-8f72-449d-a399-de7e12f5eb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:22.404943 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1282/2532] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:45:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:45:22.416681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f8885-55c5-465a-b415-1d27975c0b89 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:22.418744 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ca3f8885-55c5-465a-b415-1d27975c0b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:22.475995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f8885-55c5-465a-b415-1d27975c0b89 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:22.479930 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce27a7d-5536-471a-97bc-9af90b4bdf49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde4369f695745c199ce6c10d241b841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:22.480860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27a7d-5536-471a-97bc-9af90b4bdf49 service glance] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:22.481225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27a7d-5536-471a-97bc-9af90b4bdf49 service glance] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:22.481530 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27a7d-5536-471a-97bc-9af90b4bdf49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:22.489909 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce27a7d-5536-471a-97bc-9af90b4bdf49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:22.491369 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce27a7d-5536-471a-97bc-9af90b4bdf49 service glance] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:22.501160 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1251/2533] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:45:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:45:28.531397 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a27f31-8f72-449d-a399-de7e12f5eb19 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:28.532903 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-11a27f31-8f72-449d-a399-de7e12f5eb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:28.591907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a27f31-8f72-449d-a399-de7e12f5eb19 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:28.595624 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9710fcd-8806-4a00-90a2-d44ea967566d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:28.596334 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9710fcd-8806-4a00-90a2-d44ea967566d service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:28.596620 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9710fcd-8806-4a00-90a2-d44ea967566d service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:28.596897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9710fcd-8806-4a00-90a2-d44ea967566d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:28.598767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a9710fcd-8806-4a00-90a2-d44ea967566d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:28.610053 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9710fcd-8806-4a00-90a2-d44ea967566d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:28.611501 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9710fcd-8806-4a00-90a2-d44ea967566d service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:28.621179 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1283/2534] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:45:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:45:29.683905 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9ff1b-11a2-4b9f-97ab-ea63d35f4352 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:29.684577 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9ff1b-11a2-4b9f-97ab-ea63d35f4352 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:29.684577 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9ff1b-11a2-4b9f-97ab-ea63d35f4352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:29.705841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3bb9ff1b-11a2-4b9f-97ab-ea63d35f4352 None None] MFA Rules not processed for user `9144d74a341b4e08ae353b384fe1186e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:45:29.705841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3bb9ff1b-11a2-4b9f-97ab-ea63d35f4352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:29.773167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1252/2535] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Jun 17 07:45:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:45:29.786664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9710fcd-8806-4a00-90a2-d44ea967566d service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:29.788239 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a9710fcd-8806-4a00-90a2-d44ea967566d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:29.854886 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:29.861457 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9710fcd-8806-4a00-90a2-d44ea967566d service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:29.866627 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96f6fb-6969-4ab0-8a26-b061f36a81c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a18b07c033224d2085773936dad33eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:29.870507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96f6fb-6969-4ab0-8a26-b061f36a81c4 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:29.870507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96f6fb-6969-4ab0-8a26-b061f36a81c4 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:29.870507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96f6fb-6969-4ab0-8a26-b061f36a81c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:29.876291 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96f6fb-6969-4ab0-8a26-b061f36a81c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:29.877898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96f6fb-6969-4ab0-8a26-b061f36a81c4 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:29.885962 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1284/2536] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Jun 17 07:45:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:45:39.765368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=78,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:39.926029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:57.232201 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9ff1b-11a2-4b9f-97ab-ea63d35f4352 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:57.233876 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3bb9ff1b-11a2-4b9f-97ab-ea63d35f4352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:57.318531 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9ff1b-11a2-4b9f-97ab-ea63d35f4352 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:57.325578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75636ee4-16c8-42d9-bf70-0308e449934d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:57.326258 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75636ee4-16c8-42d9-bf70-0308e449934d service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:57.326542 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75636ee4-16c8-42d9-bf70-0308e449934d service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:57.326820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75636ee4-16c8-42d9-bf70-0308e449934d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:57.329155 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-75636ee4-16c8-42d9-bf70-0308e449934d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:57.343489 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75636ee4-16c8-42d9-bf70-0308e449934d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:57.345109 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75636ee4-16c8-42d9-bf70-0308e449934d service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:57.358730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1253/2537] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:45:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:45:59.567304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a41d5-ff7a-4d83-a334-e44f64dfe87d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:59.567842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a41d5-ff7a-4d83-a334-e44f64dfe87d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:59.567964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a41d5-ff7a-4d83-a334-e44f64dfe87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:59.586680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0f2a41d5-ff7a-4d83-a334-e44f64dfe87d None None] MFA Rules not processed for user `9144d74a341b4e08ae353b384fe1186e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:45:59.587881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0f2a41d5-ff7a-4d83-a334-e44f64dfe87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:45:59.595911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1285/2538] 10.222.0.52 () {58 vars in 967 bytes} [Fri Jun 17 07:45:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:45:59.619096 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75636ee4-16c8-42d9-bf70-0308e449934d service nova] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:45:59.631049 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75636ee4-16c8-42d9-bf70-0308e449934d service nova] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:45:59.636220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ebc21-32a2-4f75-9098-2c9d149fd04d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a18b07c033224d2085773936dad33eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:45:59.637662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ebc21-32a2-4f75-9098-2c9d149fd04d service swift] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:45:59.637857 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ebc21-32a2-4f75-9098-2c9d149fd04d service swift] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:45:59.638065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ebc21-32a2-4f75-9098-2c9d149fd04d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:45:59.647112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ebc21-32a2-4f75-9098-2c9d149fd04d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:45:59.648730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ebc21-32a2-4f75-9098-2c9d149fd04d service swift] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:45:59.657509 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1254/2539] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Jun 17 07:45:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:46:09.581477 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:09.653890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=40 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:10.820329 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a41d5-ff7a-4d83-a334-e44f64dfe87d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:10.886401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a41d5-ff7a-4d83-a334-e44f64dfe87d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:10.891504 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcb6b3-177b-4dc1-aedd-a429e6acf905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:10.892490 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcb6b3-177b-4dc1-aedd-a429e6acf905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:10.892841 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcb6b3-177b-4dc1-aedd-a429e6acf905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:10.893124 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcb6b3-177b-4dc1-aedd-a429e6acf905 admin admin] PATH_INFO: `/v3/users/81a8586f087b4adca4056a9ee19dd329` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:10.894505 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcb6b3-177b-4dc1-aedd-a429e6acf905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81a8586f087b4adca4056a9ee19dd329)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:10.896673 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcb6b3-177b-4dc1-aedd-a429e6acf905 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:11.119019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-64fcb6b3-177b-4dc1-aedd-a429e6acf905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81a8586f087b4adca4056a9ee19dd329'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:46:11.131038 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-64fcb6b3-177b-4dc1-aedd-a429e6acf905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81a8586f087b4adca4056a9ee19dd329'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:46:11.138482 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-64fcb6b3-177b-4dc1-aedd-a429e6acf905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81a8586f087b4adca4056a9ee19dd329'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:46:11.142775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-64fcb6b3-177b-4dc1-aedd-a429e6acf905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81a8586f087b4adca4056a9ee19dd329'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:46:11.142775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-64fcb6b3-177b-4dc1-aedd-a429e6acf905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81a8586f087b4adca4056a9ee19dd329'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:46:11.225246 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1286/2540] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:46:10 2022] DELETE /identity/v3/users/81a8586f087b4adca4056a9ee19dd329 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:46:11.230287 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b42432-42bc-49cc-b236-cc8423647b47 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:11.230802 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b42432-42bc-49cc-b236-cc8423647b47 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:11.230909 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b42432-42bc-49cc-b236-cc8423647b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:11.249073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-65b42432-42bc-49cc-b236-cc8423647b47 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:46:11.250338 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-65b42432-42bc-49cc-b236-cc8423647b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:11.311144 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1255/2541] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:46:11.321220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcb6b3-177b-4dc1-aedd-a429e6acf905 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:11.323148 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-64fcb6b3-177b-4dc1-aedd-a429e6acf905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:11.407477 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcb6b3-177b-4dc1-aedd-a429e6acf905 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:11.411761 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77738e7e-27ec-4f37-9ae8-14b8ceec675b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:11.412421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77738e7e-27ec-4f37-9ae8-14b8ceec675b service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:11.412719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77738e7e-27ec-4f37-9ae8-14b8ceec675b service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:11.412994 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77738e7e-27ec-4f37-9ae8-14b8ceec675b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:11.422972 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77738e7e-27ec-4f37-9ae8-14b8ceec675b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:11.424400 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77738e7e-27ec-4f37-9ae8-14b8ceec675b service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:11.434885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1287/2542] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:46:11.856027 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b42432-42bc-49cc-b236-cc8423647b47 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:11.857505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-65b42432-42bc-49cc-b236-cc8423647b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:11.869450 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b42432-42bc-49cc-b236-cc8423647b47 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:11.875698 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a5049-401d-4a17-8ce0-127986cf6d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:11.876772 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a5049-401d-4a17-8ce0-127986cf6d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:11.877092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a5049-401d-4a17-8ce0-127986cf6d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:11.877487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a5049-401d-4a17-8ce0-127986cf6d9e admin admin] PATH_INFO: `/v3/projects/d9f9c143851645a39e5ca41536f49adf` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:11.878720 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a5049-401d-4a17-8ce0-127986cf6d9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f9c143851645a39e5ca41536f49adf)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:11.881628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a5049-401d-4a17-8ce0-127986cf6d9e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:12.008401 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-031a5049-401d-4a17-8ce0-127986cf6d9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f9c143851645a39e5ca41536f49adf', 'request_id': 'req-031a5049-401d-4a17-8ce0-127986cf6d9e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:46:12.015576 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-031a5049-401d-4a17-8ce0-127986cf6d9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f9c143851645a39e5ca41536f49adf', 'request_id': 'req-031a5049-401d-4a17-8ce0-127986cf6d9e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:46:12.082245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-031a5049-401d-4a17-8ce0-127986cf6d9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f9c143851645a39e5ca41536f49adf', 'request_id': 'req-031a5049-401d-4a17-8ce0-127986cf6d9e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:46:12.094982 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-031a5049-401d-4a17-8ce0-127986cf6d9e admin admin] The token cache is being invalidate because project d9f9c143851645a39e5ca41536f49adf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:46:12.095258 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-031a5049-401d-4a17-8ce0-127986cf6d9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:46:12.095939 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-031a5049-401d-4a17-8ce0-127986cf6d9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:46:12.097684 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1256/2543] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:46:11 2022] DELETE /identity/v3/projects/d9f9c143851645a39e5ca41536f49adf => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:46:12.103440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40582f-a053-47f8-96fb-1f47bce58bcd None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:12.106405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40582f-a053-47f8-96fb-1f47bce58bcd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:12.106405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40582f-a053-47f8-96fb-1f47bce58bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:12.123689 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-aa40582f-a053-47f8-96fb-1f47bce58bcd None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:46:12.124925 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-aa40582f-a053-47f8-96fb-1f47bce58bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:12.143480 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:12.188897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1288/2544] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:46:12.196891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8630b14-cade-4caf-b860-809da1825f30 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:12.197183 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8630b14-cade-4caf-b860-809da1825f30 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:12.197524 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8630b14-cade-4caf-b860-809da1825f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:12.216361 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d8630b14-cade-4caf-b860-809da1825f30 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:46:12.217617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d8630b14-cade-4caf-b860-809da1825f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:12.226036 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1257/2545] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:46:12.231092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40582f-a053-47f8-96fb-1f47bce58bcd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:12.241129 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40582f-a053-47f8-96fb-1f47bce58bcd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:12.247324 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a26d38-b988-4a40-8d7a-2dff67a50d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:12.248194 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a26d38-b988-4a40-8d7a-2dff67a50d32 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:12.248584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a26d38-b988-4a40-8d7a-2dff67a50d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:12.248939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a26d38-b988-4a40-8d7a-2dff67a50d32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:12.249757 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a26d38-b988-4a40-8d7a-2dff67a50d32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:46:12.250108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a26d38-b988-4a40-8d7a-2dff67a50d32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:12.251766 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a26d38-b988-4a40-8d7a-2dff67a50d32 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:12.264829 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1289/2546] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:46:12.269192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8630b14-cade-4caf-b860-809da1825f30 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:12.279206 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8630b14-cade-4caf-b860-809da1825f30 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:12.283890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc3fbc-8faf-495e-9381-5a1692ef43aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:12.284536 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc3fbc-8faf-495e-9381-5a1692ef43aa admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:12.284815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc3fbc-8faf-495e-9381-5a1692ef43aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:12.285084 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc3fbc-8faf-495e-9381-5a1692ef43aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:12.285814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc3fbc-8faf-495e-9381-5a1692ef43aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:12.287807 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc3fbc-8faf-495e-9381-5a1692ef43aa admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:12.372264 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1258/2547] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:46:12 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:46:12.376505 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a26d38-b988-4a40-8d7a-2dff67a50d32 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:12.386960 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a26d38-b988-4a40-8d7a-2dff67a50d32 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:12.446680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461b326-99d8-4e23-a69a-e38e97b2160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:12.447352 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461b326-99d8-4e23-a69a-e38e97b2160c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:12.447644 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461b326-99d8-4e23-a69a-e38e97b2160c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:12.447899 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461b326-99d8-4e23-a69a-e38e97b2160c admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:12.448585 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461b326-99d8-4e23-a69a-e38e97b2160c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:12.450590 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461b326-99d8-4e23-a69a-e38e97b2160c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:12.548616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1290/2548] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:46:12 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:46:12.552686 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc3fbc-8faf-495e-9381-5a1692ef43aa admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:12.564524 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc3fbc-8faf-495e-9381-5a1692ef43aa admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:12.569682 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c3be7-bcc1-422c-b3cc-bd18e886838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:12.570379 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c3be7-bcc1-422c-b3cc-bd18e886838a admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:12.570661 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c3be7-bcc1-422c-b3cc-bd18e886838a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:12.570938 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c3be7-bcc1-422c-b3cc-bd18e886838a admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:12.571717 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c3be7-bcc1-422c-b3cc-bd18e886838a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:12.574513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c3be7-bcc1-422c-b3cc-bd18e886838a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:12.585307 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1259/2549] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:46:12.589759 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461b326-99d8-4e23-a69a-e38e97b2160c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:12.600539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461b326-99d8-4e23-a69a-e38e97b2160c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:12.607805 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a4007-650d-47ee-a49e-14ed2aba4382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:12.608503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a4007-650d-47ee-a49e-14ed2aba4382 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:12.608789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a4007-650d-47ee-a49e-14ed2aba4382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:12.609068 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a4007-650d-47ee-a49e-14ed2aba4382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:12.609859 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a4007-650d-47ee-a49e-14ed2aba4382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:12.611502 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a4007-650d-47ee-a49e-14ed2aba4382 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:12.623455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1291/2550] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:46:12.631619 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c3be7-bcc1-422c-b3cc-bd18e886838a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:12.646015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c3be7-bcc1-422c-b3cc-bd18e886838a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:12.647598 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9210cc-c40f-4284-868f-18fd032883b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:12.648627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9210cc-c40f-4284-868f-18fd032883b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:12.648913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9210cc-c40f-4284-868f-18fd032883b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:12.649183 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9210cc-c40f-4284-868f-18fd032883b1 admin admin] PATH_INFO: `/v3/projects/7b7f8de890ca4b1a82898a24488b32dd/users/c4a915f6c02d4facb64d5332904f9fe6/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:12.667251 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9210cc-c40f-4284-868f-18fd032883b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7f8de890ca4b1a82898a24488b32dd, user_id=c4a915f6c02d4facb64d5332904f9fe6, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:12.674822 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9210cc-c40f-4284-868f-18fd032883b1 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:12.751653 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1260/2551] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:46:12 2022] PUT /identity/v3/projects/7b7f8de890ca4b1a82898a24488b32dd/users/c4a915f6c02d4facb64d5332904f9fe6/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:46:12.756821 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14885e-c254-4941-81dd-206fae157615 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:12.757107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14885e-c254-4941-81dd-206fae157615 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:12.757413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14885e-c254-4941-81dd-206fae157615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:12.775873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7e14885e-c254-4941-81dd-206fae157615 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:46:12.777344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7e14885e-c254-4941-81dd-206fae157615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:12.838929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1292/2552] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:46:12.848835 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9210cc-c40f-4284-868f-18fd032883b1 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:12.850880 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8d9210cc-c40f-4284-868f-18fd032883b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:12.873083 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:12.912874 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9210cc-c40f-4284-868f-18fd032883b1 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:12.916895 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db96cf-8d25-476b-9632-11a18d5d560c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:12.917618 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db96cf-8d25-476b-9632-11a18d5d560c service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:12.917902 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db96cf-8d25-476b-9632-11a18d5d560c service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:12.918173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db96cf-8d25-476b-9632-11a18d5d560c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:12.927622 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db96cf-8d25-476b-9632-11a18d5d560c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:12.929062 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db96cf-8d25-476b-9632-11a18d5d560c service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:12.939543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1261/2553] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:46:18.539146 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfe8bf-174e-464f-860b-0c94dbb533df None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:18.539637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfe8bf-174e-464f-860b-0c94dbb533df None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:18.539734 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfe8bf-174e-464f-860b-0c94dbb533df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:18.609637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-00bfe8bf-174e-464f-860b-0c94dbb533df None None] MFA Rules not processed for user `c4a915f6c02d4facb64d5332904f9fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:46:18.611235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-00bfe8bf-174e-464f-860b-0c94dbb533df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:18.633975 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:18.698613 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1293/2554] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:46:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:46:18.703354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db96cf-8d25-476b-9632-11a18d5d560c service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:18.714508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db96cf-8d25-476b-9632-11a18d5d560c service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:18.719372 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fe59c-48ce-4ae1-be7c-c376fdfddc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:18.720045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fe59c-48ce-4ae1-be7c-c376fdfddc9b admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:18.720324 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fe59c-48ce-4ae1-be7c-c376fdfddc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:18.720599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fe59c-48ce-4ae1-be7c-c376fdfddc9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:18.721297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fe59c-48ce-4ae1-be7c-c376fdfddc9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:18.723277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fe59c-48ce-4ae1-be7c-c376fdfddc9b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:18.853801 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1262/2555] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:46:18 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:46:18.857896 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfe8bf-174e-464f-860b-0c94dbb533df None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:18.870520 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfe8bf-174e-464f-860b-0c94dbb533df None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:18.930271 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848edfa-44e1-4f87-a689-a254223be068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:18.930897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848edfa-44e1-4f87-a689-a254223be068 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:18.931726 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848edfa-44e1-4f87-a689-a254223be068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:18.932228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848edfa-44e1-4f87-a689-a254223be068 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:18.933089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848edfa-44e1-4f87-a689-a254223be068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:18.935210 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848edfa-44e1-4f87-a689-a254223be068 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:19.015933 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1294/2556] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:46:18 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:46:19.019410 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fe59c-48ce-4ae1-be7c-c376fdfddc9b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:19.030697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fe59c-48ce-4ae1-be7c-c376fdfddc9b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:19.035580 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc8e5a-0a0e-4490-9d8c-120ba2bde849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:19.036255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc8e5a-0a0e-4490-9d8c-120ba2bde849 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:19.036535 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc8e5a-0a0e-4490-9d8c-120ba2bde849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:19.036806 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc8e5a-0a0e-4490-9d8c-120ba2bde849 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:19.037560 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc8e5a-0a0e-4490-9d8c-120ba2bde849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:19.039179 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc8e5a-0a0e-4490-9d8c-120ba2bde849 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:19.051311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1263/2557] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:46:19.055451 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848edfa-44e1-4f87-a689-a254223be068 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:19.066386 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848edfa-44e1-4f87-a689-a254223be068 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:19.071241 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7e9a6-92df-4e13-9248-041c73b874d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:19.072370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7e9a6-92df-4e13-9248-041c73b874d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:19.072647 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7e9a6-92df-4e13-9248-041c73b874d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:19.072946 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7e9a6-92df-4e13-9248-041c73b874d9 admin admin] PATH_INFO: `/v3/projects/850c79a1c40a40b88eee619a828bda8b/users/799ae61a570740ae95e70903f80d4066/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:19.089761 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7e9a6-92df-4e13-9248-041c73b874d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=850c79a1c40a40b88eee619a828bda8b, user_id=799ae61a570740ae95e70903f80d4066, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:19.092465 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7e9a6-92df-4e13-9248-041c73b874d9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:19.196001 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1295/2558] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:46:19 2022] PUT /identity/v3/projects/850c79a1c40a40b88eee619a828bda8b/users/799ae61a570740ae95e70903f80d4066/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:46:19.196211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc8e5a-0a0e-4490-9d8c-120ba2bde849 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:19.205309 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc8e5a-0a0e-4490-9d8c-120ba2bde849 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:19.263400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b5953-e0fe-44c7-90af-02e34d02d47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:19.264070 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b5953-e0fe-44c7-90af-02e34d02d47f admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:19.264354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b5953-e0fe-44c7-90af-02e34d02d47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:19.264645 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b5953-e0fe-44c7-90af-02e34d02d47f admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:19.265432 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b5953-e0fe-44c7-90af-02e34d02d47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:19.267034 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b5953-e0fe-44c7-90af-02e34d02d47f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:19.277121 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1264/2559] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:46:19.281498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7e9a6-92df-4e13-9248-041c73b874d9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:19.292410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7e9a6-92df-4e13-9248-041c73b874d9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:19.297159 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bad98c-47eb-4220-ad34-fee1ad542af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:19.298145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bad98c-47eb-4220-ad34-fee1ad542af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:19.298423 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bad98c-47eb-4220-ad34-fee1ad542af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:19.298697 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bad98c-47eb-4220-ad34-fee1ad542af1 admin admin] PATH_INFO: `/v3/projects/850c79a1c40a40b88eee619a828bda8b/users/799ae61a570740ae95e70903f80d4066/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:19.300669 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bad98c-47eb-4220-ad34-fee1ad542af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=850c79a1c40a40b88eee619a828bda8b, user_id=799ae61a570740ae95e70903f80d4066, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:19.303396 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bad98c-47eb-4220-ad34-fee1ad542af1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:19.314988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1296/2560] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:46:19 2022] PUT /identity/v3/projects/850c79a1c40a40b88eee619a828bda8b/users/799ae61a570740ae95e70903f80d4066/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:46:25.116019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075f5c1-02e6-4e80-8f1b-84adb129d9c1 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:25.116563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075f5c1-02e6-4e80-8f1b-84adb129d9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:25.116563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075f5c1-02e6-4e80-8f1b-84adb129d9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:25.158108 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6075f5c1-02e6-4e80-8f1b-84adb129d9c1 None None] MFA Rules not processed for user `799ae61a570740ae95e70903f80d4066`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:46:25.159611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6075f5c1-02e6-4e80-8f1b-84adb129d9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:25.247964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1265/2561] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:46:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:46:25.261546 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bad98c-47eb-4220-ad34-fee1ad542af1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:25.262999 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-87bad98c-47eb-4220-ad34-fee1ad542af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:25.346507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bad98c-47eb-4220-ad34-fee1ad542af1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:25.351763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d250e-e611-4cc5-b6fb-52133df61aa5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde4369f695745c199ce6c10d241b841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:25.353107 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d250e-e611-4cc5-b6fb-52133df61aa5 service glance] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:25.353421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d250e-e611-4cc5-b6fb-52133df61aa5 service glance] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:25.353705 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d250e-e611-4cc5-b6fb-52133df61aa5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:25.379912 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:25.416253 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d250e-e611-4cc5-b6fb-52133df61aa5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:25.418926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d250e-e611-4cc5-b6fb-52133df61aa5 service glance] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:25.428962 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1297/2562] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:46:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:46:25.685771 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ffbac-8fe3-40a8-9112-88e3388254c7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:25.685771 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ffbac-8fe3-40a8-9112-88e3388254c7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:25.685771 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ffbac-8fe3-40a8-9112-88e3388254c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:25.697154 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-714ffbac-8fe3-40a8-9112-88e3388254c7 None None] MFA Rules not processed for user `9144d74a341b4e08ae353b384fe1186e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:46:25.698525 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-714ffbac-8fe3-40a8-9112-88e3388254c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:25.704986 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:25.785173 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1266/2563] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Jun 17 07:46:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:46:25.802499 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d250e-e611-4cc5-b6fb-52133df61aa5 service glance] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:25.804019 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fe0d250e-e611-4cc5-b6fb-52133df61aa5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:25.891038 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d250e-e611-4cc5-b6fb-52133df61aa5 service glance] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:25.896129 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358664c-b345-452d-b646-556cef33a9e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a18b07c033224d2085773936dad33eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:25.896824 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358664c-b345-452d-b646-556cef33a9e4 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:25.897108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358664c-b345-452d-b646-556cef33a9e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:25.897420 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358664c-b345-452d-b646-556cef33a9e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:25.906440 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358664c-b345-452d-b646-556cef33a9e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:25.908069 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358664c-b345-452d-b646-556cef33a9e4 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:25.917469 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1298/2564] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Jun 17 07:46:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:46:35.817192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=20 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:35.913441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=48 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:36.756697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc43733-fd6c-4492-8856-6ba1222c4600 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:36.757078 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc43733-fd6c-4492-8856-6ba1222c4600 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:36.757447 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc43733-fd6c-4492-8856-6ba1222c4600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:36.776812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0dc43733-fd6c-4492-8856-6ba1222c4600 None None] MFA Rules not processed for user `c4a915f6c02d4facb64d5332904f9fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:46:36.778091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0dc43733-fd6c-4492-8856-6ba1222c4600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:36.785246 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1267/2565] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:46:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:46:37.521615 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358664c-b345-452d-b646-556cef33a9e4 service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:37.523147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5358664c-b345-452d-b646-556cef33a9e4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:37.597724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358664c-b345-452d-b646-556cef33a9e4 service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:37.603405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532f2a1-7a51-4dc9-bd92-f16ae553f539 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adc8b93e5c41929b928002e004df6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:37.604050 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532f2a1-7a51-4dc9-bd92-f16ae553f539 service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:37.604336 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532f2a1-7a51-4dc9-bd92-f16ae553f539 service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:37.604614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532f2a1-7a51-4dc9-bd92-f16ae553f539 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:37.606431 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1532f2a1-7a51-4dc9-bd92-f16ae553f539 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:37.618920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532f2a1-7a51-4dc9-bd92-f16ae553f539 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:37.620535 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532f2a1-7a51-4dc9-bd92-f16ae553f539 service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:37.630806 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1299/2566] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:46:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:46:40.984762 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d50f76-5422-479b-9cf5-d6001dc8bb27 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:40.985359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d50f76-5422-479b-9cf5-d6001dc8bb27 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:40.985359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d50f76-5422-479b-9cf5-d6001dc8bb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:41.005435 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-08d50f76-5422-479b-9cf5-d6001dc8bb27 None None] MFA Rules not processed for user `9144d74a341b4e08ae353b384fe1186e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:46:41.006812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-08d50f76-5422-479b-9cf5-d6001dc8bb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:41.015268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1268/2567] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Jun 17 07:46:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:46:41.030292 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532f2a1-7a51-4dc9-bd92-f16ae553f539 service placement] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:41.042906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532f2a1-7a51-4dc9-bd92-f16ae553f539 service placement] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:41.048084 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdadfe1-6cb5-4a1c-be9d-e37f686448dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a18b07c033224d2085773936dad33eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:41.051626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdadfe1-6cb5-4a1c-be9d-e37f686448dc service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:41.051626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdadfe1-6cb5-4a1c-be9d-e37f686448dc service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:41.051626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdadfe1-6cb5-4a1c-be9d-e37f686448dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:41.058958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdadfe1-6cb5-4a1c-be9d-e37f686448dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:41.060557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdadfe1-6cb5-4a1c-be9d-e37f686448dc service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:41.069230 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1300/2568] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Jun 17 07:46:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:46:50.998782 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=6 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:51.065767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=38 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:56.541474 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d50f76-5422-479b-9cf5-d6001dc8bb27 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:46:56.544519 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-08d50f76-5422-479b-9cf5-d6001dc8bb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:56.713992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d50f76-5422-479b-9cf5-d6001dc8bb27 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:46:56.730735 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af454d33-bc74-4dfd-af03-c8f25d20520a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:46:56.730735 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af454d33-bc74-4dfd-af03-c8f25d20520a service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:46:56.730735 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af454d33-bc74-4dfd-af03-c8f25d20520a service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:46:56.730735 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af454d33-bc74-4dfd-af03-c8f25d20520a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:46:56.731485 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-af454d33-bc74-4dfd-af03-c8f25d20520a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:46:56.739075 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af454d33-bc74-4dfd-af03-c8f25d20520a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:46:56.741639 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af454d33-bc74-4dfd-af03-c8f25d20520a service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:46:56.753820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1269/2569] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:46:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:47:06.748281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=56 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:09.548097 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdadfe1-6cb5-4a1c-be9d-e37f686448dc service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:09.549712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ebdadfe1-6cb5-4a1c-be9d-e37f686448dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:09.645434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdadfe1-6cb5-4a1c-be9d-e37f686448dc service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:09.649264 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa2801-34b9-4c80-ad59-8fda7476e6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:09.649955 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa2801-34b9-4c80-ad59-8fda7476e6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:09.650233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa2801-34b9-4c80-ad59-8fda7476e6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:09.650505 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa2801-34b9-4c80-ad59-8fda7476e6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:09.652307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ceaa2801-34b9-4c80-ad59-8fda7476e6f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:09.744119 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa2801-34b9-4c80-ad59-8fda7476e6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:09.745622 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa2801-34b9-4c80-ad59-8fda7476e6f9 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:09.767562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1301/2570] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:47:13.573300 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af454d33-bc74-4dfd-af03-c8f25d20520a service nova] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:13.574847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-af454d33-bc74-4dfd-af03-c8f25d20520a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:13.588848 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af454d33-bc74-4dfd-af03-c8f25d20520a service nova] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:13.593434 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94df85-8215-4e1c-94b1-ac1ad8630a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:13.594574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94df85-8215-4e1c-94b1-ac1ad8630a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:13.594853 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94df85-8215-4e1c-94b1-ac1ad8630a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:13.595128 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94df85-8215-4e1c-94b1-ac1ad8630a60 admin admin] PATH_INFO: `/v3/users/c9c07cf08d9c45479f9530efe9dcad2a` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:13.609264 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94df85-8215-4e1c-94b1-ac1ad8630a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c07cf08d9c45479f9530efe9dcad2a)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:13.611255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94df85-8215-4e1c-94b1-ac1ad8630a60 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:13.802290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ae94df85-8215-4e1c-94b1-ac1ad8630a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c07cf08d9c45479f9530efe9dcad2a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:13.814357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ae94df85-8215-4e1c-94b1-ac1ad8630a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c07cf08d9c45479f9530efe9dcad2a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:13.815085 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ae94df85-8215-4e1c-94b1-ac1ad8630a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c07cf08d9c45479f9530efe9dcad2a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:13.815776 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ae94df85-8215-4e1c-94b1-ac1ad8630a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c07cf08d9c45479f9530efe9dcad2a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:13.826130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ae94df85-8215-4e1c-94b1-ac1ad8630a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c07cf08d9c45479f9530efe9dcad2a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:13.901517 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1270/2571] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:47:13 2022] DELETE /identity/v3/users/c9c07cf08d9c45479f9530efe9dcad2a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:47:14.147950 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa2801-34b9-4c80-ad59-8fda7476e6f9 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:14.158629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa2801-34b9-4c80-ad59-8fda7476e6f9 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:14.210078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:14.220101 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf0916-dd01-4c2b-9666-dbe3d87d4dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:14.225314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf0916-dd01-4c2b-9666-dbe3d87d4dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:14.225314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf0916-dd01-4c2b-9666-dbe3d87d4dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:14.225314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf0916-dd01-4c2b-9666-dbe3d87d4dae admin admin] PATH_INFO: `/v3/projects/ae461627578a489a9a6a9569cee15eb8` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:14.233182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf0916-dd01-4c2b-9666-dbe3d87d4dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae461627578a489a9a6a9569cee15eb8)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:14.235151 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf0916-dd01-4c2b-9666-dbe3d87d4dae admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:14.378632 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ffbf0916-dd01-4c2b-9666-dbe3d87d4dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae461627578a489a9a6a9569cee15eb8', 'request_id': 'req-ffbf0916-dd01-4c2b-9666-dbe3d87d4dae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:14.444029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ffbf0916-dd01-4c2b-9666-dbe3d87d4dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae461627578a489a9a6a9569cee15eb8', 'request_id': 'req-ffbf0916-dd01-4c2b-9666-dbe3d87d4dae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:14.451877 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ffbf0916-dd01-4c2b-9666-dbe3d87d4dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae461627578a489a9a6a9569cee15eb8', 'request_id': 'req-ffbf0916-dd01-4c2b-9666-dbe3d87d4dae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:14.463115 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ffbf0916-dd01-4c2b-9666-dbe3d87d4dae admin admin] The token cache is being invalidate because project ae461627578a489a9a6a9569cee15eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:47:14.463403 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ffbf0916-dd01-4c2b-9666-dbe3d87d4dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:14.464053 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ffbf0916-dd01-4c2b-9666-dbe3d87d4dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:14.465720 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1302/2572] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:47:14 2022] DELETE /identity/v3/projects/ae461627578a489a9a6a9569cee15eb8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:47:14.471057 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a68f7-144c-4b14-8ac1-c39d4c001e82 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:14.471349 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a68f7-144c-4b14-8ac1-c39d4c001e82 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:14.471626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a68f7-144c-4b14-8ac1-c39d4c001e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:14.539784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-bc4a68f7-144c-4b14-8ac1-c39d4c001e82 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:14.541094 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-bc4a68f7-144c-4b14-8ac1-c39d4c001e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:14.628027 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1271/2573] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:47:14.642552 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fa502-d661-43ec-a1fa-dad0ec8f50ab None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:14.642552 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fa502-d661-43ec-a1fa-dad0ec8f50ab None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:14.642552 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fa502-d661-43ec-a1fa-dad0ec8f50ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:14.665069 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-344fa502-d661-43ec-a1fa-dad0ec8f50ab None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:14.666320 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-344fa502-d661-43ec-a1fa-dad0ec8f50ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:14.675261 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1303/2574] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:47:14.680663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a68f7-144c-4b14-8ac1-c39d4c001e82 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:14.693918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a68f7-144c-4b14-8ac1-c39d4c001e82 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:14.698761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b6b7f-b9ca-48d2-af8f-141f1304884d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:14.699445 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b6b7f-b9ca-48d2-af8f-141f1304884d admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:14.699891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b6b7f-b9ca-48d2-af8f-141f1304884d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:14.700177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b6b7f-b9ca-48d2-af8f-141f1304884d admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:14.701115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b6b7f-b9ca-48d2-af8f-141f1304884d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:47:14.701251 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b6b7f-b9ca-48d2-af8f-141f1304884d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:14.702878 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b6b7f-b9ca-48d2-af8f-141f1304884d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:14.717136 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1272/2575] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:47:14.721928 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fa502-d661-43ec-a1fa-dad0ec8f50ab None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:14.733553 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fa502-d661-43ec-a1fa-dad0ec8f50ab None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:14.739275 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5c18e-137c-405b-b4f8-31c39c963404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:14.739993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5c18e-137c-405b-b4f8-31c39c963404 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:14.740270 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5c18e-137c-405b-b4f8-31c39c963404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:14.740542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5c18e-137c-405b-b4f8-31c39c963404 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:14.741236 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5c18e-137c-405b-b4f8-31c39c963404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:14.743195 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5c18e-137c-405b-b4f8-31c39c963404 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:14.828382 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1304/2576] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:47:14 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:47:14.833528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b6b7f-b9ca-48d2-af8f-141f1304884d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:14.846241 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b6b7f-b9ca-48d2-af8f-141f1304884d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:14.866253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:14.923400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbae0d4-6e83-4482-9174-98ed7f87b61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:14.923994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbae0d4-6e83-4482-9174-98ed7f87b61e admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:14.924283 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbae0d4-6e83-4482-9174-98ed7f87b61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:14.925268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbae0d4-6e83-4482-9174-98ed7f87b61e admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:14.925268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbae0d4-6e83-4482-9174-98ed7f87b61e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:14.929084 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbae0d4-6e83-4482-9174-98ed7f87b61e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:15.050873 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1273/2577] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:47:14 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:47:15.056575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5c18e-137c-405b-b4f8-31c39c963404 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:15.067702 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5c18e-137c-405b-b4f8-31c39c963404 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:15.073226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b8b1e-701c-420d-a7c6-24e3bb6a18e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:15.074082 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8b1e-701c-420d-a7c6-24e3bb6a18e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:15.074370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8b1e-701c-420d-a7c6-24e3bb6a18e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:15.074648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8b1e-701c-420d-a7c6-24e3bb6a18e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:15.075656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b8b1e-701c-420d-a7c6-24e3bb6a18e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:15.077282 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b8b1e-701c-420d-a7c6-24e3bb6a18e2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:15.090254 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1305/2578] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:47:15.094794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbae0d4-6e83-4482-9174-98ed7f87b61e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:15.107113 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbae0d4-6e83-4482-9174-98ed7f87b61e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:15.112869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f13a21-83f6-46d9-ab72-ab43711c5e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:15.114210 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f13a21-83f6-46d9-ab72-ab43711c5e1b admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:15.114606 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f13a21-83f6-46d9-ab72-ab43711c5e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:15.114983 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f13a21-83f6-46d9-ab72-ab43711c5e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:15.115828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f13a21-83f6-46d9-ab72-ab43711c5e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:15.117888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f13a21-83f6-46d9-ab72-ab43711c5e1b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:15.131209 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1274/2579] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:47:15.135761 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b8b1e-701c-420d-a7c6-24e3bb6a18e2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:15.147486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b8b1e-701c-420d-a7c6-24e3bb6a18e2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:15.152274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5c98d-ccd1-4edd-b67c-4319562d05da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:15.153690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5c98d-ccd1-4edd-b67c-4319562d05da admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:15.154157 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5c98d-ccd1-4edd-b67c-4319562d05da admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:15.154443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5c98d-ccd1-4edd-b67c-4319562d05da admin admin] PATH_INFO: `/v3/projects/2b6698fe4fa84871a3685aac8856970a/users/3af78d3ebe2548f280d84fff4d6cb644/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:15.192287 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5c98d-ccd1-4edd-b67c-4319562d05da admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6698fe4fa84871a3685aac8856970a, user_id=3af78d3ebe2548f280d84fff4d6cb644, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:15.192287 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5c98d-ccd1-4edd-b67c-4319562d05da admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:15.267193 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1306/2580] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:47:15 2022] PUT /identity/v3/projects/2b6698fe4fa84871a3685aac8856970a/users/3af78d3ebe2548f280d84fff4d6cb644/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:47:15.275163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ca6fa-f7fe-4f9e-bd5f-95561001e0ff None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:15.275163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ca6fa-f7fe-4f9e-bd5f-95561001e0ff None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:15.275499 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ca6fa-f7fe-4f9e-bd5f-95561001e0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:15.297031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-759ca6fa-f7fe-4f9e-bd5f-95561001e0ff None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:15.298713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-759ca6fa-f7fe-4f9e-bd5f-95561001e0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:15.379663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1275/2581] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:47:15.389656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5c98d-ccd1-4edd-b67c-4319562d05da admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:15.391514 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-28f5c98d-ccd1-4edd-b67c-4319562d05da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:15.456034 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5c98d-ccd1-4edd-b67c-4319562d05da admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:15.459949 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20049c7-b403-40ef-b0fa-4ae45a4092af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:15.460636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20049c7-b403-40ef-b0fa-4ae45a4092af service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:15.460918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20049c7-b403-40ef-b0fa-4ae45a4092af service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:15.461189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20049c7-b403-40ef-b0fa-4ae45a4092af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:15.472631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20049c7-b403-40ef-b0fa-4ae45a4092af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:15.474610 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20049c7-b403-40ef-b0fa-4ae45a4092af service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:15.485569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1307/2582] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:47:18.853673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ca6fa-f7fe-4f9e-bd5f-95561001e0ff None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:18.861789 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-759ca6fa-f7fe-4f9e-bd5f-95561001e0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:18.876273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ca6fa-f7fe-4f9e-bd5f-95561001e0ff None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:18.912482 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876d4f3-2789-4daa-bc3b-c52297f084a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:18.912482 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876d4f3-2789-4daa-bc3b-c52297f084a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:18.912482 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876d4f3-2789-4daa-bc3b-c52297f084a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:18.912482 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876d4f3-2789-4daa-bc3b-c52297f084a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:18.916216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3876d4f3-2789-4daa-bc3b-c52297f084a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:19.070807 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876d4f3-2789-4daa-bc3b-c52297f084a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:19.072993 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876d4f3-2789-4daa-bc3b-c52297f084a3 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:19.100840 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1276/2583] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:47:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:47:21.446651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee6833-c993-48d3-a99a-f4d10c80cf29 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:21.446651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee6833-c993-48d3-a99a-f4d10c80cf29 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:21.446651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee6833-c993-48d3-a99a-f4d10c80cf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:21.446651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:21.454544 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-89ee6833-c993-48d3-a99a-f4d10c80cf29 None None] MFA Rules not processed for user `3af78d3ebe2548f280d84fff4d6cb644`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:21.455805 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-89ee6833-c993-48d3-a99a-f4d10c80cf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:21.545061 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1308/2584] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:47:21.559756 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876d4f3-2789-4daa-bc3b-c52297f084a3 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:21.561265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3876d4f3-2789-4daa-bc3b-c52297f084a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:21.600028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:21.651163 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876d4f3-2789-4daa-bc3b-c52297f084a3 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:21.657818 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd99622-0083-49f3-b639-804b84ff6e5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:21.658567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd99622-0083-49f3-b639-804b84ff6e5c service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:21.658916 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd99622-0083-49f3-b639-804b84ff6e5c service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:21.659254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd99622-0083-49f3-b639-804b84ff6e5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:21.676471 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd99622-0083-49f3-b639-804b84ff6e5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:21.678172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd99622-0083-49f3-b639-804b84ff6e5c service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:21.688979 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1277/2585] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:47:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:47:22.074036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee6833-c993-48d3-a99a-f4d10c80cf29 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:22.076512 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-89ee6833-c993-48d3-a99a-f4d10c80cf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:22.101102 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee6833-c993-48d3-a99a-f4d10c80cf29 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:22.109570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726702f9-1629-41da-88d5-893dd5784ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:22.110848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726702f9-1629-41da-88d5-893dd5784ab7 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:22.111152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726702f9-1629-41da-88d5-893dd5784ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:22.111433 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726702f9-1629-41da-88d5-893dd5784ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:22.114368 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-726702f9-1629-41da-88d5-893dd5784ab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:22.131639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726702f9-1629-41da-88d5-893dd5784ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:22.134119 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726702f9-1629-41da-88d5-893dd5784ab7 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:22.155789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1309/2586] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:47:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:47:23.775578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd99622-0083-49f3-b639-804b84ff6e5c service nova] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:23.805794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd99622-0083-49f3-b639-804b84ff6e5c service nova] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:23.810505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2ae6b-b707-48a9-b296-1974530220de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:23.811168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2ae6b-b707-48a9-b296-1974530220de service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:23.811168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2ae6b-b707-48a9-b296-1974530220de service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:23.811369 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2ae6b-b707-48a9-b296-1974530220de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:23.819478 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-29a2ae6b-b707-48a9-b296-1974530220de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:24.074644 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2ae6b-b707-48a9-b296-1974530220de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:24.076182 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2ae6b-b707-48a9-b296-1974530220de service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:24.117246 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1278/2587] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:47:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:47:25.829723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989a857-aadb-4c5a-afa3-144a448ff96f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:25.834900 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989a857-aadb-4c5a-afa3-144a448ff96f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:25.834900 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989a857-aadb-4c5a-afa3-144a448ff96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:25.856909 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c989a857-aadb-4c5a-afa3-144a448ff96f None None] MFA Rules not processed for user `3af78d3ebe2548f280d84fff4d6cb644`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:25.858360 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c989a857-aadb-4c5a-afa3-144a448ff96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:25.868021 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1310/2588] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:47:26.469696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2ae6b-b707-48a9-b296-1974530220de service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:26.484328 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2ae6b-b707-48a9-b296-1974530220de service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:26.498034 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafdc9d0-8aec-45b8-be47-1e4a746b2416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:26.499720 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdc9d0-8aec-45b8-be47-1e4a746b2416 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:26.503328 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdc9d0-8aec-45b8-be47-1e4a746b2416 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:26.504097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdc9d0-8aec-45b8-be47-1e4a746b2416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:26.507844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fafdc9d0-8aec-45b8-be47-1e4a746b2416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:26.540320 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafdc9d0-8aec-45b8-be47-1e4a746b2416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:26.542357 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafdc9d0-8aec-45b8-be47-1e4a746b2416 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:26.553124 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1279/2589] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:47:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:47:29.836824 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989a857-aadb-4c5a-afa3-144a448ff96f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:29.847651 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989a857-aadb-4c5a-afa3-144a448ff96f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:29.851528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b08d63-21e9-4c7a-aa90-e575e8691d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:29.852215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b08d63-21e9-4c7a-aa90-e575e8691d50 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:29.852498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b08d63-21e9-4c7a-aa90-e575e8691d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:29.852784 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b08d63-21e9-4c7a-aa90-e575e8691d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:29.854610 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-56b08d63-21e9-4c7a-aa90-e575e8691d50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:29.867853 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b08d63-21e9-4c7a-aa90-e575e8691d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:29.869422 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b08d63-21e9-4c7a-aa90-e575e8691d50 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:29.880546 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1311/2590] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:47:34.173812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafdc9d0-8aec-45b8-be47-1e4a746b2416 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:34.175759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fafdc9d0-8aec-45b8-be47-1e4a746b2416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:34.192574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafdc9d0-8aec-45b8-be47-1e4a746b2416 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:34.197586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a4eb4-36f7-4798-bc1e-ab73bcc99f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:34.198590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a4eb4-36f7-4798-bc1e-ab73bcc99f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:34.198925 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a4eb4-36f7-4798-bc1e-ab73bcc99f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:34.199279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a4eb4-36f7-4798-bc1e-ab73bcc99f27 admin admin] PATH_INFO: `/v3/users/a3ea40ad7d7546449f60539341abc545` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:34.200589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a4eb4-36f7-4798-bc1e-ab73bcc99f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3ea40ad7d7546449f60539341abc545)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:34.202910 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a4eb4-36f7-4798-bc1e-ab73bcc99f27 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:34.428073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e69a4eb4-36f7-4798-bc1e-ab73bcc99f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3ea40ad7d7546449f60539341abc545'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:34.481826 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e69a4eb4-36f7-4798-bc1e-ab73bcc99f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3ea40ad7d7546449f60539341abc545'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:34.482605 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e69a4eb4-36f7-4798-bc1e-ab73bcc99f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3ea40ad7d7546449f60539341abc545'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:34.483233 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e69a4eb4-36f7-4798-bc1e-ab73bcc99f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3ea40ad7d7546449f60539341abc545'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:34.486916 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:34.495006 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e69a4eb4-36f7-4798-bc1e-ab73bcc99f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3ea40ad7d7546449f60539341abc545'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:34.589613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1280/2591] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:47:34 2022] DELETE /identity/v3/users/a3ea40ad7d7546449f60539341abc545 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:47:34.914733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b08d63-21e9-4c7a-aa90-e575e8691d50 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:34.943340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b08d63-21e9-4c7a-aa90-e575e8691d50 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:35.034014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c10f8-7d98-40c8-af8e-8c0b18ed4233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:35.035314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c10f8-7d98-40c8-af8e-8c0b18ed4233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:35.035818 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c10f8-7d98-40c8-af8e-8c0b18ed4233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:35.036612 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c10f8-7d98-40c8-af8e-8c0b18ed4233 admin admin] PATH_INFO: `/v3/projects/8432e3c517624c449606ca1201f2be12` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:35.038219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c10f8-7d98-40c8-af8e-8c0b18ed4233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8432e3c517624c449606ca1201f2be12)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:35.040686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c10f8-7d98-40c8-af8e-8c0b18ed4233 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:35.183356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f26c10f8-7d98-40c8-af8e-8c0b18ed4233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8432e3c517624c449606ca1201f2be12', 'request_id': 'req-f26c10f8-7d98-40c8-af8e-8c0b18ed4233'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:35.266777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f26c10f8-7d98-40c8-af8e-8c0b18ed4233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8432e3c517624c449606ca1201f2be12', 'request_id': 'req-f26c10f8-7d98-40c8-af8e-8c0b18ed4233'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:35.274401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f26c10f8-7d98-40c8-af8e-8c0b18ed4233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8432e3c517624c449606ca1201f2be12', 'request_id': 'req-f26c10f8-7d98-40c8-af8e-8c0b18ed4233'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:35.281840 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:35.287177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f26c10f8-7d98-40c8-af8e-8c0b18ed4233 admin admin] The token cache is being invalidate because project 8432e3c517624c449606ca1201f2be12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:47:35.287472 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f26c10f8-7d98-40c8-af8e-8c0b18ed4233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:35.288237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f26c10f8-7d98-40c8-af8e-8c0b18ed4233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:35.289911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1312/2592] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:47:34 2022] DELETE /identity/v3/projects/8432e3c517624c449606ca1201f2be12 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:47:35.296634 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1d100-a96b-4167-8135-fcc283878312 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:35.308905 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1d100-a96b-4167-8135-fcc283878312 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:35.308905 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1d100-a96b-4167-8135-fcc283878312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:35.320023 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0db1d100-a96b-4167-8135-fcc283878312 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:35.320715 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0db1d100-a96b-4167-8135-fcc283878312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:35.410970 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1281/2593] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:47:35.413262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157b86c-c58b-465f-a255-8f9cb0229bc1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:35.413832 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157b86c-c58b-465f-a255-8f9cb0229bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:35.414367 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157b86c-c58b-465f-a255-8f9cb0229bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:35.464675 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7157b86c-c58b-465f-a255-8f9cb0229bc1 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:35.464675 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7157b86c-c58b-465f-a255-8f9cb0229bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:35.468274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1313/2594] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:47:35.473480 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1d100-a96b-4167-8135-fcc283878312 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:35.484504 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1d100-a96b-4167-8135-fcc283878312 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:35.490752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d441d01-7188-47b9-89e4-285080966f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:35.491482 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d441d01-7188-47b9-89e4-285080966f1e admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:35.491735 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d441d01-7188-47b9-89e4-285080966f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:35.492014 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d441d01-7188-47b9-89e4-285080966f1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:35.492755 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d441d01-7188-47b9-89e4-285080966f1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:47:35.493065 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d441d01-7188-47b9-89e4-285080966f1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:35.494763 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d441d01-7188-47b9-89e4-285080966f1e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:35.509744 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1282/2595] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:47:35.514188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157b86c-c58b-465f-a255-8f9cb0229bc1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:35.524787 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157b86c-c58b-465f-a255-8f9cb0229bc1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:35.531892 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c4541-b1c5-4447-82da-58d002a9196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:35.532659 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c4541-b1c5-4447-82da-58d002a9196b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:35.533208 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c4541-b1c5-4447-82da-58d002a9196b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:35.533585 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c4541-b1c5-4447-82da-58d002a9196b admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:35.535255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c4541-b1c5-4447-82da-58d002a9196b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:35.536792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c4541-b1c5-4447-82da-58d002a9196b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:35.628671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1314/2596] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:47:35 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:47:35.632942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d441d01-7188-47b9-89e4-285080966f1e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:35.653205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d441d01-7188-47b9-89e4-285080966f1e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:35.725774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc2056-1690-4e5d-9227-3dc776b6961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:35.726466 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc2056-1690-4e5d-9227-3dc776b6961d admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:35.726746 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc2056-1690-4e5d-9227-3dc776b6961d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:35.727024 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc2056-1690-4e5d-9227-3dc776b6961d admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:35.727966 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc2056-1690-4e5d-9227-3dc776b6961d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:35.729894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc2056-1690-4e5d-9227-3dc776b6961d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:35.825408 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1283/2597] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:47:35 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:47:35.828072 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c4541-b1c5-4447-82da-58d002a9196b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:35.844700 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c4541-b1c5-4447-82da-58d002a9196b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:35.852241 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ac245-ae49-42bc-96e3-0389bc1385b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:35.853036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ac245-ae49-42bc-96e3-0389bc1385b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:35.857253 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ac245-ae49-42bc-96e3-0389bc1385b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:35.857253 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ac245-ae49-42bc-96e3-0389bc1385b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:35.857253 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ac245-ae49-42bc-96e3-0389bc1385b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:35.857253 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ac245-ae49-42bc-96e3-0389bc1385b3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:35.868598 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1315/2598] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:47:35.872804 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc2056-1690-4e5d-9227-3dc776b6961d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:35.883691 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc2056-1690-4e5d-9227-3dc776b6961d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:35.893380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e02e43-0ade-4253-87bd-933d0eba0830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:35.893380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e02e43-0ade-4253-87bd-933d0eba0830 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:35.893380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e02e43-0ade-4253-87bd-933d0eba0830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:35.893380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e02e43-0ade-4253-87bd-933d0eba0830 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:35.893898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e02e43-0ade-4253-87bd-933d0eba0830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:35.893898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e02e43-0ade-4253-87bd-933d0eba0830 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:35.905676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1284/2599] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:47:35.912138 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ac245-ae49-42bc-96e3-0389bc1385b3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:35.923526 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ac245-ae49-42bc-96e3-0389bc1385b3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:35.928622 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2491cdb-362c-4c23-85c8-211440a1293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:35.929729 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2491cdb-362c-4c23-85c8-211440a1293d admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:35.930073 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2491cdb-362c-4c23-85c8-211440a1293d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:35.937100 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2491cdb-362c-4c23-85c8-211440a1293d admin admin] PATH_INFO: `/v3/projects/0cd214928860448c92d3af6bdb15b661/users/2bf6b84f54024f788551de2639479cb8/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:35.946684 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2491cdb-362c-4c23-85c8-211440a1293d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd214928860448c92d3af6bdb15b661, user_id=2bf6b84f54024f788551de2639479cb8, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:35.949666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2491cdb-362c-4c23-85c8-211440a1293d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:36.062172 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1316/2600] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:47:35 2022] PUT /identity/v3/projects/0cd214928860448c92d3af6bdb15b661/users/2bf6b84f54024f788551de2639479cb8/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:47:36.073242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7369a9-75ff-4f69-a138-a5b3381ea14f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:36.073833 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7369a9-75ff-4f69-a138-a5b3381ea14f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:36.074216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7369a9-75ff-4f69-a138-a5b3381ea14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:36.111061 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-ff7369a9-75ff-4f69-a138-a5b3381ea14f None None] MFA Rules not processed for user `2bf6b84f54024f788551de2639479cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:36.113223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ff7369a9-75ff-4f69-a138-a5b3381ea14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:36.165813 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:36.199458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1285/2601] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:47:36.210947 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2491cdb-362c-4c23-85c8-211440a1293d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:36.214161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d2491cdb-362c-4c23-85c8-211440a1293d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:36.338387 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2491cdb-362c-4c23-85c8-211440a1293d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:36.349390 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3618b69-e710-4e2c-9932-15c4db29181b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:36.350071 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3618b69-e710-4e2c-9932-15c4db29181b service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:36.350362 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3618b69-e710-4e2c-9932-15c4db29181b service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:36.350641 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3618b69-e710-4e2c-9932-15c4db29181b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:36.360074 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3618b69-e710-4e2c-9932-15c4db29181b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:36.362333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3618b69-e710-4e2c-9932-15c4db29181b service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:36.372640 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1317/2602] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:47:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:47:39.571647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7369a9-75ff-4f69-a138-a5b3381ea14f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:39.632400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7369a9-75ff-4f69-a138-a5b3381ea14f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:39.637584 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28be3e9-bcde-4d69-8ba6-e4da388f3289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:39.638465 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28be3e9-bcde-4d69-8ba6-e4da388f3289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:39.638912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28be3e9-bcde-4d69-8ba6-e4da388f3289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:39.639237 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28be3e9-bcde-4d69-8ba6-e4da388f3289 admin admin] PATH_INFO: `/v3/users/2bf6b84f54024f788551de2639479cb8` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:39.640457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28be3e9-bcde-4d69-8ba6-e4da388f3289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf6b84f54024f788551de2639479cb8)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:39.642673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28be3e9-bcde-4d69-8ba6-e4da388f3289 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:39.883705 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c28be3e9-bcde-4d69-8ba6-e4da388f3289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf6b84f54024f788551de2639479cb8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:39.896620 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c28be3e9-bcde-4d69-8ba6-e4da388f3289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf6b84f54024f788551de2639479cb8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:39.897352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c28be3e9-bcde-4d69-8ba6-e4da388f3289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf6b84f54024f788551de2639479cb8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:39.897956 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c28be3e9-bcde-4d69-8ba6-e4da388f3289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf6b84f54024f788551de2639479cb8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:39.904935 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c28be3e9-bcde-4d69-8ba6-e4da388f3289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf6b84f54024f788551de2639479cb8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:40.021050 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1286/2603] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:47:39 2022] DELETE /identity/v3/users/2bf6b84f54024f788551de2639479cb8 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:47:40.025580 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e9a6c-81d4-4900-bb62-dd1c6aac9ff1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:40.026086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e9a6c-81d4-4900-bb62-dd1c6aac9ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:40.026183 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e9a6c-81d4-4900-bb62-dd1c6aac9ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:40.044663 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-173e9a6c-81d4-4900-bb62-dd1c6aac9ff1 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:40.045893 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-173e9a6c-81d4-4900-bb62-dd1c6aac9ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:40.106184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1318/2604] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:47:40.115918 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28be3e9-bcde-4d69-8ba6-e4da388f3289 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:40.117315 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c28be3e9-bcde-4d69-8ba6-e4da388f3289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:40.179870 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28be3e9-bcde-4d69-8ba6-e4da388f3289 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:40.183656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf99c51-1c3f-4899-8849-97bad778ed91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:40.184394 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf99c51-1c3f-4899-8849-97bad778ed91 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:40.184880 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf99c51-1c3f-4899-8849-97bad778ed91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:40.185427 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf99c51-1c3f-4899-8849-97bad778ed91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:40.196261 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf99c51-1c3f-4899-8849-97bad778ed91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:40.197878 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf99c51-1c3f-4899-8849-97bad778ed91 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:40.208315 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1287/2605] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:47:40.640764 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e9a6c-81d4-4900-bb62-dd1c6aac9ff1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:40.643714 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-173e9a6c-81d4-4900-bb62-dd1c6aac9ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:40.662513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e9a6c-81d4-4900-bb62-dd1c6aac9ff1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:40.677549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6463c-3797-4ad9-9775-9bb5e6e10801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:40.682869 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6463c-3797-4ad9-9775-9bb5e6e10801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:40.683219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6463c-3797-4ad9-9775-9bb5e6e10801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:40.683548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6463c-3797-4ad9-9775-9bb5e6e10801 admin admin] PATH_INFO: `/v3/projects/0cd214928860448c92d3af6bdb15b661` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:40.686497 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6463c-3797-4ad9-9775-9bb5e6e10801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd214928860448c92d3af6bdb15b661)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:40.687077 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6463c-3797-4ad9-9775-9bb5e6e10801 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:40.722217 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:40.810098 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4f6463c-3797-4ad9-9775-9bb5e6e10801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd214928860448c92d3af6bdb15b661', 'request_id': 'req-d4f6463c-3797-4ad9-9775-9bb5e6e10801'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:40.860597 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4f6463c-3797-4ad9-9775-9bb5e6e10801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd214928860448c92d3af6bdb15b661', 'request_id': 'req-d4f6463c-3797-4ad9-9775-9bb5e6e10801'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:40.870381 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4f6463c-3797-4ad9-9775-9bb5e6e10801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd214928860448c92d3af6bdb15b661', 'request_id': 'req-d4f6463c-3797-4ad9-9775-9bb5e6e10801'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:40.882212 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4f6463c-3797-4ad9-9775-9bb5e6e10801 admin admin] The token cache is being invalidate because project 0cd214928860448c92d3af6bdb15b661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:47:40.882570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4f6463c-3797-4ad9-9775-9bb5e6e10801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:40.883255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4f6463c-3797-4ad9-9775-9bb5e6e10801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:40.885148 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1319/2606] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:47:40 2022] DELETE /identity/v3/projects/0cd214928860448c92d3af6bdb15b661 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:47:40.890322 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404ddc3-e05e-447f-80ef-2369701e760d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:40.890909 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404ddc3-e05e-447f-80ef-2369701e760d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:40.890909 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404ddc3-e05e-447f-80ef-2369701e760d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:40.898273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:40.911935 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8404ddc3-e05e-447f-80ef-2369701e760d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:40.913181 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8404ddc3-e05e-447f-80ef-2369701e760d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:40.979940 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1288/2607] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:47:40.989996 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99505055-6c98-4846-992a-d68567b80506 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:40.990285 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99505055-6c98-4846-992a-d68567b80506 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:40.990563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99505055-6c98-4846-992a-d68567b80506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:41.017671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-99505055-6c98-4846-992a-d68567b80506 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:41.019015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-99505055-6c98-4846-992a-d68567b80506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:41.029067 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1320/2608] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:47:41.033582 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404ddc3-e05e-447f-80ef-2369701e760d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:41.043687 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404ddc3-e05e-447f-80ef-2369701e760d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:41.050487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de24a2-4a30-46f7-858a-805277a58896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:41.051477 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de24a2-4a30-46f7-858a-805277a58896 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:41.051926 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de24a2-4a30-46f7-858a-805277a58896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:41.052282 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de24a2-4a30-46f7-858a-805277a58896 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:41.053030 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de24a2-4a30-46f7-858a-805277a58896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:47:41.053350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de24a2-4a30-46f7-858a-805277a58896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:41.055066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de24a2-4a30-46f7-858a-805277a58896 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:41.068089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1289/2609] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:47:41.072410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99505055-6c98-4846-992a-d68567b80506 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:41.082747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99505055-6c98-4846-992a-d68567b80506 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:41.087910 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc2c3d-3ef4-4af1-9e94-e6fb05401758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:41.088593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2c3d-3ef4-4af1-9e94-e6fb05401758 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:41.088912 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2c3d-3ef4-4af1-9e94-e6fb05401758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:41.089193 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2c3d-3ef4-4af1-9e94-e6fb05401758 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:41.089976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc2c3d-3ef4-4af1-9e94-e6fb05401758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:41.092434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc2c3d-3ef4-4af1-9e94-e6fb05401758 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:41.227573 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1321/2610] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:47:41 2022] POST /identity/v3/projects => generated 405 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:47:41.231566 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de24a2-4a30-46f7-858a-805277a58896 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:41.242503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de24a2-4a30-46f7-858a-805277a58896 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:41.300587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28fab6-00c1-4f89-bb5c-9d6429b96dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:41.301270 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28fab6-00c1-4f89-bb5c-9d6429b96dea admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:41.301589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28fab6-00c1-4f89-bb5c-9d6429b96dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:41.301865 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28fab6-00c1-4f89-bb5c-9d6429b96dea admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:41.302572 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28fab6-00c1-4f89-bb5c-9d6429b96dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:41.304528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28fab6-00c1-4f89-bb5c-9d6429b96dea admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:41.385208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1290/2611] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:47:41 2022] POST /identity/v3/users => generated 303 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:47:41.386437 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc2c3d-3ef4-4af1-9e94-e6fb05401758 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:41.397911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc2c3d-3ef4-4af1-9e94-e6fb05401758 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:41.402813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fb85d-0a17-4e4f-b523-4b8c491889e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:41.403495 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fb85d-0a17-4e4f-b523-4b8c491889e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:41.403771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fb85d-0a17-4e4f-b523-4b8c491889e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:41.404048 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fb85d-0a17-4e4f-b523-4b8c491889e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:41.404771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fb85d-0a17-4e4f-b523-4b8c491889e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:41.406425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fb85d-0a17-4e4f-b523-4b8c491889e4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:41.419200 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1322/2612] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:47:41.423870 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28fab6-00c1-4f89-bb5c-9d6429b96dea admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:41.441226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28fab6-00c1-4f89-bb5c-9d6429b96dea admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:41.449079 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcdf3b-454a-4333-ad0e-59d8fe1278c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:41.452653 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcdf3b-454a-4333-ad0e-59d8fe1278c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:41.452653 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcdf3b-454a-4333-ad0e-59d8fe1278c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:41.452653 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcdf3b-454a-4333-ad0e-59d8fe1278c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:41.452653 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bcdf3b-454a-4333-ad0e-59d8fe1278c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:41.453202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bcdf3b-454a-4333-ad0e-59d8fe1278c5 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:41.467849 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1291/2613] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:47:41.469316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fb85d-0a17-4e4f-b523-4b8c491889e4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:41.480534 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fb85d-0a17-4e4f-b523-4b8c491889e4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:41.486374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3585d5-cece-4976-b824-3007e3f52261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:41.487629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3585d5-cece-4976-b824-3007e3f52261 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:41.487909 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3585d5-cece-4976-b824-3007e3f52261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:41.488185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3585d5-cece-4976-b824-3007e3f52261 admin admin] PATH_INFO: `/v3/projects/e1a670eccc4345aabcc90e821d2b0431/users/db0e4465de7b4f1893d7acb7ac771911/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:41.503941 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3585d5-cece-4976-b824-3007e3f52261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a670eccc4345aabcc90e821d2b0431, user_id=db0e4465de7b4f1893d7acb7ac771911, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:41.506681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3585d5-cece-4976-b824-3007e3f52261 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:41.584901 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1323/2614] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:47:41 2022] PUT /identity/v3/projects/e1a670eccc4345aabcc90e821d2b0431/users/db0e4465de7b4f1893d7acb7ac771911/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:47:41.595398 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e492f54-fa95-4330-926f-11f7e500bbe6 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:41.595693 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e492f54-fa95-4330-926f-11f7e500bbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:41.595971 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e492f54-fa95-4330-926f-11f7e500bbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:41.624258 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-9e492f54-fa95-4330-926f-11f7e500bbe6 None None] MFA Rules not processed for user `db0e4465de7b4f1893d7acb7ac771911`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:41.625507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9e492f54-fa95-4330-926f-11f7e500bbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:41.696617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:41.702305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1292/2615] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:47:41.707396 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3585d5-cece-4976-b824-3007e3f52261 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:41.781354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e492f54-fa95-4330-926f-11f7e500bbe6 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:41.783539 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9e492f54-fa95-4330-926f-11f7e500bbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:41.789208 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3585d5-cece-4976-b824-3007e3f52261 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:41.794276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353f613-1a45-422f-a34e-67dc95a1e109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:41.794957 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f613-1a45-422f-a34e-67dc95a1e109 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:41.795243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f613-1a45-422f-a34e-67dc95a1e109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:41.795524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f613-1a45-422f-a34e-67dc95a1e109 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:41.796239 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353f613-1a45-422f-a34e-67dc95a1e109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:41.798277 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353f613-1a45-422f-a34e-67dc95a1e109 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:41.850546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e492f54-fa95-4330-926f-11f7e500bbe6 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:41.854470 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e97067-f5fc-4157-8522-b90522f9a99c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:41.855194 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e97067-f5fc-4157-8522-b90522f9a99c service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:41.855563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e97067-f5fc-4157-8522-b90522f9a99c service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:41.855956 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e97067-f5fc-4157-8522-b90522f9a99c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:41.857774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e4e97067-f5fc-4157-8522-b90522f9a99c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:41.870976 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e97067-f5fc-4157-8522-b90522f9a99c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:41.872426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e97067-f5fc-4157-8522-b90522f9a99c service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:41.882681 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1293/2616] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:47:41.889993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1324/2617] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:47:41 2022] POST /identity/v3/projects => generated 403 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:47:41.894958 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e97067-f5fc-4157-8522-b90522f9a99c service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:41.905402 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e97067-f5fc-4157-8522-b90522f9a99c service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:41.975424 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d08f8-9cfa-4a9f-ba09-64c3aa2cb6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:41.976116 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d08f8-9cfa-4a9f-ba09-64c3aa2cb6af admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:41.976406 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d08f8-9cfa-4a9f-ba09-64c3aa2cb6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:41.976684 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d08f8-9cfa-4a9f-ba09-64c3aa2cb6af admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:41.977424 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d08f8-9cfa-4a9f-ba09-64c3aa2cb6af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:41.979386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d08f8-9cfa-4a9f-ba09-64c3aa2cb6af admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:42.041155 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1294/2618] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:47:41 2022] POST /identity/v3/users => generated 308 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:47:42.045062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353f613-1a45-422f-a34e-67dc95a1e109 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:42.057498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353f613-1a45-422f-a34e-67dc95a1e109 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:42.081698 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e9a40-f646-4e18-8392-bcf24d59a65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:42.085101 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e9a40-f646-4e18-8392-bcf24d59a65c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:42.085511 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e9a40-f646-4e18-8392-bcf24d59a65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:42.086911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e9a40-f646-4e18-8392-bcf24d59a65c admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:42.088178 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e9a40-f646-4e18-8392-bcf24d59a65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:42.097056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e9a40-f646-4e18-8392-bcf24d59a65c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:42.129274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1325/2619] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:47:42.130850 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d08f8-9cfa-4a9f-ba09-64c3aa2cb6af admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:42.144091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d08f8-9cfa-4a9f-ba09-64c3aa2cb6af admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:42.149392 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd153fe-c7b5-4268-9f53-0133a755cea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:42.150355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd153fe-c7b5-4268-9f53-0133a755cea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:42.150640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd153fe-c7b5-4268-9f53-0133a755cea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:42.150922 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd153fe-c7b5-4268-9f53-0133a755cea4 admin admin] PATH_INFO: `/v3/projects/99fd2e9013cd452c82fd2f841bdeb49d/users/5ead31de7dab41d3b9cc09c58970eca7/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:42.169190 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd153fe-c7b5-4268-9f53-0133a755cea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fd2e9013cd452c82fd2f841bdeb49d, user_id=5ead31de7dab41d3b9cc09c58970eca7, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:42.172190 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd153fe-c7b5-4268-9f53-0133a755cea4 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:42.284943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1295/2620] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:47:42 2022] PUT /identity/v3/projects/99fd2e9013cd452c82fd2f841bdeb49d/users/5ead31de7dab41d3b9cc09c58970eca7/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:47:42.288932 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e9a40-f646-4e18-8392-bcf24d59a65c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:42.299730 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e9a40-f646-4e18-8392-bcf24d59a65c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:42.311610 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:42.370073 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608e966-8e40-4b23-88a8-872258e134a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:42.370850 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608e966-8e40-4b23-88a8-872258e134a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:42.371204 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608e966-8e40-4b23-88a8-872258e134a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:42.371725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608e966-8e40-4b23-88a8-872258e134a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:42.372552 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608e966-8e40-4b23-88a8-872258e134a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:42.374636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608e966-8e40-4b23-88a8-872258e134a3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:42.389883 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1326/2621] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:47:42.391377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd153fe-c7b5-4268-9f53-0133a755cea4 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:42.405827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd153fe-c7b5-4268-9f53-0133a755cea4 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:42.412493 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea484a60-1117-4373-9d03-2a04f4c68664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:42.413693 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea484a60-1117-4373-9d03-2a04f4c68664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:42.414182 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea484a60-1117-4373-9d03-2a04f4c68664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:42.414540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea484a60-1117-4373-9d03-2a04f4c68664 admin admin] PATH_INFO: `/v3/projects/99fd2e9013cd452c82fd2f841bdeb49d/users/5ead31de7dab41d3b9cc09c58970eca7/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:42.416895 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea484a60-1117-4373-9d03-2a04f4c68664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fd2e9013cd452c82fd2f841bdeb49d, user_id=5ead31de7dab41d3b9cc09c58970eca7, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:42.420003 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea484a60-1117-4373-9d03-2a04f4c68664 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:42.441411 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1296/2622] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:47:42 2022] PUT /identity/v3/projects/99fd2e9013cd452c82fd2f841bdeb49d/users/5ead31de7dab41d3b9cc09c58970eca7/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:47:42.448882 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98a3b7-2a5e-4670-9567-37e535fd8ca3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:42.449244 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98a3b7-2a5e-4670-9567-37e535fd8ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:42.449542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98a3b7-2a5e-4670-9567-37e535fd8ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:42.498818 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-db98a3b7-2a5e-4670-9567-37e535fd8ca3 None None] MFA Rules not processed for user `5ead31de7dab41d3b9cc09c58970eca7`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:42.500697 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-db98a3b7-2a5e-4670-9567-37e535fd8ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:42.617518 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1327/2623] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:42 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:47:42.638476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea484a60-1117-4373-9d03-2a04f4c68664 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:42.640395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ea484a60-1117-4373-9d03-2a04f4c68664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:42.757548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea484a60-1117-4373-9d03-2a04f4c68664 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:42.763604 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bfb9c-bb0b-4620-985f-f72d32f37234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:42.764676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bfb9c-bb0b-4620-985f-f72d32f37234 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:42.765224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bfb9c-bb0b-4620-985f-f72d32f37234 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:42.765766 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bfb9c-bb0b-4620-985f-f72d32f37234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:42.776235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:42.780268 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bfb9c-bb0b-4620-985f-f72d32f37234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:42.783389 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bfb9c-bb0b-4620-985f-f72d32f37234 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:42.795716 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1297/2624] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:47:42 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:47:42.960977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98a3b7-2a5e-4670-9567-37e535fd8ca3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:43.034935 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98a3b7-2a5e-4670-9567-37e535fd8ca3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:43.040325 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730aff7-f4d9-4290-9c96-92940338b80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:43.041412 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730aff7-f4d9-4290-9c96-92940338b80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:43.041637 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730aff7-f4d9-4290-9c96-92940338b80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:43.041914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730aff7-f4d9-4290-9c96-92940338b80d admin admin] PATH_INFO: `/v3/users/db0e4465de7b4f1893d7acb7ac771911` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:43.043167 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730aff7-f4d9-4290-9c96-92940338b80d admin admin] RBAC: Authorizing `identity:delete_user(user_id=db0e4465de7b4f1893d7acb7ac771911)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:43.045166 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730aff7-f4d9-4290-9c96-92940338b80d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:43.215770 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:43.226000 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0730aff7-f4d9-4290-9c96-92940338b80d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0e4465de7b4f1893d7acb7ac771911'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:43.239724 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0730aff7-f4d9-4290-9c96-92940338b80d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0e4465de7b4f1893d7acb7ac771911'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:43.247294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0730aff7-f4d9-4290-9c96-92940338b80d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0e4465de7b4f1893d7acb7ac771911'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:43.248033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0730aff7-f4d9-4290-9c96-92940338b80d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0e4465de7b4f1893d7acb7ac771911'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:43.248646 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0730aff7-f4d9-4290-9c96-92940338b80d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0e4465de7b4f1893d7acb7ac771911'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:43.379253 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1328/2625] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:47:42 2022] DELETE /identity/v3/users/db0e4465de7b4f1893d7acb7ac771911 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:47:43.382265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06840cd3-2344-4a5b-9907-ecbc7ae550cd None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:43.382722 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06840cd3-2344-4a5b-9907-ecbc7ae550cd None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:43.383564 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06840cd3-2344-4a5b-9907-ecbc7ae550cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:43.407822 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-06840cd3-2344-4a5b-9907-ecbc7ae550cd None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:43.407822 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-06840cd3-2344-4a5b-9907-ecbc7ae550cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:43.511264 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1298/2626] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:47:43.520032 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730aff7-f4d9-4290-9c96-92940338b80d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:43.522351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0730aff7-f4d9-4290-9c96-92940338b80d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:43.602220 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730aff7-f4d9-4290-9c96-92940338b80d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:43.606827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eeeff5-f551-4103-9c95-e5ad58ad72c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:43.607372 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eeeff5-f551-4103-9c95-e5ad58ad72c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:43.607655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eeeff5-f551-4103-9c95-e5ad58ad72c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:43.608579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eeeff5-f551-4103-9c95-e5ad58ad72c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:43.621556 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eeeff5-f551-4103-9c95-e5ad58ad72c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:43.621556 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eeeff5-f551-4103-9c95-e5ad58ad72c2 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:43.632563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1329/2627] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:47:44.111091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06840cd3-2344-4a5b-9907-ecbc7ae550cd None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:44.112768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-06840cd3-2344-4a5b-9907-ecbc7ae550cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:44.127546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06840cd3-2344-4a5b-9907-ecbc7ae550cd None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:44.133931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c55495-03de-456e-8e84-6bb6bae23c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:44.135138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c55495-03de-456e-8e84-6bb6bae23c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:44.135249 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c55495-03de-456e-8e84-6bb6bae23c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:44.135537 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c55495-03de-456e-8e84-6bb6bae23c8c admin admin] PATH_INFO: `/v3/projects/e1a670eccc4345aabcc90e821d2b0431` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:44.137258 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c55495-03de-456e-8e84-6bb6bae23c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a670eccc4345aabcc90e821d2b0431)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:44.139118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c55495-03de-456e-8e84-6bb6bae23c8c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:44.262368 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-48c55495-03de-456e-8e84-6bb6bae23c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a670eccc4345aabcc90e821d2b0431', 'request_id': 'req-48c55495-03de-456e-8e84-6bb6bae23c8c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:44.270908 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-48c55495-03de-456e-8e84-6bb6bae23c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a670eccc4345aabcc90e821d2b0431', 'request_id': 'req-48c55495-03de-456e-8e84-6bb6bae23c8c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:44.363743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-48c55495-03de-456e-8e84-6bb6bae23c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a670eccc4345aabcc90e821d2b0431', 'request_id': 'req-48c55495-03de-456e-8e84-6bb6bae23c8c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:44.378803 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-48c55495-03de-456e-8e84-6bb6bae23c8c admin admin] The token cache is being invalidate because project e1a670eccc4345aabcc90e821d2b0431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:47:44.379177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-48c55495-03de-456e-8e84-6bb6bae23c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:44.379915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-48c55495-03de-456e-8e84-6bb6bae23c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:44.381727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1299/2628] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:47:44 2022] DELETE /identity/v3/projects/e1a670eccc4345aabcc90e821d2b0431 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:47:44.386055 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eeeff5-f551-4103-9c95-e5ad58ad72c2 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:44.397645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eeeff5-f551-4103-9c95-e5ad58ad72c2 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:44.487215 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d74c4-477b-427e-92cf-b0687879b728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:44.488111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d74c4-477b-427e-92cf-b0687879b728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:44.488394 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d74c4-477b-427e-92cf-b0687879b728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:44.488699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d74c4-477b-427e-92cf-b0687879b728 admin admin] PATH_INFO: `/v3/users/5ead31de7dab41d3b9cc09c58970eca7` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:44.490054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d74c4-477b-427e-92cf-b0687879b728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ead31de7dab41d3b9cc09c58970eca7)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:44.492605 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d74c4-477b-427e-92cf-b0687879b728 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:44.747404 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-746d74c4-477b-427e-92cf-b0687879b728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ead31de7dab41d3b9cc09c58970eca7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:44.756987 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:44.761485 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-746d74c4-477b-427e-92cf-b0687879b728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ead31de7dab41d3b9cc09c58970eca7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:44.768897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-746d74c4-477b-427e-92cf-b0687879b728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ead31de7dab41d3b9cc09c58970eca7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:44.770096 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-746d74c4-477b-427e-92cf-b0687879b728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ead31de7dab41d3b9cc09c58970eca7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:44.770240 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-746d74c4-477b-427e-92cf-b0687879b728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ead31de7dab41d3b9cc09c58970eca7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:44.853583 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1330/2629] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:47:44 2022] DELETE /identity/v3/users/5ead31de7dab41d3b9cc09c58970eca7 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:47:45.388251 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c55495-03de-456e-8e84-6bb6bae23c8c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:45.390325 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-48c55495-03de-456e-8e84-6bb6bae23c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:45.408119 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c55495-03de-456e-8e84-6bb6bae23c8c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:45.501547 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ef6cc-6fc2-416d-80df-e4a8a7faad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:45.502912 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ef6cc-6fc2-416d-80df-e4a8a7faad3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:45.505742 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ef6cc-6fc2-416d-80df-e4a8a7faad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:45.506234 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ef6cc-6fc2-416d-80df-e4a8a7faad3d admin admin] PATH_INFO: `/v3/projects/99fd2e9013cd452c82fd2f841bdeb49d` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:45.508503 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ef6cc-6fc2-416d-80df-e4a8a7faad3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=99fd2e9013cd452c82fd2f841bdeb49d)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:45.510932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ef6cc-6fc2-416d-80df-e4a8a7faad3d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:45.546270 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:45.714127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-be7ef6cc-6fc2-416d-80df-e4a8a7faad3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99fd2e9013cd452c82fd2f841bdeb49d', 'request_id': 'req-be7ef6cc-6fc2-416d-80df-e4a8a7faad3d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:45.722893 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-be7ef6cc-6fc2-416d-80df-e4a8a7faad3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99fd2e9013cd452c82fd2f841bdeb49d', 'request_id': 'req-be7ef6cc-6fc2-416d-80df-e4a8a7faad3d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:45.857841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-be7ef6cc-6fc2-416d-80df-e4a8a7faad3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99fd2e9013cd452c82fd2f841bdeb49d', 'request_id': 'req-be7ef6cc-6fc2-416d-80df-e4a8a7faad3d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:45.871794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-be7ef6cc-6fc2-416d-80df-e4a8a7faad3d admin admin] The token cache is being invalidate because project 99fd2e9013cd452c82fd2f841bdeb49d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:47:45.872185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-be7ef6cc-6fc2-416d-80df-e4a8a7faad3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:45.872952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-be7ef6cc-6fc2-416d-80df-e4a8a7faad3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:45.874859 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1300/2630] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:47:45 2022] DELETE /identity/v3/projects/99fd2e9013cd452c82fd2f841bdeb49d => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:47:45.880454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae053b6-864b-4192-a46e-572583720753 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:45.881647 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae053b6-864b-4192-a46e-572583720753 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:45.881647 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae053b6-864b-4192-a46e-572583720753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:45.921948 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-aae053b6-864b-4192-a46e-572583720753 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:45.924030 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-aae053b6-864b-4192-a46e-572583720753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:45.992230 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1331/2631] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:47:46.001947 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ca9a4-e353-43ce-9717-2c12d605eafe None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:46.002236 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ca9a4-e353-43ce-9717-2c12d605eafe None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:46.002512 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ca9a4-e353-43ce-9717-2c12d605eafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:46.022004 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-571ca9a4-e353-43ce-9717-2c12d605eafe None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:46.023224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-571ca9a4-e353-43ce-9717-2c12d605eafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:46.031370 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1301/2632] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:47:46.036284 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae053b6-864b-4192-a46e-572583720753 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:46.046150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae053b6-864b-4192-a46e-572583720753 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:46.051410 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567d1b3-71d9-4899-be88-cdaf2f508701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:46.052094 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567d1b3-71d9-4899-be88-cdaf2f508701 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:46.052381 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567d1b3-71d9-4899-be88-cdaf2f508701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:46.052662 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567d1b3-71d9-4899-be88-cdaf2f508701 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:46.053597 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567d1b3-71d9-4899-be88-cdaf2f508701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:47:46.053911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567d1b3-71d9-4899-be88-cdaf2f508701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:46.055545 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567d1b3-71d9-4899-be88-cdaf2f508701 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:46.071145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1332/2633] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:47:46.075935 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ca9a4-e353-43ce-9717-2c12d605eafe None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:46.086465 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ca9a4-e353-43ce-9717-2c12d605eafe None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:46.092080 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efa1a8-ac7c-4a4d-97c4-d4bad385fb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:46.092750 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efa1a8-ac7c-4a4d-97c4-d4bad385fb8c admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:46.093025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efa1a8-ac7c-4a4d-97c4-d4bad385fb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:46.093305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efa1a8-ac7c-4a4d-97c4-d4bad385fb8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:46.094026 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93efa1a8-ac7c-4a4d-97c4-d4bad385fb8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:46.096220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93efa1a8-ac7c-4a4d-97c4-d4bad385fb8c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:46.159231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1302/2634] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:47:46 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:47:46.163226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567d1b3-71d9-4899-be88-cdaf2f508701 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:46.174604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567d1b3-71d9-4899-be88-cdaf2f508701 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:46.237387 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56210f4-7134-468f-87a1-f820a502da0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:46.238074 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56210f4-7134-468f-87a1-f820a502da0b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:46.238492 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56210f4-7134-468f-87a1-f820a502da0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:46.238775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56210f4-7134-468f-87a1-f820a502da0b admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:46.239503 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56210f4-7134-468f-87a1-f820a502da0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:46.241450 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56210f4-7134-468f-87a1-f820a502da0b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:46.334904 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1333/2635] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:47:46 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:47:46.339304 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efa1a8-ac7c-4a4d-97c4-d4bad385fb8c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:46.351245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efa1a8-ac7c-4a4d-97c4-d4bad385fb8c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:46.356553 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af1c51-533c-45a5-bf69-136c28659485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:46.358073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af1c51-533c-45a5-bf69-136c28659485 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:46.358371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af1c51-533c-45a5-bf69-136c28659485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:46.358686 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af1c51-533c-45a5-bf69-136c28659485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:46.359424 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af1c51-533c-45a5-bf69-136c28659485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:46.361144 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af1c51-533c-45a5-bf69-136c28659485 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:46.375400 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1303/2636] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:47:46.376604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56210f4-7134-468f-87a1-f820a502da0b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:46.387732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56210f4-7134-468f-87a1-f820a502da0b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:46.393653 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb86e6-a62f-4f42-978b-30575bae1497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:46.394342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb86e6-a62f-4f42-978b-30575bae1497 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:46.397230 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb86e6-a62f-4f42-978b-30575bae1497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:46.397230 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb86e6-a62f-4f42-978b-30575bae1497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:46.397230 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb86e6-a62f-4f42-978b-30575bae1497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:46.397230 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb86e6-a62f-4f42-978b-30575bae1497 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:46.411552 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1334/2637] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:47:46.415343 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af1c51-533c-45a5-bf69-136c28659485 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:46.429678 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af1c51-533c-45a5-bf69-136c28659485 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:46.436878 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ef073-bcc2-4438-9037-4e969c6791d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:46.438018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ef073-bcc2-4438-9037-4e969c6791d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:46.438521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ef073-bcc2-4438-9037-4e969c6791d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:46.438910 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ef073-bcc2-4438-9037-4e969c6791d5 admin admin] PATH_INFO: `/v3/projects/ffa9f84c4c5f4bb481e768520109f12a/users/60514c31241243bc9ab4b15b2db8ff2d/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:46.462017 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ef073-bcc2-4438-9037-4e969c6791d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa9f84c4c5f4bb481e768520109f12a, user_id=60514c31241243bc9ab4b15b2db8ff2d, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:46.466054 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ef073-bcc2-4438-9037-4e969c6791d5 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:46.546470 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1304/2638] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:47:46 2022] PUT /identity/v3/projects/ffa9f84c4c5f4bb481e768520109f12a/users/60514c31241243bc9ab4b15b2db8ff2d/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:47:46.557740 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b226806-2e3b-4faa-9cb7-955f0b60ef15 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:46.561227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b226806-2e3b-4faa-9cb7-955f0b60ef15 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:46.561227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b226806-2e3b-4faa-9cb7-955f0b60ef15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:46.588564 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3b226806-2e3b-4faa-9cb7-955f0b60ef15 None None] MFA Rules not processed for user `60514c31241243bc9ab4b15b2db8ff2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:46.589832 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3b226806-2e3b-4faa-9cb7-955f0b60ef15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:46.623857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:46.663240 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1335/2639] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:47:46.667731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ef073-bcc2-4438-9037-4e969c6791d5 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:46.735684 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ef073-bcc2-4438-9037-4e969c6791d5 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:46.740627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0473e-444e-4655-8c60-bf792f439294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:46.741300 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0473e-444e-4655-8c60-bf792f439294 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:46.741607 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0473e-444e-4655-8c60-bf792f439294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:46.741882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0473e-444e-4655-8c60-bf792f439294 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:46.742583 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0473e-444e-4655-8c60-bf792f439294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:46.744516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0473e-444e-4655-8c60-bf792f439294 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:46.844709 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1305/2640] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:47:46 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:47:46.848643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b226806-2e3b-4faa-9cb7-955f0b60ef15 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:46.860168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b226806-2e3b-4faa-9cb7-955f0b60ef15 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:46.919364 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b651f7d-14d1-4c39-8bb0-8dc1304d588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:46.920116 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b651f7d-14d1-4c39-8bb0-8dc1304d588c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:46.920312 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b651f7d-14d1-4c39-8bb0-8dc1304d588c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:46.920590 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b651f7d-14d1-4c39-8bb0-8dc1304d588c admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:46.921291 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b651f7d-14d1-4c39-8bb0-8dc1304d588c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:46.923671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b651f7d-14d1-4c39-8bb0-8dc1304d588c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:47.028602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1336/2641] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:47:46 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:47:47.029927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0473e-444e-4655-8c60-bf792f439294 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:47.040775 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0473e-444e-4655-8c60-bf792f439294 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:47.045507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b85b9-1da9-424e-b5a5-e7c48a8a16fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:47.046166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b85b9-1da9-424e-b5a5-e7c48a8a16fb admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:47.047708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b85b9-1da9-424e-b5a5-e7c48a8a16fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:47.047708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b85b9-1da9-424e-b5a5-e7c48a8a16fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:47.047708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b85b9-1da9-424e-b5a5-e7c48a8a16fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:47.049170 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b85b9-1da9-424e-b5a5-e7c48a8a16fb admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:47.059836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1306/2642] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:47:47.064599 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b651f7d-14d1-4c39-8bb0-8dc1304d588c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:47.074567 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b651f7d-14d1-4c39-8bb0-8dc1304d588c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:47.079790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c539eb4-d4aa-40c8-9680-0bd014d4e2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:47.080674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c539eb4-d4aa-40c8-9680-0bd014d4e2b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:47.080950 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c539eb4-d4aa-40c8-9680-0bd014d4e2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:47.081224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c539eb4-d4aa-40c8-9680-0bd014d4e2b3 admin admin] PATH_INFO: `/v3/projects/8fe7775ef597496a9e0cd45bc0c9a33f/users/9eb80c9791524dbc951c51d848909494/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:47.096460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c539eb4-d4aa-40c8-9680-0bd014d4e2b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe7775ef597496a9e0cd45bc0c9a33f, user_id=9eb80c9791524dbc951c51d848909494, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:47.099114 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c539eb4-d4aa-40c8-9680-0bd014d4e2b3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:47.208087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b85b9-1da9-424e-b5a5-e7c48a8a16fb admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:47.208616 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1337/2643] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:47:47 2022] PUT /identity/v3/projects/8fe7775ef597496a9e0cd45bc0c9a33f/users/9eb80c9791524dbc951c51d848909494/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:47:47.220376 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b85b9-1da9-424e-b5a5-e7c48a8a16fb admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:47.244146 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:47.290038 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8e363-8679-4ee1-8e36-1307eb0130a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:47.290722 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8e363-8679-4ee1-8e36-1307eb0130a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:47.291338 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8e363-8679-4ee1-8e36-1307eb0130a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:47.291338 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8e363-8679-4ee1-8e36-1307eb0130a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:47.292082 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8e363-8679-4ee1-8e36-1307eb0130a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:47.294392 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8e363-8679-4ee1-8e36-1307eb0130a6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:47.305809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1307/2644] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:47:47.309930 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c539eb4-d4aa-40c8-9680-0bd014d4e2b3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:47.321185 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c539eb4-d4aa-40c8-9680-0bd014d4e2b3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:47.327119 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab9a11-f721-4501-b924-2e3e2ec91679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:47.336867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab9a11-f721-4501-b924-2e3e2ec91679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:47.336867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab9a11-f721-4501-b924-2e3e2ec91679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:47.336867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab9a11-f721-4501-b924-2e3e2ec91679 admin admin] PATH_INFO: `/v3/projects/8fe7775ef597496a9e0cd45bc0c9a33f/users/9eb80c9791524dbc951c51d848909494/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:47.336867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab9a11-f721-4501-b924-2e3e2ec91679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe7775ef597496a9e0cd45bc0c9a33f, user_id=9eb80c9791524dbc951c51d848909494, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:47.336867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab9a11-f721-4501-b924-2e3e2ec91679 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:47.346862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1338/2645] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:47:47 2022] PUT /identity/v3/projects/8fe7775ef597496a9e0cd45bc0c9a33f/users/9eb80c9791524dbc951c51d848909494/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:47:47.356961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033be79c-0f9c-47d5-8219-e6e6086f378c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:47.357250 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033be79c-0f9c-47d5-8219-e6e6086f378c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:47.357600 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033be79c-0f9c-47d5-8219-e6e6086f378c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:47.385925 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-033be79c-0f9c-47d5-8219-e6e6086f378c None None] MFA Rules not processed for user `9eb80c9791524dbc951c51d848909494`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:47:47.387146 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-033be79c-0f9c-47d5-8219-e6e6086f378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:47.461886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1308/2646] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:47:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:47:47.474249 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab9a11-f721-4501-b924-2e3e2ec91679 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:47.477234 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3bab9a11-f721-4501-b924-2e3e2ec91679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:47.538982 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab9a11-f721-4501-b924-2e3e2ec91679 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:47.542965 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008d513-f7a1-4a36-9ea2-d78ec8e99698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:47.543713 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008d513-f7a1-4a36-9ea2-d78ec8e99698 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:47.543998 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008d513-f7a1-4a36-9ea2-d78ec8e99698 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:47.544273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008d513-f7a1-4a36-9ea2-d78ec8e99698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:47.554593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008d513-f7a1-4a36-9ea2-d78ec8e99698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:47.556143 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008d513-f7a1-4a36-9ea2-d78ec8e99698 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:47.568247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1339/2647] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:47:47 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:47:47.762618 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033be79c-0f9c-47d5-8219-e6e6086f378c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:47.774216 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033be79c-0f9c-47d5-8219-e6e6086f378c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:47.778110 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31744ca2-fc46-4188-a284-75025c0de39d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:47.778789 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31744ca2-fc46-4188-a284-75025c0de39d service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:47.779074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31744ca2-fc46-4188-a284-75025c0de39d service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:47.779355 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31744ca2-fc46-4188-a284-75025c0de39d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:47.844190 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31744ca2-fc46-4188-a284-75025c0de39d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:47.846014 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31744ca2-fc46-4188-a284-75025c0de39d service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:47.855524 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1309/2648] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:47:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:47:49.952269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008d513-f7a1-4a36-9ea2-d78ec8e99698 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:49.954584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2008d513-f7a1-4a36-9ea2-d78ec8e99698 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:49.989695 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:50.024816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008d513-f7a1-4a36-9ea2-d78ec8e99698 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:50.029274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae90e9f-7efa-44a5-a6c9-d0126f49afcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:50.030178 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae90e9f-7efa-44a5-a6c9-d0126f49afcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:50.033494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae90e9f-7efa-44a5-a6c9-d0126f49afcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:50.033494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae90e9f-7efa-44a5-a6c9-d0126f49afcb admin admin] PATH_INFO: `/v3/users/781e29f49f27417a96cfc4ba00af95dd` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:50.033494 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae90e9f-7efa-44a5-a6c9-d0126f49afcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=781e29f49f27417a96cfc4ba00af95dd)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:50.033979 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae90e9f-7efa-44a5-a6c9-d0126f49afcb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:50.267743 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6ae90e9f-7efa-44a5-a6c9-d0126f49afcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '781e29f49f27417a96cfc4ba00af95dd'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:50.283324 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6ae90e9f-7efa-44a5-a6c9-d0126f49afcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '781e29f49f27417a96cfc4ba00af95dd'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:50.291702 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6ae90e9f-7efa-44a5-a6c9-d0126f49afcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '781e29f49f27417a96cfc4ba00af95dd'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:50.296086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6ae90e9f-7efa-44a5-a6c9-d0126f49afcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '781e29f49f27417a96cfc4ba00af95dd'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:50.296086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6ae90e9f-7efa-44a5-a6c9-d0126f49afcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '781e29f49f27417a96cfc4ba00af95dd'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:50.379705 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1340/2649] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:47:49 2022] DELETE /identity/v3/users/781e29f49f27417a96cfc4ba00af95dd => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:47:50.629581 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31744ca2-fc46-4188-a284-75025c0de39d service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:50.640443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31744ca2-fc46-4188-a284-75025c0de39d service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:50.683531 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:50.701604 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:50.702578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:50.702888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:50.703162 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c admin admin] PATH_INFO: `/v3/projects/8705999014cf43e1b1ccd5186b67b4bd` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:50.704500 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8705999014cf43e1b1ccd5186b67b4bd)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:50.706441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:50.817619 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8705999014cf43e1b1ccd5186b67b4bd', 'request_id': 'req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:50.823827 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8705999014cf43e1b1ccd5186b67b4bd', 'request_id': 'req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:50.879526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8705999014cf43e1b1ccd5186b67b4bd', 'request_id': 'req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:50.890128 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c admin admin] The token cache is being invalidate because project 8705999014cf43e1b1ccd5186b67b4bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:47:50.890412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:50.891094 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:50.892644 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1310/2650] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:47:50 2022] DELETE /identity/v3/projects/8705999014cf43e1b1ccd5186b67b4bd => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:47:50.896608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae90e9f-7efa-44a5-a6c9-d0126f49afcb admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:50.898074 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6ae90e9f-7efa-44a5-a6c9-d0126f49afcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:50.911263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae90e9f-7efa-44a5-a6c9-d0126f49afcb admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:50.969660 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0277f11-a994-492e-8501-9ae911ca83f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:50.970609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0277f11-a994-492e-8501-9ae911ca83f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:50.970890 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0277f11-a994-492e-8501-9ae911ca83f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:50.971161 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0277f11-a994-492e-8501-9ae911ca83f7 admin admin] PATH_INFO: `/v3/users/ffb1baa644ca4adab70b783ef90545ed` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:50.986701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0277f11-a994-492e-8501-9ae911ca83f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffb1baa644ca4adab70b783ef90545ed)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:50.988807 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0277f11-a994-492e-8501-9ae911ca83f7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:51.212712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:51.222120 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e0277f11-a994-492e-8501-9ae911ca83f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffb1baa644ca4adab70b783ef90545ed'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:51.234214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e0277f11-a994-492e-8501-9ae911ca83f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffb1baa644ca4adab70b783ef90545ed'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:51.241902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e0277f11-a994-492e-8501-9ae911ca83f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffb1baa644ca4adab70b783ef90545ed'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:51.242655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e0277f11-a994-492e-8501-9ae911ca83f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffb1baa644ca4adab70b783ef90545ed'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:51.243357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e0277f11-a994-492e-8501-9ae911ca83f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffb1baa644ca4adab70b783ef90545ed'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:51.356836 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1341/2651] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:47:50 2022] DELETE /identity/v3/users/ffb1baa644ca4adab70b783ef90545ed => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:47:51.592619 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:47:51.594805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:47:51.608318 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aa38a-a2ed-42e9-8210-1f1c4ff81c1c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:47:51.674127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7047302-3ec3-406d-bd2f-362bd1608b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:47:51.675007 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7047302-3ec3-406d-bd2f-362bd1608b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:47:51.675293 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7047302-3ec3-406d-bd2f-362bd1608b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:47:51.675569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7047302-3ec3-406d-bd2f-362bd1608b74 admin admin] PATH_INFO: `/v3/projects/b99c9d9f4a384db1a8fc5252167f3b4f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:47:51.687021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7047302-3ec3-406d-bd2f-362bd1608b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b99c9d9f4a384db1a8fc5252167f3b4f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:47:51.689601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7047302-3ec3-406d-bd2f-362bd1608b74 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:47:51.820298 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a7047302-3ec3-406d-bd2f-362bd1608b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b99c9d9f4a384db1a8fc5252167f3b4f', 'request_id': 'req-a7047302-3ec3-406d-bd2f-362bd1608b74'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:51.827041 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a7047302-3ec3-406d-bd2f-362bd1608b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b99c9d9f4a384db1a8fc5252167f3b4f', 'request_id': 'req-a7047302-3ec3-406d-bd2f-362bd1608b74'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:51.910682 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a7047302-3ec3-406d-bd2f-362bd1608b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b99c9d9f4a384db1a8fc5252167f3b4f', 'request_id': 'req-a7047302-3ec3-406d-bd2f-362bd1608b74'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:51.913042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:51.921791 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a7047302-3ec3-406d-bd2f-362bd1608b74 admin admin] The token cache is being invalidate because project b99c9d9f4a384db1a8fc5252167f3b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:47:51.924905 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a7047302-3ec3-406d-bd2f-362bd1608b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:51.924905 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a7047302-3ec3-406d-bd2f-362bd1608b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:47:51.924905 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1311/2652] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:47:51 2022] DELETE /identity/v3/projects/b99c9d9f4a384db1a8fc5252167f3b4f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:48:01.470642 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=15,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:48:02.060486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:48:38.008010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0277f11-a994-492e-8501-9ae911ca83f7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:38.009497 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e0277f11-a994-492e-8501-9ae911ca83f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:48:38.109455 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0277f11-a994-492e-8501-9ae911ca83f7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:38.174628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf653f28-ed04-4546-b93c-4ca7bd392e98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adc8b93e5c41929b928002e004df6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:38.175782 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf653f28-ed04-4546-b93c-4ca7bd392e98 service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:38.176233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf653f28-ed04-4546-b93c-4ca7bd392e98 service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:38.176709 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf653f28-ed04-4546-b93c-4ca7bd392e98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:38.180658 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bf653f28-ed04-4546-b93c-4ca7bd392e98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:48:38.192769 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf653f28-ed04-4546-b93c-4ca7bd392e98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:38.194532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf653f28-ed04-4546-b93c-4ca7bd392e98 service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:38.206525 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1342/2653] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:48:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:48:42.618885 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7047302-3ec3-406d-bd2f-362bd1608b74 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:42.621225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a7047302-3ec3-406d-bd2f-362bd1608b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:48:42.689251 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7047302-3ec3-406d-bd2f-362bd1608b74 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:42.694203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744436b-2540-47c5-86ad-f61ed4b47021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:42.695281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744436b-2540-47c5-86ad-f61ed4b47021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:42.695453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744436b-2540-47c5-86ad-f61ed4b47021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:42.695676 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744436b-2540-47c5-86ad-f61ed4b47021 admin admin] PATH_INFO: `/v3/users/60514c31241243bc9ab4b15b2db8ff2d` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:42.696881 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744436b-2540-47c5-86ad-f61ed4b47021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60514c31241243bc9ab4b15b2db8ff2d)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:42.699647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744436b-2540-47c5-86ad-f61ed4b47021 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:42.873612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1744436b-2540-47c5-86ad-f61ed4b47021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60514c31241243bc9ab4b15b2db8ff2d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:42.885603 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1744436b-2540-47c5-86ad-f61ed4b47021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60514c31241243bc9ab4b15b2db8ff2d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:42.887007 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1744436b-2540-47c5-86ad-f61ed4b47021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60514c31241243bc9ab4b15b2db8ff2d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:42.887617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1744436b-2540-47c5-86ad-f61ed4b47021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60514c31241243bc9ab4b15b2db8ff2d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:42.894495 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1744436b-2540-47c5-86ad-f61ed4b47021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60514c31241243bc9ab4b15b2db8ff2d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:42.973896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1312/2654] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:48:42 2022] DELETE /identity/v3/users/60514c31241243bc9ab4b15b2db8ff2d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:48:42.978453 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc3030-796c-4445-9d7f-ee57522f8faf None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:42.978983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc3030-796c-4445-9d7f-ee57522f8faf None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:42.978983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc3030-796c-4445-9d7f-ee57522f8faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:42.997717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-13bc3030-796c-4445-9d7f-ee57522f8faf None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:48:42.998933 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-13bc3030-796c-4445-9d7f-ee57522f8faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:48:43.059939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1343/2655] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:48:43.069924 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744436b-2540-47c5-86ad-f61ed4b47021 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:43.071474 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-1744436b-2540-47c5-86ad-f61ed4b47021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:48:43.143986 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744436b-2540-47c5-86ad-f61ed4b47021 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:43.147965 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566f170-1f1d-4ec8-b404-25847db80fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:43.148709 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566f170-1f1d-4ec8-b404-25847db80fab service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:43.149027 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566f170-1f1d-4ec8-b404-25847db80fab service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:43.149374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566f170-1f1d-4ec8-b404-25847db80fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:43.161044 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566f170-1f1d-4ec8-b404-25847db80fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:43.162893 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566f170-1f1d-4ec8-b404-25847db80fab service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:43.174115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1313/2656] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:48:43.594036 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc3030-796c-4445-9d7f-ee57522f8faf None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:43.595534 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-13bc3030-796c-4445-9d7f-ee57522f8faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:48:43.609681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc3030-796c-4445-9d7f-ee57522f8faf None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:43.614313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3584c-dbac-4473-8226-1fee19d76e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:43.615184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3584c-dbac-4473-8226-1fee19d76e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:43.615464 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3584c-dbac-4473-8226-1fee19d76e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:43.615737 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3584c-dbac-4473-8226-1fee19d76e96 admin admin] PATH_INFO: `/v3/projects/ffa9f84c4c5f4bb481e768520109f12a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:43.616926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3584c-dbac-4473-8226-1fee19d76e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa9f84c4c5f4bb481e768520109f12a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:43.619822 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3584c-dbac-4473-8226-1fee19d76e96 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:43.629024 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:48:43.735498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38b3584c-dbac-4473-8226-1fee19d76e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa9f84c4c5f4bb481e768520109f12a', 'request_id': 'req-38b3584c-dbac-4473-8226-1fee19d76e96'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:43.802821 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38b3584c-dbac-4473-8226-1fee19d76e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa9f84c4c5f4bb481e768520109f12a', 'request_id': 'req-38b3584c-dbac-4473-8226-1fee19d76e96'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:43.810828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38b3584c-dbac-4473-8226-1fee19d76e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa9f84c4c5f4bb481e768520109f12a', 'request_id': 'req-38b3584c-dbac-4473-8226-1fee19d76e96'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:43.821312 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38b3584c-dbac-4473-8226-1fee19d76e96 admin admin] The token cache is being invalidate because project ffa9f84c4c5f4bb481e768520109f12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:48:43.824938 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38b3584c-dbac-4473-8226-1fee19d76e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:43.824938 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38b3584c-dbac-4473-8226-1fee19d76e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:43.824938 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1344/2657] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:48:43 2022] DELETE /identity/v3/projects/ffa9f84c4c5f4bb481e768520109f12a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:48:43.828904 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566f170-1f1d-4ec8-b404-25847db80fab service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:43.839225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566f170-1f1d-4ec8-b404-25847db80fab service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:43.857338 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:48:43.895526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f9fcd-5fdb-485e-a678-9e192c5217c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:43.896399 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f9fcd-5fdb-485e-a678-9e192c5217c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:43.896673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f9fcd-5fdb-485e-a678-9e192c5217c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:43.896946 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f9fcd-5fdb-485e-a678-9e192c5217c8 admin admin] PATH_INFO: `/v3/users/9eb80c9791524dbc951c51d848909494` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:43.898156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f9fcd-5fdb-485e-a678-9e192c5217c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb80c9791524dbc951c51d848909494)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:43.900066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f9fcd-5fdb-485e-a678-9e192c5217c8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:44.056617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c58f9fcd-5fdb-485e-a678-9e192c5217c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb80c9791524dbc951c51d848909494'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:44.069166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c58f9fcd-5fdb-485e-a678-9e192c5217c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb80c9791524dbc951c51d848909494'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:44.069994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c58f9fcd-5fdb-485e-a678-9e192c5217c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb80c9791524dbc951c51d848909494'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:44.070613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c58f9fcd-5fdb-485e-a678-9e192c5217c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb80c9791524dbc951c51d848909494'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:44.078254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c58f9fcd-5fdb-485e-a678-9e192c5217c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb80c9791524dbc951c51d848909494'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:44.176029 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1314/2658] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:48:43 2022] DELETE /identity/v3/users/9eb80c9791524dbc951c51d848909494 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:48:44.596033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3584c-dbac-4473-8226-1fee19d76e96 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:44.599993 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-38b3584c-dbac-4473-8226-1fee19d76e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:48:44.610633 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3584c-dbac-4473-8226-1fee19d76e96 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:44.670147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a419140-988e-4890-b802-39de1a432fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:44.671149 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a419140-988e-4890-b802-39de1a432fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:44.671427 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a419140-988e-4890-b802-39de1a432fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:44.671699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a419140-988e-4890-b802-39de1a432fde admin admin] PATH_INFO: `/v3/projects/8fe7775ef597496a9e0cd45bc0c9a33f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:44.673018 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a419140-988e-4890-b802-39de1a432fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe7775ef597496a9e0cd45bc0c9a33f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:44.680419 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a419140-988e-4890-b802-39de1a432fde admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:44.808368 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3a419140-988e-4890-b802-39de1a432fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe7775ef597496a9e0cd45bc0c9a33f', 'request_id': 'req-3a419140-988e-4890-b802-39de1a432fde'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:44.871366 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3a419140-988e-4890-b802-39de1a432fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe7775ef597496a9e0cd45bc0c9a33f', 'request_id': 'req-3a419140-988e-4890-b802-39de1a432fde'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:44.878350 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3a419140-988e-4890-b802-39de1a432fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe7775ef597496a9e0cd45bc0c9a33f', 'request_id': 'req-3a419140-988e-4890-b802-39de1a432fde'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:44.889541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3a419140-988e-4890-b802-39de1a432fde admin admin] The token cache is being invalidate because project 8fe7775ef597496a9e0cd45bc0c9a33f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:48:44.889817 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3a419140-988e-4890-b802-39de1a432fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:44.890478 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3a419140-988e-4890-b802-39de1a432fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:48:44.892087 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1345/2659] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:48:44 2022] DELETE /identity/v3/projects/8fe7775ef597496a9e0cd45bc0c9a33f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:48:44.896961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae3ba-9632-4572-84ee-7f859f7bcd10 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:44.897455 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae3ba-9632-4572-84ee-7f859f7bcd10 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:44.897579 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae3ba-9632-4572-84ee-7f859f7bcd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:44.916095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-aa9ae3ba-9632-4572-84ee-7f859f7bcd10 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:48:44.919583 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-aa9ae3ba-9632-4572-84ee-7f859f7bcd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:48:44.976219 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1315/2660] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:48:44.984198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba3843-d3ee-4a7b-939f-f4290ee9aec6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:44.984489 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba3843-d3ee-4a7b-939f-f4290ee9aec6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:44.984818 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba3843-d3ee-4a7b-939f-f4290ee9aec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:45.003274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bfba3843-d3ee-4a7b-939f-f4290ee9aec6 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:48:45.004483 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bfba3843-d3ee-4a7b-939f-f4290ee9aec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:48:45.013286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1346/2661] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:48:45.017656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ae3ba-9632-4572-84ee-7f859f7bcd10 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:45.028110 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ae3ba-9632-4572-84ee-7f859f7bcd10 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:45.032698 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30277c92-8181-443a-9fc7-983813c90897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:45.033373 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30277c92-8181-443a-9fc7-983813c90897 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:45.033659 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30277c92-8181-443a-9fc7-983813c90897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:45.033934 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30277c92-8181-443a-9fc7-983813c90897 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:45.034652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30277c92-8181-443a-9fc7-983813c90897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:48:45.034954 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30277c92-8181-443a-9fc7-983813c90897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:45.036553 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30277c92-8181-443a-9fc7-983813c90897 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:45.048531 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1316/2662] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:48:45.052929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba3843-d3ee-4a7b-939f-f4290ee9aec6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:45.062301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba3843-d3ee-4a7b-939f-f4290ee9aec6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:45.067117 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98ffd2-9774-4ca1-950e-da9fb5862be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:45.067783 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98ffd2-9774-4ca1-950e-da9fb5862be2 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:45.068066 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98ffd2-9774-4ca1-950e-da9fb5862be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:45.068340 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98ffd2-9774-4ca1-950e-da9fb5862be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:45.069035 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98ffd2-9774-4ca1-950e-da9fb5862be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:45.070992 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98ffd2-9774-4ca1-950e-da9fb5862be2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:45.174701 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:48:45.183401 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1347/2663] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:48:45 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:48:45.187354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30277c92-8181-443a-9fc7-983813c90897 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:45.197341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30277c92-8181-443a-9fc7-983813c90897 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:45.224471 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:48:45.254689 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bd78c-8218-47a0-ada1-2a8780adf4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:45.255358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd78c-8218-47a0-ada1-2a8780adf4dd admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:45.255641 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd78c-8218-47a0-ada1-2a8780adf4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:45.255933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd78c-8218-47a0-ada1-2a8780adf4dd admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:45.256617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bd78c-8218-47a0-ada1-2a8780adf4dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:45.258693 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bd78c-8218-47a0-ada1-2a8780adf4dd admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:45.377512 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1317/2664] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:48:45 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:48:45.378763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98ffd2-9774-4ca1-950e-da9fb5862be2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:45.389942 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98ffd2-9774-4ca1-950e-da9fb5862be2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:45.394793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111e2d0-32f5-41f0-aadb-f6f7441183d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:45.395486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111e2d0-32f5-41f0-aadb-f6f7441183d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:45.395770 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111e2d0-32f5-41f0-aadb-f6f7441183d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:45.396045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111e2d0-32f5-41f0-aadb-f6f7441183d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:45.396774 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111e2d0-32f5-41f0-aadb-f6f7441183d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:45.398449 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111e2d0-32f5-41f0-aadb-f6f7441183d1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:45.413043 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1348/2665] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:48:45.414117 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bd78c-8218-47a0-ada1-2a8780adf4dd admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:45.425873 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bd78c-8218-47a0-ada1-2a8780adf4dd admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:45.430502 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4f708-f672-43bb-9bc7-206e3f3f8847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:45.431166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4f708-f672-43bb-9bc7-206e3f3f8847 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:45.431449 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4f708-f672-43bb-9bc7-206e3f3f8847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:45.431730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4f708-f672-43bb-9bc7-206e3f3f8847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:45.433031 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4f708-f672-43bb-9bc7-206e3f3f8847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:45.435138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4f708-f672-43bb-9bc7-206e3f3f8847 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:45.445371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1318/2666] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:48:45.450344 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111e2d0-32f5-41f0-aadb-f6f7441183d1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:45.460799 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111e2d0-32f5-41f0-aadb-f6f7441183d1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:45.465622 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35526c3a-f6cd-47b0-82f8-6b15671455f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:45.467094 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35526c3a-f6cd-47b0-82f8-6b15671455f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:45.467545 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35526c3a-f6cd-47b0-82f8-6b15671455f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:45.467991 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35526c3a-f6cd-47b0-82f8-6b15671455f2 admin admin] PATH_INFO: `/v3/projects/4d957b51405d4e5ea05a3c8e33ab2ad6/users/f005570e168e4489b371798984fd04c2/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:45.483773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35526c3a-f6cd-47b0-82f8-6b15671455f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d957b51405d4e5ea05a3c8e33ab2ad6, user_id=f005570e168e4489b371798984fd04c2, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:45.486504 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35526c3a-f6cd-47b0-82f8-6b15671455f2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:45.557037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1349/2667] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:48:45 2022] PUT /identity/v3/projects/4d957b51405d4e5ea05a3c8e33ab2ad6/users/f005570e168e4489b371798984fd04c2/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:48:45.567970 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ca0fb-2913-4c15-b526-6b19488951c9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:45.568260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ca0fb-2913-4c15-b526-6b19488951c9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:45.568537 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ca0fb-2913-4c15-b526-6b19488951c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:45.598862 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-7d9ca0fb-2913-4c15-b526-6b19488951c9 None None] MFA Rules not processed for user `f005570e168e4489b371798984fd04c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:48:45.600090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7d9ca0fb-2913-4c15-b526-6b19488951c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:48:45.663275 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1319/2668] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:48:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:48:45.668745 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35526c3a-f6cd-47b0-82f8-6b15671455f2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:45.743823 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35526c3a-f6cd-47b0-82f8-6b15671455f2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:45.749684 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb6567-0f2a-47cf-bca1-6fc5ac05c335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:45.750369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb6567-0f2a-47cf-bca1-6fc5ac05c335 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:45.750654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb6567-0f2a-47cf-bca1-6fc5ac05c335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:45.750936 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb6567-0f2a-47cf-bca1-6fc5ac05c335 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:45.751656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb6567-0f2a-47cf-bca1-6fc5ac05c335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:45.753690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb6567-0f2a-47cf-bca1-6fc5ac05c335 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:45.845182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1350/2669] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:48:45 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:48:45.849040 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ca0fb-2913-4c15-b526-6b19488951c9 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:45.860135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ca0fb-2913-4c15-b526-6b19488951c9 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:45.916119 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f39a0-644c-41e9-81e6-5245a46b1d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:45.916789 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f39a0-644c-41e9-81e6-5245a46b1d47 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:45.917255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f39a0-644c-41e9-81e6-5245a46b1d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:45.917640 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f39a0-644c-41e9-81e6-5245a46b1d47 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:45.918341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f39a0-644c-41e9-81e6-5245a46b1d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:45.920265 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f39a0-644c-41e9-81e6-5245a46b1d47 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:45.995470 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1320/2670] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:48:45 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:48:45.999712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb6567-0f2a-47cf-bca1-6fc5ac05c335 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:46.010276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb6567-0f2a-47cf-bca1-6fc5ac05c335 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:46.015982 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb8e2-d673-4ee7-81fe-84ab73e5c25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:46.016643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb8e2-d673-4ee7-81fe-84ab73e5c25a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:46.016918 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb8e2-d673-4ee7-81fe-84ab73e5c25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:46.017190 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb8e2-d673-4ee7-81fe-84ab73e5c25a admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:46.018041 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffb8e2-d673-4ee7-81fe-84ab73e5c25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:46.019743 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffb8e2-d673-4ee7-81fe-84ab73e5c25a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:46.031569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1351/2671] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:48:46.035862 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f39a0-644c-41e9-81e6-5245a46b1d47 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:46.046555 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f39a0-644c-41e9-81e6-5245a46b1d47 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:46.051164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c3686-ac52-4800-b4c6-4d20f0ef5453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:46.052042 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c3686-ac52-4800-b4c6-4d20f0ef5453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:46.052333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c3686-ac52-4800-b4c6-4d20f0ef5453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:46.052615 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c3686-ac52-4800-b4c6-4d20f0ef5453 admin admin] PATH_INFO: `/v3/projects/c5945676f41d43bf9632407b8d3d8a2d/users/27fe1996390944329775c5b68ab431ad/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:46.067114 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c3686-ac52-4800-b4c6-4d20f0ef5453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5945676f41d43bf9632407b8d3d8a2d, user_id=27fe1996390944329775c5b68ab431ad, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:46.069863 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c3686-ac52-4800-b4c6-4d20f0ef5453 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:46.137165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1321/2672] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:48:46 2022] PUT /identity/v3/projects/c5945676f41d43bf9632407b8d3d8a2d/users/27fe1996390944329775c5b68ab431ad/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:48:46.141245 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb8e2-d673-4ee7-81fe-84ab73e5c25a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:46.151759 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb8e2-d673-4ee7-81fe-84ab73e5c25a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:46.208118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabe539-c4fa-4050-98b6-5a8c3fecc7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:46.208816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabe539-c4fa-4050-98b6-5a8c3fecc7de admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:46.209102 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabe539-c4fa-4050-98b6-5a8c3fecc7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:46.209398 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabe539-c4fa-4050-98b6-5a8c3fecc7de admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:46.210383 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabe539-c4fa-4050-98b6-5a8c3fecc7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:46.212029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabe539-c4fa-4050-98b6-5a8c3fecc7de admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:46.223773 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1352/2673] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:48:46.227999 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c3686-ac52-4800-b4c6-4d20f0ef5453 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:46.234407 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:48:46.239767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c3686-ac52-4800-b4c6-4d20f0ef5453 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:46.244482 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4e8ce-62a6-45ae-a56a-b0ec932ba865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:46.249181 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4e8ce-62a6-45ae-a56a-b0ec932ba865 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:46.249181 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4e8ce-62a6-45ae-a56a-b0ec932ba865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:46.249181 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4e8ce-62a6-45ae-a56a-b0ec932ba865 admin admin] PATH_INFO: `/v3/projects/c5945676f41d43bf9632407b8d3d8a2d/users/27fe1996390944329775c5b68ab431ad/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:46.249181 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4e8ce-62a6-45ae-a56a-b0ec932ba865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5945676f41d43bf9632407b8d3d8a2d, user_id=27fe1996390944329775c5b68ab431ad, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:46.251384 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4e8ce-62a6-45ae-a56a-b0ec932ba865 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:46.262475 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1322/2674] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:48:46 2022] PUT /identity/v3/projects/c5945676f41d43bf9632407b8d3d8a2d/users/27fe1996390944329775c5b68ab431ad/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:48:46.272733 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788b5d9-e439-4a66-9062-12fbbd68c2c3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:46.273024 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788b5d9-e439-4a66-9062-12fbbd68c2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:46.273306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788b5d9-e439-4a66-9062-12fbbd68c2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:46.302765 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f788b5d9-e439-4a66-9062-12fbbd68c2c3 None None] MFA Rules not processed for user `27fe1996390944329775c5b68ab431ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:48:46.303988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f788b5d9-e439-4a66-9062-12fbbd68c2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:48:46.327528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:48:46.382643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1353/2675] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:48:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:48:46.394803 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4e8ce-62a6-45ae-a56a-b0ec932ba865 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:46.396548 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dbb4e8ce-62a6-45ae-a56a-b0ec932ba865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:48:46.484189 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4e8ce-62a6-45ae-a56a-b0ec932ba865 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:46.488020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64518b9-3aab-4908-9513-5d22b6a4dac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:46.488669 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64518b9-3aab-4908-9513-5d22b6a4dac6 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:46.488952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64518b9-3aab-4908-9513-5d22b6a4dac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:46.489230 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64518b9-3aab-4908-9513-5d22b6a4dac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:46.499775 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64518b9-3aab-4908-9513-5d22b6a4dac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:46.501167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64518b9-3aab-4908-9513-5d22b6a4dac6 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:46.511211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1323/2676] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:48:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:48:46.750944 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788b5d9-e439-4a66-9062-12fbbd68c2c3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:46.761182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788b5d9-e439-4a66-9062-12fbbd68c2c3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:46.764796 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daadd73-7ad0-44c5-96c8-ff6b49035d22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:46.765448 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daadd73-7ad0-44c5-96c8-ff6b49035d22 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:46.765732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daadd73-7ad0-44c5-96c8-ff6b49035d22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:46.766004 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daadd73-7ad0-44c5-96c8-ff6b49035d22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:46.822035 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daadd73-7ad0-44c5-96c8-ff6b49035d22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:46.823984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daadd73-7ad0-44c5-96c8-ff6b49035d22 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:48:46.834241 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1354/2677] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:48:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:48:56.506652 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:48:56.829618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=47 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:48:59.884862 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64518b9-3aab-4908-9513-5d22b6a4dac6 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:48:59.955126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64518b9-3aab-4908-9513-5d22b6a4dac6 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:48:59.960343 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8dc9f-aeec-4517-8758-d73eb8b599a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:48:59.961226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8dc9f-aeec-4517-8758-d73eb8b599a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:48:59.961544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8dc9f-aeec-4517-8758-d73eb8b599a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:48:59.961825 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8dc9f-aeec-4517-8758-d73eb8b599a2 admin admin] PATH_INFO: `/v3/users/f005570e168e4489b371798984fd04c2` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:48:59.963607 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8dc9f-aeec-4517-8758-d73eb8b599a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f005570e168e4489b371798984fd04c2)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:48:59.965584 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8dc9f-aeec-4517-8758-d73eb8b599a2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:00.150149 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-32b8dc9f-aeec-4517-8758-d73eb8b599a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f005570e168e4489b371798984fd04c2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:00.162536 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-32b8dc9f-aeec-4517-8758-d73eb8b599a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f005570e168e4489b371798984fd04c2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:00.168140 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-32b8dc9f-aeec-4517-8758-d73eb8b599a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f005570e168e4489b371798984fd04c2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:00.168140 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-32b8dc9f-aeec-4517-8758-d73eb8b599a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f005570e168e4489b371798984fd04c2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:00.172155 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-32b8dc9f-aeec-4517-8758-d73eb8b599a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f005570e168e4489b371798984fd04c2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:00.256273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1324/2678] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:48:59 2022] DELETE /identity/v3/users/f005570e168e4489b371798984fd04c2 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:00.261792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed09631-5eb2-40cd-95be-95792ec73439 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:00.266465 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed09631-5eb2-40cd-95be-95792ec73439 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:00.266465 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed09631-5eb2-40cd-95be-95792ec73439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:00.280436 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0ed09631-5eb2-40cd-95be-95792ec73439 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:49:00.281685 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0ed09631-5eb2-40cd-95be-95792ec73439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:00.341963 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1355/2679] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:49:00.350997 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8dc9f-aeec-4517-8758-d73eb8b599a2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:00.352444 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-32b8dc9f-aeec-4517-8758-d73eb8b599a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:00.412201 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8dc9f-aeec-4517-8758-d73eb8b599a2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:00.416626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a298e-5d92-42fc-ae3a-4a7043d05d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:00.417300 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a298e-5d92-42fc-ae3a-4a7043d05d60 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:00.417688 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a298e-5d92-42fc-ae3a-4a7043d05d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:00.417966 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a298e-5d92-42fc-ae3a-4a7043d05d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:00.427749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a298e-5d92-42fc-ae3a-4a7043d05d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:00.429197 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a298e-5d92-42fc-ae3a-4a7043d05d60 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:00.439280 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1325/2680] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:49:00.829424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed09631-5eb2-40cd-95be-95792ec73439 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:00.830963 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0ed09631-5eb2-40cd-95be-95792ec73439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:00.843543 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed09631-5eb2-40cd-95be-95792ec73439 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:00.848377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027fc04-da48-498d-b34a-cd3f17b51375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:00.849263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027fc04-da48-498d-b34a-cd3f17b51375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:00.849585 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027fc04-da48-498d-b34a-cd3f17b51375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:00.849866 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027fc04-da48-498d-b34a-cd3f17b51375 admin admin] PATH_INFO: `/v3/projects/4d957b51405d4e5ea05a3c8e33ab2ad6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:00.851092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027fc04-da48-498d-b34a-cd3f17b51375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d957b51405d4e5ea05a3c8e33ab2ad6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:00.853885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027fc04-da48-498d-b34a-cd3f17b51375 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:00.974422 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1027fc04-da48-498d-b34a-cd3f17b51375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d957b51405d4e5ea05a3c8e33ab2ad6', 'request_id': 'req-1027fc04-da48-498d-b34a-cd3f17b51375'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:01.058951 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1027fc04-da48-498d-b34a-cd3f17b51375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d957b51405d4e5ea05a3c8e33ab2ad6', 'request_id': 'req-1027fc04-da48-498d-b34a-cd3f17b51375'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:01.067643 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1027fc04-da48-498d-b34a-cd3f17b51375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d957b51405d4e5ea05a3c8e33ab2ad6', 'request_id': 'req-1027fc04-da48-498d-b34a-cd3f17b51375'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:01.082108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1027fc04-da48-498d-b34a-cd3f17b51375 admin admin] The token cache is being invalidate because project 4d957b51405d4e5ea05a3c8e33ab2ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:49:01.082623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1027fc04-da48-498d-b34a-cd3f17b51375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:01.083937 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1027fc04-da48-498d-b34a-cd3f17b51375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:01.086359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1356/2681] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:49:00 2022] DELETE /identity/v3/projects/4d957b51405d4e5ea05a3c8e33ab2ad6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:01.090880 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a298e-5d92-42fc-ae3a-4a7043d05d60 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:01.100859 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a298e-5d92-42fc-ae3a-4a7043d05d60 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:01.131792 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:01.174411 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aeb67a-2778-487e-8192-461b6491917c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:01.175299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb67a-2778-487e-8192-461b6491917c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:01.175577 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb67a-2778-487e-8192-461b6491917c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:01.175848 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb67a-2778-487e-8192-461b6491917c admin admin] PATH_INFO: `/v3/users/27fe1996390944329775c5b68ab431ad` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:01.177118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aeb67a-2778-487e-8192-461b6491917c admin admin] RBAC: Authorizing `identity:delete_user(user_id=27fe1996390944329775c5b68ab431ad)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:01.179120 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aeb67a-2778-487e-8192-461b6491917c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:01.398378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-04aeb67a-2778-487e-8192-461b6491917c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27fe1996390944329775c5b68ab431ad'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:01.410890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-04aeb67a-2778-487e-8192-461b6491917c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27fe1996390944329775c5b68ab431ad'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:01.411601 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-04aeb67a-2778-487e-8192-461b6491917c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27fe1996390944329775c5b68ab431ad'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:01.412224 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-04aeb67a-2778-487e-8192-461b6491917c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27fe1996390944329775c5b68ab431ad'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:01.419262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-04aeb67a-2778-487e-8192-461b6491917c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27fe1996390944329775c5b68ab431ad'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:01.507299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1326/2682] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:49:01 2022] DELETE /identity/v3/users/27fe1996390944329775c5b68ab431ad => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:49:01.911188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027fc04-da48-498d-b34a-cd3f17b51375 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:01.912597 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1027fc04-da48-498d-b34a-cd3f17b51375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:01.926233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027fc04-da48-498d-b34a-cd3f17b51375 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:01.984662 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e98463-f703-465e-af32-fb7e92ea9c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:01.985576 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e98463-f703-465e-af32-fb7e92ea9c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:01.985857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e98463-f703-465e-af32-fb7e92ea9c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:01.986135 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e98463-f703-465e-af32-fb7e92ea9c86 admin admin] PATH_INFO: `/v3/projects/c5945676f41d43bf9632407b8d3d8a2d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:01.987349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e98463-f703-465e-af32-fb7e92ea9c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5945676f41d43bf9632407b8d3d8a2d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:01.989351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e98463-f703-465e-af32-fb7e92ea9c86 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:02.059704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:02.077077 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-26e98463-f703-465e-af32-fb7e92ea9c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5945676f41d43bf9632407b8d3d8a2d', 'request_id': 'req-26e98463-f703-465e-af32-fb7e92ea9c86'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:02.135636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-26e98463-f703-465e-af32-fb7e92ea9c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5945676f41d43bf9632407b8d3d8a2d', 'request_id': 'req-26e98463-f703-465e-af32-fb7e92ea9c86'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:02.142355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-26e98463-f703-465e-af32-fb7e92ea9c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5945676f41d43bf9632407b8d3d8a2d', 'request_id': 'req-26e98463-f703-465e-af32-fb7e92ea9c86'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:02.152638 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-26e98463-f703-465e-af32-fb7e92ea9c86 admin admin] The token cache is being invalidate because project c5945676f41d43bf9632407b8d3d8a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:49:02.152927 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-26e98463-f703-465e-af32-fb7e92ea9c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:02.153608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-26e98463-f703-465e-af32-fb7e92ea9c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:02.155150 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1357/2683] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:49:01 2022] DELETE /identity/v3/projects/c5945676f41d43bf9632407b8d3d8a2d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:02.161002 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563c12f-633d-4820-81f5-56c2bab758d3 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:02.162880 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563c12f-633d-4820-81f5-56c2bab758d3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:02.162880 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563c12f-633d-4820-81f5-56c2bab758d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:02.180632 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-7563c12f-633d-4820-81f5-56c2bab758d3 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:49:02.182839 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7563c12f-633d-4820-81f5-56c2bab758d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:02.242978 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1327/2684] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:49:02.251741 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70005ad5-119e-4272-9e09-d651e7f3e460 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:02.258187 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70005ad5-119e-4272-9e09-d651e7f3e460 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:02.258187 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70005ad5-119e-4272-9e09-d651e7f3e460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:02.271262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-70005ad5-119e-4272-9e09-d651e7f3e460 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:49:02.272454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-70005ad5-119e-4272-9e09-d651e7f3e460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:02.281075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1358/2685] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:49:02.285573 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563c12f-633d-4820-81f5-56c2bab758d3 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:02.295311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563c12f-633d-4820-81f5-56c2bab758d3 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:02.299836 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceebb12-4d4c-4233-8ee2-9096fdc81bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:02.300487 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceebb12-4d4c-4233-8ee2-9096fdc81bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:02.300765 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceebb12-4d4c-4233-8ee2-9096fdc81bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:02.301038 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceebb12-4d4c-4233-8ee2-9096fdc81bc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:02.301786 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceebb12-4d4c-4233-8ee2-9096fdc81bc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:49:02.302098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceebb12-4d4c-4233-8ee2-9096fdc81bc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:02.303680 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceebb12-4d4c-4233-8ee2-9096fdc81bc8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:02.315273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1328/2686] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:49:02.319579 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70005ad5-119e-4272-9e09-d651e7f3e460 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:02.329529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70005ad5-119e-4272-9e09-d651e7f3e460 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:02.334436 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092eed5c-4f66-4574-91f8-ec70f416ab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:02.335086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092eed5c-4f66-4574-91f8-ec70f416ab94 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:02.335367 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092eed5c-4f66-4574-91f8-ec70f416ab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:02.335639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092eed5c-4f66-4574-91f8-ec70f416ab94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:02.336369 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092eed5c-4f66-4574-91f8-ec70f416ab94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:02.338978 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092eed5c-4f66-4574-91f8-ec70f416ab94 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:02.425338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1359/2687] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:49:02 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:49:02.429374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceebb12-4d4c-4233-8ee2-9096fdc81bc8 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:02.439553 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceebb12-4d4c-4233-8ee2-9096fdc81bc8 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:02.466421 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:02.497307 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22116d1-968b-492b-b816-ab4051572bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:02.498130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22116d1-968b-492b-b816-ab4051572bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:02.498472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22116d1-968b-492b-b816-ab4051572bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:02.499099 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22116d1-968b-492b-b816-ab4051572bb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:02.499943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22116d1-968b-492b-b816-ab4051572bb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:02.501927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22116d1-968b-492b-b816-ab4051572bb0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:02.601384 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1329/2688] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:49:02 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:49:02.606173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092eed5c-4f66-4574-91f8-ec70f416ab94 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:02.616696 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092eed5c-4f66-4574-91f8-ec70f416ab94 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:02.621667 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ac175-23ee-4d88-9155-ae27aa9b96ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:02.622357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ac175-23ee-4d88-9155-ae27aa9b96ae admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:02.622646 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ac175-23ee-4d88-9155-ae27aa9b96ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:02.622927 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ac175-23ee-4d88-9155-ae27aa9b96ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:02.623725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ac175-23ee-4d88-9155-ae27aa9b96ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:02.625460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ac175-23ee-4d88-9155-ae27aa9b96ae admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:02.637396 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1360/2689] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:49:02.641300 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22116d1-968b-492b-b816-ab4051572bb0 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:02.652598 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22116d1-968b-492b-b816-ab4051572bb0 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:02.657433 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea151fd-fae9-43a9-982e-65058873d312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:02.660013 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea151fd-fae9-43a9-982e-65058873d312 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:02.660013 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea151fd-fae9-43a9-982e-65058873d312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:02.660013 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea151fd-fae9-43a9-982e-65058873d312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:02.660013 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea151fd-fae9-43a9-982e-65058873d312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:02.661091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea151fd-fae9-43a9-982e-65058873d312 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:02.672667 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1330/2690] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:49:02.676909 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ac175-23ee-4d88-9155-ae27aa9b96ae admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:02.688746 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ac175-23ee-4d88-9155-ae27aa9b96ae admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:02.692275 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c7819-1cf8-4119-a823-465f19ccfe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:02.693164 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c7819-1cf8-4119-a823-465f19ccfe40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:02.693485 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c7819-1cf8-4119-a823-465f19ccfe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:02.693758 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c7819-1cf8-4119-a823-465f19ccfe40 admin admin] PATH_INFO: `/v3/projects/77fd259293784298aa87891b97255755/users/f150b044f6294d1798dfb729861c66de/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:02.709041 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c7819-1cf8-4119-a823-465f19ccfe40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77fd259293784298aa87891b97255755, user_id=f150b044f6294d1798dfb729861c66de, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:02.711722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c7819-1cf8-4119-a823-465f19ccfe40 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:02.798872 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1361/2691] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:49:02 2022] PUT /identity/v3/projects/77fd259293784298aa87891b97255755/users/f150b044f6294d1798dfb729861c66de/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:02.810674 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469b182-630b-4c1e-bd6d-3311a579b96b None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:02.814796 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469b182-630b-4c1e-bd6d-3311a579b96b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:02.814796 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469b182-630b-4c1e-bd6d-3311a579b96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:02.838024 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d469b182-630b-4c1e-bd6d-3311a579b96b None None] MFA Rules not processed for user `f150b044f6294d1798dfb729861c66de`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:49:02.843507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d469b182-630b-4c1e-bd6d-3311a579b96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:02.904208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1331/2692] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:49:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:49:02.908737 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c7819-1cf8-4119-a823-465f19ccfe40 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:02.972088 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c7819-1cf8-4119-a823-465f19ccfe40 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:02.976712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ea81a-2ff3-4391-9ded-9c9ca1ff75c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:02.977413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ea81a-2ff3-4391-9ded-9c9ca1ff75c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:02.978224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ea81a-2ff3-4391-9ded-9c9ca1ff75c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:02.978512 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ea81a-2ff3-4391-9ded-9c9ca1ff75c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:02.979210 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ea81a-2ff3-4391-9ded-9c9ca1ff75c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:02.981137 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ea81a-2ff3-4391-9ded-9c9ca1ff75c4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:03.099964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1362/2693] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:49:02 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:49:03.104576 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469b182-630b-4c1e-bd6d-3311a579b96b None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:03.115186 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469b182-630b-4c1e-bd6d-3311a579b96b None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:03.172356 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b943f4-34ef-46cd-b097-d2aaade4a9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:03.173127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b943f4-34ef-46cd-b097-d2aaade4a9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:03.173482 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b943f4-34ef-46cd-b097-d2aaade4a9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:03.173835 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b943f4-34ef-46cd-b097-d2aaade4a9e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:03.174606 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b943f4-34ef-46cd-b097-d2aaade4a9e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:03.176890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b943f4-34ef-46cd-b097-d2aaade4a9e1 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:03.276546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1332/2694] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:49:03 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:49:03.280702 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ea81a-2ff3-4391-9ded-9c9ca1ff75c4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:03.295064 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ea81a-2ff3-4391-9ded-9c9ca1ff75c4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:03.302997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513339b2-0a5b-4631-8aaf-4ecd92d7098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:03.304168 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513339b2-0a5b-4631-8aaf-4ecd92d7098c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:03.304676 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513339b2-0a5b-4631-8aaf-4ecd92d7098c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:03.305182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513339b2-0a5b-4631-8aaf-4ecd92d7098c admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:03.306668 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513339b2-0a5b-4631-8aaf-4ecd92d7098c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:03.309831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513339b2-0a5b-4631-8aaf-4ecd92d7098c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:03.329469 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1363/2695] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:49:03.332165 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b943f4-34ef-46cd-b097-d2aaade4a9e1 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:03.345377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b943f4-34ef-46cd-b097-d2aaade4a9e1 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:03.350336 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214da97-a10a-4b82-bf5f-bf88c5abff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:03.351010 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214da97-a10a-4b82-bf5f-bf88c5abff02 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:03.351302 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214da97-a10a-4b82-bf5f-bf88c5abff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:03.351581 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214da97-a10a-4b82-bf5f-bf88c5abff02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:03.352314 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214da97-a10a-4b82-bf5f-bf88c5abff02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:03.354733 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214da97-a10a-4b82-bf5f-bf88c5abff02 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:03.365673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1333/2696] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:49:03.370633 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513339b2-0a5b-4631-8aaf-4ecd92d7098c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:03.385835 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513339b2-0a5b-4631-8aaf-4ecd92d7098c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:03.393877 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ccb16-863a-4c76-8f8b-186bbe450d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:03.395821 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ccb16-863a-4c76-8f8b-186bbe450d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:03.396047 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ccb16-863a-4c76-8f8b-186bbe450d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:03.396559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ccb16-863a-4c76-8f8b-186bbe450d67 admin admin] PATH_INFO: `/v3/projects/7c7368a87ab34eeebcc161c9fb7b92ff/users/0e9ccb027ded439eb2a488d7121e6f36/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:03.422607 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ccb16-863a-4c76-8f8b-186bbe450d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7368a87ab34eeebcc161c9fb7b92ff, user_id=0e9ccb027ded439eb2a488d7121e6f36, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:03.425424 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ccb16-863a-4c76-8f8b-186bbe450d67 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:03.498602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:03.503633 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1364/2697] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:49:03 2022] PUT /identity/v3/projects/7c7368a87ab34eeebcc161c9fb7b92ff/users/0e9ccb027ded439eb2a488d7121e6f36/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:03.514894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9021dde-965e-4648-a311-69d925689f73 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:03.516095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9021dde-965e-4648-a311-69d925689f73 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:03.516095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9021dde-965e-4648-a311-69d925689f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:03.543793 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c9021dde-965e-4648-a311-69d925689f73 None None] MFA Rules not processed for user `0e9ccb027ded439eb2a488d7121e6f36`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:49:03.544914 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c9021dde-965e-4648-a311-69d925689f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:03.548996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:03.616658 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1334/2698] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:49:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:49:03.622016 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ccb16-863a-4c76-8f8b-186bbe450d67 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:03.692737 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ccb16-863a-4c76-8f8b-186bbe450d67 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:03.700170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d832a3-e055-45c6-b6bd-ae8358b3b2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:03.700170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d832a3-e055-45c6-b6bd-ae8358b3b2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:03.700472 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d832a3-e055-45c6-b6bd-ae8358b3b2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:03.700634 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d832a3-e055-45c6-b6bd-ae8358b3b2f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:03.701673 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d832a3-e055-45c6-b6bd-ae8358b3b2f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:03.705502 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d832a3-e055-45c6-b6bd-ae8358b3b2f2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:03.814793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1365/2699] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:49:03 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:49:03.818638 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9021dde-965e-4648-a311-69d925689f73 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:03.830987 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9021dde-965e-4648-a311-69d925689f73 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:03.894752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fca324-394b-46af-baaa-b74f2eb25694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:03.895476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fca324-394b-46af-baaa-b74f2eb25694 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:03.895757 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fca324-394b-46af-baaa-b74f2eb25694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:03.896028 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fca324-394b-46af-baaa-b74f2eb25694 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:03.896726 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fca324-394b-46af-baaa-b74f2eb25694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:03.898694 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fca324-394b-46af-baaa-b74f2eb25694 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:04.013741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1335/2700] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:49:03 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:49:04.018491 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d832a3-e055-45c6-b6bd-ae8358b3b2f2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:04.031941 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d832a3-e055-45c6-b6bd-ae8358b3b2f2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:04.039149 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919936f-df26-4422-94fc-565a4fa77631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:04.039940 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919936f-df26-4422-94fc-565a4fa77631 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:04.040931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919936f-df26-4422-94fc-565a4fa77631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:04.041473 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919936f-df26-4422-94fc-565a4fa77631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:04.042519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919936f-df26-4422-94fc-565a4fa77631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:04.044609 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919936f-df26-4422-94fc-565a4fa77631 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:04.057053 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1366/2701] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:49:04.061360 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fca324-394b-46af-baaa-b74f2eb25694 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:04.071914 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fca324-394b-46af-baaa-b74f2eb25694 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:04.076505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f765a-6cb3-4628-afd4-4c969d3fc75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:04.077429 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f765a-6cb3-4628-afd4-4c969d3fc75e admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:04.077717 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f765a-6cb3-4628-afd4-4c969d3fc75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:04.077997 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f765a-6cb3-4628-afd4-4c969d3fc75e admin admin] PATH_INFO: `/v3/projects/f3e576d7d2c74cb2b5fa98eedc35814a/users/4fbd6014b47b4a859b95e5c1d7b9f916/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:04.094396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f765a-6cb3-4628-afd4-4c969d3fc75e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e576d7d2c74cb2b5fa98eedc35814a, user_id=4fbd6014b47b4a859b95e5c1d7b9f916, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:04.097087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f765a-6cb3-4628-afd4-4c969d3fc75e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:04.210387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1336/2702] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:49:04 2022] PUT /identity/v3/projects/f3e576d7d2c74cb2b5fa98eedc35814a/users/4fbd6014b47b4a859b95e5c1d7b9f916/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:04.215145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919936f-df26-4422-94fc-565a4fa77631 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:04.225062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919936f-df26-4422-94fc-565a4fa77631 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:04.285224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1027ca4-f694-4f3f-9387-13e607dae873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:04.286336 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1027ca4-f694-4f3f-9387-13e607dae873 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:04.286794 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1027ca4-f694-4f3f-9387-13e607dae873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:04.287243 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1027ca4-f694-4f3f-9387-13e607dae873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:04.288495 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1027ca4-f694-4f3f-9387-13e607dae873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:04.292263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1027ca4-f694-4f3f-9387-13e607dae873 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:04.303147 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1367/2703] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:49:04.307883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f765a-6cb3-4628-afd4-4c969d3fc75e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:04.318627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f765a-6cb3-4628-afd4-4c969d3fc75e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:04.324296 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694561cc-73fd-4767-bbb3-cd63b2d556e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:04.325142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694561cc-73fd-4767-bbb3-cd63b2d556e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:04.325532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694561cc-73fd-4767-bbb3-cd63b2d556e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:04.325814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694561cc-73fd-4767-bbb3-cd63b2d556e0 admin admin] PATH_INFO: `/v3/projects/f3e576d7d2c74cb2b5fa98eedc35814a/users/4fbd6014b47b4a859b95e5c1d7b9f916/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:04.327826 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694561cc-73fd-4767-bbb3-cd63b2d556e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e576d7d2c74cb2b5fa98eedc35814a, user_id=4fbd6014b47b4a859b95e5c1d7b9f916, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:04.330532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694561cc-73fd-4767-bbb3-cd63b2d556e0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:04.341545 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1337/2704] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:49:04 2022] PUT /identity/v3/projects/f3e576d7d2c74cb2b5fa98eedc35814a/users/4fbd6014b47b4a859b95e5c1d7b9f916/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:04.351783 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd13d40-a508-4746-9787-642cb95501d1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:04.352092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd13d40-a508-4746-9787-642cb95501d1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:04.352367 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd13d40-a508-4746-9787-642cb95501d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:04.379490 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8dd13d40-a508-4746-9787-642cb95501d1 None None] MFA Rules not processed for user `4fbd6014b47b4a859b95e5c1d7b9f916`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:49:04.380693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8dd13d40-a508-4746-9787-642cb95501d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:04.445052 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:04.454391 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1368/2705] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:49:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:49:04.472698 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694561cc-73fd-4767-bbb3-cd63b2d556e0 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:04.474468 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-694561cc-73fd-4767-bbb3-cd63b2d556e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:04.531329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694561cc-73fd-4767-bbb3-cd63b2d556e0 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:04.536292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f52f1-69ab-4dad-ad7b-b8708164b889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:04.537339 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f52f1-69ab-4dad-ad7b-b8708164b889 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:04.537821 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f52f1-69ab-4dad-ad7b-b8708164b889 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:04.538288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f52f1-69ab-4dad-ad7b-b8708164b889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:04.551038 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f52f1-69ab-4dad-ad7b-b8708164b889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:04.552496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f52f1-69ab-4dad-ad7b-b8708164b889 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:04.557662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:04.562586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1338/2706] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:49:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:49:05.662722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd13d40-a508-4746-9787-642cb95501d1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:05.664109 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8dd13d40-a508-4746-9787-642cb95501d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:05.677177 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd13d40-a508-4746-9787-642cb95501d1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:05.681562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d331e4-6423-4dd4-9793-a34364f70cda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:05.682506 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d331e4-6423-4dd4-9793-a34364f70cda service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:05.682791 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d331e4-6423-4dd4-9793-a34364f70cda service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:05.683078 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d331e4-6423-4dd4-9793-a34364f70cda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:05.740987 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d331e4-6423-4dd4-9793-a34364f70cda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:05.742474 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d331e4-6423-4dd4-9793-a34364f70cda service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:05.752250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1369/2707] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:49:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:49:11.694235 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f52f1-69ab-4dad-ad7b-b8708164b889 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:11.703243 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f52f1-69ab-4dad-ad7b-b8708164b889 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:11.706941 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502f593-6be2-4f8c-b625-55a808548ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:11.707611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502f593-6be2-4f8c-b625-55a808548ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:11.708169 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502f593-6be2-4f8c-b625-55a808548ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:11.708447 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502f593-6be2-4f8c-b625-55a808548ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:11.765754 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502f593-6be2-4f8c-b625-55a808548ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:11.767232 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502f593-6be2-4f8c-b625-55a808548ee2 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:11.776812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1339/2708] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:49:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:49:15.748163 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=30 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:15.983267 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d331e4-6423-4dd4-9793-a34364f70cda service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:16.048871 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d331e4-6423-4dd4-9793-a34364f70cda service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:16.053277 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970d410-e03e-436f-a931-cf14776754c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:16.054172 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d410-e03e-436f-a931-cf14776754c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:16.054456 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d410-e03e-436f-a931-cf14776754c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:16.055264 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d410-e03e-436f-a931-cf14776754c6 admin admin] PATH_INFO: `/v3/users/f150b044f6294d1798dfb729861c66de` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:16.056838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970d410-e03e-436f-a931-cf14776754c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f150b044f6294d1798dfb729861c66de)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:16.058803 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970d410-e03e-436f-a931-cf14776754c6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:16.219166 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1970d410-e03e-436f-a931-cf14776754c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f150b044f6294d1798dfb729861c66de'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:16.232881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1970d410-e03e-436f-a931-cf14776754c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f150b044f6294d1798dfb729861c66de'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:16.240483 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1970d410-e03e-436f-a931-cf14776754c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f150b044f6294d1798dfb729861c66de'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:16.241231 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1970d410-e03e-436f-a931-cf14776754c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f150b044f6294d1798dfb729861c66de'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:16.241984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1970d410-e03e-436f-a931-cf14776754c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f150b044f6294d1798dfb729861c66de'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:16.337707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1370/2709] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:49:15 2022] DELETE /identity/v3/users/f150b044f6294d1798dfb729861c66de => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:16.342597 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3c70f-be52-4d05-afb5-d42041adc219 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:16.343090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3c70f-be52-4d05-afb5-d42041adc219 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:16.343255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3c70f-be52-4d05-afb5-d42041adc219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:16.364732 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a7b3c70f-be52-4d05-afb5-d42041adc219 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:49:16.365985 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a7b3c70f-be52-4d05-afb5-d42041adc219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:16.428453 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1340/2710] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:49:16.439020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970d410-e03e-436f-a931-cf14776754c6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:16.440487 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1970d410-e03e-436f-a931-cf14776754c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:16.503378 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970d410-e03e-436f-a931-cf14776754c6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:16.507415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fcef3-79e6-4e1d-b05b-f1b8fc203a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:16.508666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fcef3-79e6-4e1d-b05b-f1b8fc203a78 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:16.509033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fcef3-79e6-4e1d-b05b-f1b8fc203a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:16.509316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fcef3-79e6-4e1d-b05b-f1b8fc203a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:16.519310 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fcef3-79e6-4e1d-b05b-f1b8fc203a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:16.523038 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fcef3-79e6-4e1d-b05b-f1b8fc203a78 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:16.531521 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1371/2711] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:49:16.970349 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3c70f-be52-4d05-afb5-d42041adc219 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:16.972350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a7b3c70f-be52-4d05-afb5-d42041adc219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:16.987626 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3c70f-be52-4d05-afb5-d42041adc219 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:16.992989 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5e735-2fd7-4872-918b-f29b8e998475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:16.993895 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5e735-2fd7-4872-918b-f29b8e998475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:16.994168 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5e735-2fd7-4872-918b-f29b8e998475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:16.994437 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5e735-2fd7-4872-918b-f29b8e998475 admin admin] PATH_INFO: `/v3/projects/77fd259293784298aa87891b97255755` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:16.995713 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5e735-2fd7-4872-918b-f29b8e998475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77fd259293784298aa87891b97255755)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:16.997573 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5e735-2fd7-4872-918b-f29b8e998475 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:17.123742 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-49e5e735-2fd7-4872-918b-f29b8e998475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77fd259293784298aa87891b97255755', 'request_id': 'req-49e5e735-2fd7-4872-918b-f29b8e998475'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:17.130203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-49e5e735-2fd7-4872-918b-f29b8e998475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77fd259293784298aa87891b97255755', 'request_id': 'req-49e5e735-2fd7-4872-918b-f29b8e998475'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:17.199475 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-49e5e735-2fd7-4872-918b-f29b8e998475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77fd259293784298aa87891b97255755', 'request_id': 'req-49e5e735-2fd7-4872-918b-f29b8e998475'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:17.211484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-49e5e735-2fd7-4872-918b-f29b8e998475 admin admin] The token cache is being invalidate because project 77fd259293784298aa87891b97255755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:49:17.211878 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-49e5e735-2fd7-4872-918b-f29b8e998475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:17.212550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-49e5e735-2fd7-4872-918b-f29b8e998475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:17.214192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1341/2712] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:49:16 2022] DELETE /identity/v3/projects/77fd259293784298aa87891b97255755 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:17.218378 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fcef3-79e6-4e1d-b05b-f1b8fc203a78 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:17.228429 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fcef3-79e6-4e1d-b05b-f1b8fc203a78 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:17.246205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:17.285103 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe2529-3e56-4255-be04-180a46ea629f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:17.286009 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe2529-3e56-4255-be04-180a46ea629f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:17.286289 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe2529-3e56-4255-be04-180a46ea629f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:17.286566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe2529-3e56-4255-be04-180a46ea629f admin admin] PATH_INFO: `/v3/users/0e9ccb027ded439eb2a488d7121e6f36` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:17.287747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe2529-3e56-4255-be04-180a46ea629f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e9ccb027ded439eb2a488d7121e6f36)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:17.290317 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe2529-3e56-4255-be04-180a46ea629f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:17.591791 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fcfe2529-3e56-4255-be04-180a46ea629f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e9ccb027ded439eb2a488d7121e6f36'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:17.607014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fcfe2529-3e56-4255-be04-180a46ea629f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e9ccb027ded439eb2a488d7121e6f36'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:17.615237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fcfe2529-3e56-4255-be04-180a46ea629f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e9ccb027ded439eb2a488d7121e6f36'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:17.617725 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fcfe2529-3e56-4255-be04-180a46ea629f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e9ccb027ded439eb2a488d7121e6f36'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:17.618411 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fcfe2529-3e56-4255-be04-180a46ea629f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e9ccb027ded439eb2a488d7121e6f36'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:17.727306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1372/2713] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:49:17 2022] DELETE /identity/v3/users/0e9ccb027ded439eb2a488d7121e6f36 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:18.232949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5e735-2fd7-4872-918b-f29b8e998475 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:18.235415 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-49e5e735-2fd7-4872-918b-f29b8e998475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:18.251246 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5e735-2fd7-4872-918b-f29b8e998475 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:18.272957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:18.315775 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bb403-9e09-48e2-9126-265bdd013499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:18.316724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bb403-9e09-48e2-9126-265bdd013499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:18.317004 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bb403-9e09-48e2-9126-265bdd013499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:18.317281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bb403-9e09-48e2-9126-265bdd013499 admin admin] PATH_INFO: `/v3/projects/7c7368a87ab34eeebcc161c9fb7b92ff` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:18.318542 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bb403-9e09-48e2-9126-265bdd013499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7368a87ab34eeebcc161c9fb7b92ff)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:18.320886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bb403-9e09-48e2-9126-265bdd013499 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:18.451516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a68bb403-9e09-48e2-9126-265bdd013499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7368a87ab34eeebcc161c9fb7b92ff', 'request_id': 'req-a68bb403-9e09-48e2-9126-265bdd013499'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:18.458089 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a68bb403-9e09-48e2-9126-265bdd013499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7368a87ab34eeebcc161c9fb7b92ff', 'request_id': 'req-a68bb403-9e09-48e2-9126-265bdd013499'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:18.528546 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a68bb403-9e09-48e2-9126-265bdd013499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7368a87ab34eeebcc161c9fb7b92ff', 'request_id': 'req-a68bb403-9e09-48e2-9126-265bdd013499'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:18.540264 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a68bb403-9e09-48e2-9126-265bdd013499 admin admin] The token cache is being invalidate because project 7c7368a87ab34eeebcc161c9fb7b92ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:49:18.540869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a68bb403-9e09-48e2-9126-265bdd013499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:18.542215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a68bb403-9e09-48e2-9126-265bdd013499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:18.543860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1342/2714] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:49:18 2022] DELETE /identity/v3/projects/7c7368a87ab34eeebcc161c9fb7b92ff => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:18.548171 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe2529-3e56-4255-be04-180a46ea629f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:18.549816 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fcfe2529-3e56-4255-be04-180a46ea629f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:18.563568 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe2529-3e56-4255-be04-180a46ea629f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:18.622750 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ec39e-b046-43ba-8208-7f082dacd68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:18.623626 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ec39e-b046-43ba-8208-7f082dacd68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:18.623911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ec39e-b046-43ba-8208-7f082dacd68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:18.624189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ec39e-b046-43ba-8208-7f082dacd68e admin admin] PATH_INFO: `/v3/users/4fbd6014b47b4a859b95e5c1d7b9f916` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:18.625399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ec39e-b046-43ba-8208-7f082dacd68e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fbd6014b47b4a859b95e5c1d7b9f916)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:18.627359 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ec39e-b046-43ba-8208-7f082dacd68e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:18.819884 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:18.822928 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e4ec39e-b046-43ba-8208-7f082dacd68e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fbd6014b47b4a859b95e5c1d7b9f916'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:18.834644 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e4ec39e-b046-43ba-8208-7f082dacd68e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fbd6014b47b4a859b95e5c1d7b9f916'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:18.842438 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e4ec39e-b046-43ba-8208-7f082dacd68e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fbd6014b47b4a859b95e5c1d7b9f916'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:18.846523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e4ec39e-b046-43ba-8208-7f082dacd68e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fbd6014b47b4a859b95e5c1d7b9f916'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:18.846523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e4ec39e-b046-43ba-8208-7f082dacd68e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fbd6014b47b4a859b95e5c1d7b9f916'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:18.935396 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1373/2715] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:49:18 2022] DELETE /identity/v3/users/4fbd6014b47b4a859b95e5c1d7b9f916 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:19.387278 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bb403-9e09-48e2-9126-265bdd013499 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:19.388773 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a68bb403-9e09-48e2-9126-265bdd013499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:19.403055 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bb403-9e09-48e2-9126-265bdd013499 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:19.465662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bc2c5-ed99-45b9-90b5-c8651092961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:19.466543 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bc2c5-ed99-45b9-90b5-c8651092961d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:19.466835 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bc2c5-ed99-45b9-90b5-c8651092961d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:19.467112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bc2c5-ed99-45b9-90b5-c8651092961d admin admin] PATH_INFO: `/v3/projects/f3e576d7d2c74cb2b5fa98eedc35814a` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:19.468305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bc2c5-ed99-45b9-90b5-c8651092961d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e576d7d2c74cb2b5fa98eedc35814a)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:19.470283 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bc2c5-ed99-45b9-90b5-c8651092961d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:19.603594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-185bc2c5-ed99-45b9-90b5-c8651092961d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e576d7d2c74cb2b5fa98eedc35814a', 'request_id': 'req-185bc2c5-ed99-45b9-90b5-c8651092961d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:19.609869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-185bc2c5-ed99-45b9-90b5-c8651092961d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e576d7d2c74cb2b5fa98eedc35814a', 'request_id': 'req-185bc2c5-ed99-45b9-90b5-c8651092961d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:19.611524 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:19.685527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-185bc2c5-ed99-45b9-90b5-c8651092961d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e576d7d2c74cb2b5fa98eedc35814a', 'request_id': 'req-185bc2c5-ed99-45b9-90b5-c8651092961d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:19.696934 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-185bc2c5-ed99-45b9-90b5-c8651092961d admin admin] The token cache is being invalidate because project f3e576d7d2c74cb2b5fa98eedc35814a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:49:19.697225 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-185bc2c5-ed99-45b9-90b5-c8651092961d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:19.697933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-185bc2c5-ed99-45b9-90b5-c8651092961d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:19.699542 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1343/2716] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:49:19 2022] DELETE /identity/v3/projects/f3e576d7d2c74cb2b5fa98eedc35814a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:19.705514 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96979fdb-bfe5-49cd-bfe0-05c5519ea330 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:19.706010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96979fdb-bfe5-49cd-bfe0-05c5519ea330 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:19.706119 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96979fdb-bfe5-49cd-bfe0-05c5519ea330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:19.725611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-96979fdb-bfe5-49cd-bfe0-05c5519ea330 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:49:19.727611 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-96979fdb-bfe5-49cd-bfe0-05c5519ea330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:19.786248 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1374/2717] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:49:19.795724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5023963-16db-455e-858f-c5c7d32ad1a1 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:19.796017 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5023963-16db-455e-858f-c5c7d32ad1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:19.796329 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5023963-16db-455e-858f-c5c7d32ad1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:19.814514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d5023963-16db-455e-858f-c5c7d32ad1a1 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:49:19.815724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d5023963-16db-455e-858f-c5c7d32ad1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:19.823812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1344/2718] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:49:19.827945 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96979fdb-bfe5-49cd-bfe0-05c5519ea330 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:19.838405 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96979fdb-bfe5-49cd-bfe0-05c5519ea330 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:19.842888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d87778-004f-4374-9708-a491a840d4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:19.843539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87778-004f-4374-9708-a491a840d4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:19.843817 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87778-004f-4374-9708-a491a840d4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:19.844092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87778-004f-4374-9708-a491a840d4b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:19.844809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d87778-004f-4374-9708-a491a840d4b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:49:19.845112 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d87778-004f-4374-9708-a491a840d4b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:19.846726 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d87778-004f-4374-9708-a491a840d4b3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:19.858680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1375/2719] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:49:19.863051 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5023963-16db-455e-858f-c5c7d32ad1a1 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:19.872497 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5023963-16db-455e-858f-c5c7d32ad1a1 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:19.877120 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63121409-59ec-4ec9-9f74-6f78d8b57254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:19.877801 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63121409-59ec-4ec9-9f74-6f78d8b57254 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:19.878081 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63121409-59ec-4ec9-9f74-6f78d8b57254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:19.878354 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63121409-59ec-4ec9-9f74-6f78d8b57254 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:19.879030 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63121409-59ec-4ec9-9f74-6f78d8b57254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:19.880932 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63121409-59ec-4ec9-9f74-6f78d8b57254 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:19.965130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1345/2720] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:49:19 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:49:19.969269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d87778-004f-4374-9708-a491a840d4b3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:19.980323 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d87778-004f-4374-9708-a491a840d4b3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:20.041971 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d8e75-15d8-4d21-ad97-0816a6ab814d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:20.042640 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d8e75-15d8-4d21-ad97-0816a6ab814d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:20.042921 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d8e75-15d8-4d21-ad97-0816a6ab814d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:20.043193 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d8e75-15d8-4d21-ad97-0816a6ab814d admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:20.043922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d8e75-15d8-4d21-ad97-0816a6ab814d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:20.045885 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d8e75-15d8-4d21-ad97-0816a6ab814d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:20.153851 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1376/2721] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:49:19 2022] POST /identity/v3/users => generated 284 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:49:20.158131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63121409-59ec-4ec9-9f74-6f78d8b57254 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:20.169211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63121409-59ec-4ec9-9f74-6f78d8b57254 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:20.173884 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43d303-a9fa-48fc-bc1d-fdbfb053b0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:20.174539 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43d303-a9fa-48fc-bc1d-fdbfb053b0fa admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:20.174854 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43d303-a9fa-48fc-bc1d-fdbfb053b0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:20.175132 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43d303-a9fa-48fc-bc1d-fdbfb053b0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:20.175849 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43d303-a9fa-48fc-bc1d-fdbfb053b0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:20.177492 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43d303-a9fa-48fc-bc1d-fdbfb053b0fa admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:20.188815 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1346/2722] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:49:20.192811 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d8e75-15d8-4d21-ad97-0816a6ab814d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:20.202997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d8e75-15d8-4d21-ad97-0816a6ab814d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:20.207813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c51a9-8571-43f1-aa64-90362b5fb3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:20.208467 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c51a9-8571-43f1-aa64-90362b5fb3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:20.208746 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c51a9-8571-43f1-aa64-90362b5fb3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:20.209020 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c51a9-8571-43f1-aa64-90362b5fb3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:20.209772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c51a9-8571-43f1-aa64-90362b5fb3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:20.211559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c51a9-8571-43f1-aa64-90362b5fb3a6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:20.221474 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1377/2723] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:49:20.225578 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43d303-a9fa-48fc-bc1d-fdbfb053b0fa admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:20.236431 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43d303-a9fa-48fc-bc1d-fdbfb053b0fa admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:20.240986 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7285687-b6fc-456d-9fa7-f86514cda6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:20.242614 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7285687-b6fc-456d-9fa7-f86514cda6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:20.242860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7285687-b6fc-456d-9fa7-f86514cda6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:20.243160 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7285687-b6fc-456d-9fa7-f86514cda6d7 admin admin] PATH_INFO: `/v3/projects/0953767b7e56432d9aee2df76fe5a16e/users/e42a3ca4203445b9a8f7242feab94678/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:20.258107 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7285687-b6fc-456d-9fa7-f86514cda6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0953767b7e56432d9aee2df76fe5a16e, user_id=e42a3ca4203445b9a8f7242feab94678, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:20.260898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7285687-b6fc-456d-9fa7-f86514cda6d7 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:20.331172 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1347/2724] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:49:20 2022] PUT /identity/v3/projects/0953767b7e56432d9aee2df76fe5a16e/users/e42a3ca4203445b9a8f7242feab94678/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:20.343193 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aba6ba-186b-4f60-ae09-145d45a0f28a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:20.343588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aba6ba-186b-4f60-ae09-145d45a0f28a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:20.343873 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aba6ba-186b-4f60-ae09-145d45a0f28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:20.374938 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f0aba6ba-186b-4f60-ae09-145d45a0f28a None None] MFA Rules not processed for user `e42a3ca4203445b9a8f7242feab94678`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:49:20.376264 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f0aba6ba-186b-4f60-ae09-145d45a0f28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:20.390039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:20.444126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1378/2725] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:49:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:49:20.449148 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7285687-b6fc-456d-9fa7-f86514cda6d7 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:20.511311 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7285687-b6fc-456d-9fa7-f86514cda6d7 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:20.515946 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5def275-8f6e-4938-9723-f0dbaf250c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:20.516597 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5def275-8f6e-4938-9723-f0dbaf250c66 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:20.516877 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5def275-8f6e-4938-9723-f0dbaf250c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:20.517149 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5def275-8f6e-4938-9723-f0dbaf250c66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:20.517860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5def275-8f6e-4938-9723-f0dbaf250c66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:20.519752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5def275-8f6e-4938-9723-f0dbaf250c66 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:20.635509 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1348/2726] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:49:20 2022] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:49:20.639513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aba6ba-186b-4f60-ae09-145d45a0f28a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:20.650327 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aba6ba-186b-4f60-ae09-145d45a0f28a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:20.706924 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a6f53-6ea1-425f-8012-c5c78019d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:20.707857 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a6f53-6ea1-425f-8012-c5c78019d8ff admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:20.708138 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a6f53-6ea1-425f-8012-c5c78019d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:20.708420 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a6f53-6ea1-425f-8012-c5c78019d8ff admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:20.709129 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a6f53-6ea1-425f-8012-c5c78019d8ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:20.711233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a6f53-6ea1-425f-8012-c5c78019d8ff admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:20.834515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1379/2727] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:49:20 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:49:20.838590 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5def275-8f6e-4938-9723-f0dbaf250c66 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:20.848810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5def275-8f6e-4938-9723-f0dbaf250c66 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:20.853869 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4120439-0706-49d0-ab4a-8d39903bb10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:20.854519 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4120439-0706-49d0-ab4a-8d39903bb10a admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:20.854799 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4120439-0706-49d0-ab4a-8d39903bb10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:20.855073 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4120439-0706-49d0-ab4a-8d39903bb10a admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:20.855785 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4120439-0706-49d0-ab4a-8d39903bb10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:20.857418 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4120439-0706-49d0-ab4a-8d39903bb10a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:20.868603 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1349/2728] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:49:20.872717 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a6f53-6ea1-425f-8012-c5c78019d8ff admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:20.883629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a6f53-6ea1-425f-8012-c5c78019d8ff admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:20.888415 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ca061-c9ae-4b2b-b8a7-6210f9fc8c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:20.889301 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ca061-c9ae-4b2b-b8a7-6210f9fc8c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:20.889614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ca061-c9ae-4b2b-b8a7-6210f9fc8c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:20.889894 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ca061-c9ae-4b2b-b8a7-6210f9fc8c1b admin admin] PATH_INFO: `/v3/projects/c494864f11ff4b10b08069f783c50f64/users/aaa8b76aa85d4a6ba7300eb7d49c6461/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:20.905422 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ca061-c9ae-4b2b-b8a7-6210f9fc8c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c494864f11ff4b10b08069f783c50f64, user_id=aaa8b76aa85d4a6ba7300eb7d49c6461, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:20.908092 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ca061-c9ae-4b2b-b8a7-6210f9fc8c1b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:20.977079 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1380/2729] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:49:20 2022] PUT /identity/v3/projects/c494864f11ff4b10b08069f783c50f64/users/aaa8b76aa85d4a6ba7300eb7d49c6461/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:20.981179 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4120439-0706-49d0-ab4a-8d39903bb10a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:20.991305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4120439-0706-49d0-ab4a-8d39903bb10a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:21.040395 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:21.056259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea6369-5710-4977-8461-097bcf8c5bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:21.056259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea6369-5710-4977-8461-097bcf8c5bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:21.056259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea6369-5710-4977-8461-097bcf8c5bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:21.056259 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea6369-5710-4977-8461-097bcf8c5bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:21.056631 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea6369-5710-4977-8461-097bcf8c5bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:21.056631 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea6369-5710-4977-8461-097bcf8c5bdc admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:21.064572 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1350/2730] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:49:21.068657 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ca061-c9ae-4b2b-b8a7-6210f9fc8c1b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:21.079419 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ca061-c9ae-4b2b-b8a7-6210f9fc8c1b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:21.084330 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a40ded-83b6-4fdb-8f16-8d10cdfb4d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:21.085272 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a40ded-83b6-4fdb-8f16-8d10cdfb4d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:21.085544 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a40ded-83b6-4fdb-8f16-8d10cdfb4d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:21.086037 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a40ded-83b6-4fdb-8f16-8d10cdfb4d66 admin admin] PATH_INFO: `/v3/projects/c494864f11ff4b10b08069f783c50f64/users/aaa8b76aa85d4a6ba7300eb7d49c6461/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:21.088077 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a40ded-83b6-4fdb-8f16-8d10cdfb4d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c494864f11ff4b10b08069f783c50f64, user_id=aaa8b76aa85d4a6ba7300eb7d49c6461, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:21.090859 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a40ded-83b6-4fdb-8f16-8d10cdfb4d66 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:21.101530 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1381/2731] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:49:21 2022] PUT /identity/v3/projects/c494864f11ff4b10b08069f783c50f64/users/aaa8b76aa85d4a6ba7300eb7d49c6461/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:21.167101 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfc617-fcd3-44bc-8e91-a4d981aeffe2 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:21.167388 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfc617-fcd3-44bc-8e91-a4d981aeffe2 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:21.167669 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfc617-fcd3-44bc-8e91-a4d981aeffe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:21.195141 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-95cfc617-fcd3-44bc-8e91-a4d981aeffe2 None None] MFA Rules not processed for user `aaa8b76aa85d4a6ba7300eb7d49c6461`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:49:21.196502 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-95cfc617-fcd3-44bc-8e91-a4d981aeffe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:21.266317 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1351/2732] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:49:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:49:21.278531 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a40ded-83b6-4fdb-8f16-8d10cdfb4d66 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:21.280333 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c1a40ded-83b6-4fdb-8f16-8d10cdfb4d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:21.339707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a40ded-83b6-4fdb-8f16-8d10cdfb4d66 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:21.343232 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03c4fd-d7d1-4946-9826-f6a1518d328b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:21.343881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03c4fd-d7d1-4946-9826-f6a1518d328b service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:21.344163 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03c4fd-d7d1-4946-9826-f6a1518d328b service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:21.344439 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03c4fd-d7d1-4946-9826-f6a1518d328b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:21.354296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03c4fd-d7d1-4946-9826-f6a1518d328b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:21.355727 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03c4fd-d7d1-4946-9826-f6a1518d328b service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:21.365063 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1382/2733] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:49:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:49:21.556544 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfc617-fcd3-44bc-8e91-a4d981aeffe2 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:21.566443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfc617-fcd3-44bc-8e91-a4d981aeffe2 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:21.570764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3507fc-d44a-4dc7-a1a3-53670cb2b1b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:21.571412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3507fc-d44a-4dc7-a1a3-53670cb2b1b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:21.571695 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3507fc-d44a-4dc7-a1a3-53670cb2b1b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:21.572633 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3507fc-d44a-4dc7-a1a3-53670cb2b1b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:21.629775 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3507fc-d44a-4dc7-a1a3-53670cb2b1b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:21.631135 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3507fc-d44a-4dc7-a1a3-53670cb2b1b3 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:21.640112 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1352/2734] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:49:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:49:26.733204 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360b39-6156-42af-89eb-52873a42a36e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:26.733846 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360b39-6156-42af-89eb-52873a42a36e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:26.733846 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360b39-6156-42af-89eb-52873a42a36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:26.752764 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a4360b39-6156-42af-89eb-52873a42a36e None None] MFA Rules not processed for user `3af78d3ebe2548f280d84fff4d6cb644`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:49:26.754025 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a4360b39-6156-42af-89eb-52873a42a36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:26.759906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:26.809125 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1383/2735] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:49:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:49:26.862675 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3507fc-d44a-4dc7-a1a3-53670cb2b1b3 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:26.864195 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9b3507fc-d44a-4dc7-a1a3-53670cb2b1b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:26.942845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3507fc-d44a-4dc7-a1a3-53670cb2b1b3 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:26.946654 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a88efb-2114-42df-9f18-c0f699af20d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde4369f695745c199ce6c10d241b841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:26.947306 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a88efb-2114-42df-9f18-c0f699af20d3 service glance] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:26.947593 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a88efb-2114-42df-9f18-c0f699af20d3 service glance] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:26.947872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a88efb-2114-42df-9f18-c0f699af20d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:26.950048 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-66a88efb-2114-42df-9f18-c0f699af20d3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:26.954625 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:27.040696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a88efb-2114-42df-9f18-c0f699af20d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:27.042491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a88efb-2114-42df-9f18-c0f699af20d3 service glance] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:27.063046 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1353/2736] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:49:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:49:27.717789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4360b39-6156-42af-89eb-52873a42a36e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:27.719248 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a4360b39-6156-42af-89eb-52873a42a36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:27.783056 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4360b39-6156-42af-89eb-52873a42a36e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:27.786974 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a6838-548a-48a6-816a-033e7162169a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:27.787715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6838-548a-48a6-816a-033e7162169a service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:27.788656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6838-548a-48a6-816a-033e7162169a service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:27.788966 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6838-548a-48a6-816a-033e7162169a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:27.791835 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-159a6838-548a-48a6-816a-033e7162169a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:27.809743 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a6838-548a-48a6-816a-033e7162169a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:27.811453 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a6838-548a-48a6-816a-033e7162169a service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:27.825294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1384/2737] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:49:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:49:28.180673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a88efb-2114-42df-9f18-c0f699af20d3 service glance] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:28.252342 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a88efb-2114-42df-9f18-c0f699af20d3 service glance] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:28.256903 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871536bf-8804-47fa-9e90-420e73cc7a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:28.257957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871536bf-8804-47fa-9e90-420e73cc7a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:28.258237 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871536bf-8804-47fa-9e90-420e73cc7a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:28.258512 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871536bf-8804-47fa-9e90-420e73cc7a7c admin admin] PATH_INFO: `/v3/users/e42a3ca4203445b9a8f7242feab94678` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:28.259703 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871536bf-8804-47fa-9e90-420e73cc7a7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e42a3ca4203445b9a8f7242feab94678)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:28.261759 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871536bf-8804-47fa-9e90-420e73cc7a7c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:28.465125 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-871536bf-8804-47fa-9e90-420e73cc7a7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e42a3ca4203445b9a8f7242feab94678'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:28.477622 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-871536bf-8804-47fa-9e90-420e73cc7a7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e42a3ca4203445b9a8f7242feab94678'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:28.478409 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-871536bf-8804-47fa-9e90-420e73cc7a7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e42a3ca4203445b9a8f7242feab94678'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:28.479025 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-871536bf-8804-47fa-9e90-420e73cc7a7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e42a3ca4203445b9a8f7242feab94678'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:28.483931 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:28.486933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-871536bf-8804-47fa-9e90-420e73cc7a7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e42a3ca4203445b9a8f7242feab94678'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:28.570488 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1354/2738] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:49:28 2022] DELETE /identity/v3/users/e42a3ca4203445b9a8f7242feab94678 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:28.574966 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3ca89-370a-426e-a464-ecb11f924799 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:28.575280 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3ca89-370a-426e-a464-ecb11f924799 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:28.575582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3ca89-370a-426e-a464-ecb11f924799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:28.593813 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-51b3ca89-370a-426e-a464-ecb11f924799 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:49:28.595040 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-51b3ca89-370a-426e-a464-ecb11f924799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:28.654887 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1385/2739] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:49:28.665350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871536bf-8804-47fa-9e90-420e73cc7a7c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:28.666964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-871536bf-8804-47fa-9e90-420e73cc7a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:28.727220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871536bf-8804-47fa-9e90-420e73cc7a7c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:28.730852 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e679-8c2d-48c5-98f4-ac86b4962d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:28.731508 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e679-8c2d-48c5-98f4-ac86b4962d45 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:28.731794 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e679-8c2d-48c5-98f4-ac86b4962d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:28.732074 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e679-8c2d-48c5-98f4-ac86b4962d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:28.741522 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540e679-8c2d-48c5-98f4-ac86b4962d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:28.742972 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540e679-8c2d-48c5-98f4-ac86b4962d45 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:28.752987 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1355/2740] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:49:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:49:29.212343 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3ca89-370a-426e-a464-ecb11f924799 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:29.214681 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-51b3ca89-370a-426e-a464-ecb11f924799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:29.226348 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3ca89-370a-426e-a464-ecb11f924799 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:29.230959 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6245a1d-4e9f-4065-9f75-c03a5428a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:29.232124 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6245a1d-4e9f-4065-9f75-c03a5428a035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:29.232346 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6245a1d-4e9f-4065-9f75-c03a5428a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:29.232621 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6245a1d-4e9f-4065-9f75-c03a5428a035 admin admin] PATH_INFO: `/v3/projects/0953767b7e56432d9aee2df76fe5a16e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:29.233870 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6245a1d-4e9f-4065-9f75-c03a5428a035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0953767b7e56432d9aee2df76fe5a16e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:29.235797 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6245a1d-4e9f-4065-9f75-c03a5428a035 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:29.367608 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d6245a1d-4e9f-4065-9f75-c03a5428a035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0953767b7e56432d9aee2df76fe5a16e', 'request_id': 'req-d6245a1d-4e9f-4065-9f75-c03a5428a035'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:29.371348 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:29.472710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d6245a1d-4e9f-4065-9f75-c03a5428a035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0953767b7e56432d9aee2df76fe5a16e', 'request_id': 'req-d6245a1d-4e9f-4065-9f75-c03a5428a035'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:29.480045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d6245a1d-4e9f-4065-9f75-c03a5428a035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0953767b7e56432d9aee2df76fe5a16e', 'request_id': 'req-d6245a1d-4e9f-4065-9f75-c03a5428a035'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:29.490375 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d6245a1d-4e9f-4065-9f75-c03a5428a035 admin admin] The token cache is being invalidate because project 0953767b7e56432d9aee2df76fe5a16e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:49:29.490601 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d6245a1d-4e9f-4065-9f75-c03a5428a035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:29.491961 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d6245a1d-4e9f-4065-9f75-c03a5428a035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:29.493712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1386/2741] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:49:29 2022] DELETE /identity/v3/projects/0953767b7e56432d9aee2df76fe5a16e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:29.497885 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e679-8c2d-48c5-98f4-ac86b4962d45 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:29.507947 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e679-8c2d-48c5-98f4-ac86b4962d45 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:29.566536 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb07230-09dd-41ae-a5f7-aeac0a9ac4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:29.567411 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb07230-09dd-41ae-a5f7-aeac0a9ac4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:29.567696 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb07230-09dd-41ae-a5f7-aeac0a9ac4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:29.567975 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb07230-09dd-41ae-a5f7-aeac0a9ac4e9 admin admin] PATH_INFO: `/v3/users/aaa8b76aa85d4a6ba7300eb7d49c6461` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:29.569279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb07230-09dd-41ae-a5f7-aeac0a9ac4e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa8b76aa85d4a6ba7300eb7d49c6461)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:29.571221 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb07230-09dd-41ae-a5f7-aeac0a9ac4e9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:29.726761 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-eeb07230-09dd-41ae-a5f7-aeac0a9ac4e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa8b76aa85d4a6ba7300eb7d49c6461'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:29.738856 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-eeb07230-09dd-41ae-a5f7-aeac0a9ac4e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa8b76aa85d4a6ba7300eb7d49c6461'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:29.739532 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-eeb07230-09dd-41ae-a5f7-aeac0a9ac4e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa8b76aa85d4a6ba7300eb7d49c6461'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:29.740162 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-eeb07230-09dd-41ae-a5f7-aeac0a9ac4e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa8b76aa85d4a6ba7300eb7d49c6461'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:29.747213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-eeb07230-09dd-41ae-a5f7-aeac0a9ac4e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa8b76aa85d4a6ba7300eb7d49c6461'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:29.833703 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1356/2742] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:49:29 2022] DELETE /identity/v3/users/aaa8b76aa85d4a6ba7300eb7d49c6461 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:30.317449 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6245a1d-4e9f-4065-9f75-c03a5428a035 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:30.317449 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d6245a1d-4e9f-4065-9f75-c03a5428a035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:30.329781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6245a1d-4e9f-4065-9f75-c03a5428a035 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:30.389066 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468fb2a-758e-4816-bee6-f07e8c3d16e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:30.389958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468fb2a-758e-4816-bee6-f07e8c3d16e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:30.390295 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468fb2a-758e-4816-bee6-f07e8c3d16e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:30.390569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468fb2a-758e-4816-bee6-f07e8c3d16e2 admin admin] PATH_INFO: `/v3/projects/c494864f11ff4b10b08069f783c50f64` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:30.391747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468fb2a-758e-4816-bee6-f07e8c3d16e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c494864f11ff4b10b08069f783c50f64)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:30.393702 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468fb2a-758e-4816-bee6-f07e8c3d16e2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:30.563305 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8468fb2a-758e-4816-bee6-f07e8c3d16e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c494864f11ff4b10b08069f783c50f64', 'request_id': 'req-8468fb2a-758e-4816-bee6-f07e8c3d16e2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:30.638721 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8468fb2a-758e-4816-bee6-f07e8c3d16e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c494864f11ff4b10b08069f783c50f64', 'request_id': 'req-8468fb2a-758e-4816-bee6-f07e8c3d16e2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:30.645618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8468fb2a-758e-4816-bee6-f07e8c3d16e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c494864f11ff4b10b08069f783c50f64', 'request_id': 'req-8468fb2a-758e-4816-bee6-f07e8c3d16e2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:30.656469 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8468fb2a-758e-4816-bee6-f07e8c3d16e2 admin admin] The token cache is being invalidate because project c494864f11ff4b10b08069f783c50f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:49:30.656760 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8468fb2a-758e-4816-bee6-f07e8c3d16e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:30.657536 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8468fb2a-758e-4816-bee6-f07e8c3d16e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:30.659152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1387/2743] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:49:30 2022] DELETE /identity/v3/projects/c494864f11ff4b10b08069f783c50f64 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:49:30.664666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3327dae-7055-4a6a-bf64-c15e58f38333 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:30.665149 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3327dae-7055-4a6a-bf64-c15e58f38333 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:30.668223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3327dae-7055-4a6a-bf64-c15e58f38333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:30.687097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d3327dae-7055-4a6a-bf64-c15e58f38333 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:49:30.688346 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d3327dae-7055-4a6a-bf64-c15e58f38333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:30.693012 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:30.751875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1357/2744] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:49:30.760316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc2a5e-30d9-4cf0-a1b3-7a5e00b85011 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:30.760665 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc2a5e-30d9-4cf0-a1b3-7a5e00b85011 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:30.761028 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc2a5e-30d9-4cf0-a1b3-7a5e00b85011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:30.779699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-23bc2a5e-30d9-4cf0-a1b3-7a5e00b85011 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:49:30.780907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-23bc2a5e-30d9-4cf0-a1b3-7a5e00b85011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:30.788800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1388/2745] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:49:30.793177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3327dae-7055-4a6a-bf64-c15e58f38333 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:30.802784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3327dae-7055-4a6a-bf64-c15e58f38333 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:30.807894 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae2383-c056-4676-a2f6-cfaf050030a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:30.808604 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae2383-c056-4676-a2f6-cfaf050030a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:30.808888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae2383-c056-4676-a2f6-cfaf050030a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:30.809164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae2383-c056-4676-a2f6-cfaf050030a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:30.809916 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae2383-c056-4676-a2f6-cfaf050030a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:49:30.810223 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae2383-c056-4676-a2f6-cfaf050030a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:30.811843 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae2383-c056-4676-a2f6-cfaf050030a8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:30.824896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1358/2746] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:49:30.832239 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc2a5e-30d9-4cf0-a1b3-7a5e00b85011 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:30.842394 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc2a5e-30d9-4cf0-a1b3-7a5e00b85011 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:30.847339 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1942d65-e798-4b97-8450-3fe46c5de2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:30.848015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1942d65-e798-4b97-8450-3fe46c5de2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:30.848294 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1942d65-e798-4b97-8450-3fe46c5de2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:30.848560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1942d65-e798-4b97-8450-3fe46c5de2d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:30.849253 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1942d65-e798-4b97-8450-3fe46c5de2d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:30.852084 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1942d65-e798-4b97-8450-3fe46c5de2d1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:30.958838 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1389/2747] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:49:30 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:49:30.964475 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae2383-c056-4676-a2f6-cfaf050030a8 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:30.974746 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae2383-c056-4676-a2f6-cfaf050030a8 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:31.042314 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805870e0-cecb-4660-8b6d-d3de3a571f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:31.043110 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805870e0-cecb-4660-8b6d-d3de3a571f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:31.043461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805870e0-cecb-4660-8b6d-d3de3a571f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:31.043843 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805870e0-cecb-4660-8b6d-d3de3a571f19 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:31.044618 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805870e0-cecb-4660-8b6d-d3de3a571f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:31.046795 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805870e0-cecb-4660-8b6d-d3de3a571f19 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:31.167199 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1359/2748] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:49:30 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:49:31.171736 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1942d65-e798-4b97-8450-3fe46c5de2d1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:31.184235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1942d65-e798-4b97-8450-3fe46c5de2d1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:31.189413 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7bf90-4daf-4008-bbec-a63584b91b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:31.196170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7bf90-4daf-4008-bbec-a63584b91b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:31.196170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7bf90-4daf-4008-bbec-a63584b91b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:31.196170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7bf90-4daf-4008-bbec-a63584b91b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:31.196170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7bf90-4daf-4008-bbec-a63584b91b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:31.196170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7bf90-4daf-4008-bbec-a63584b91b67 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:31.209089 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1390/2749] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:49:31.214152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805870e0-cecb-4660-8b6d-d3de3a571f19 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:31.224823 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805870e0-cecb-4660-8b6d-d3de3a571f19 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:31.231203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2426d-1907-4620-8b99-125f46ad289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:31.236517 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2426d-1907-4620-8b99-125f46ad289d admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:31.236517 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2426d-1907-4620-8b99-125f46ad289d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:31.236517 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2426d-1907-4620-8b99-125f46ad289d admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:31.236517 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2426d-1907-4620-8b99-125f46ad289d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:31.236517 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2426d-1907-4620-8b99-125f46ad289d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:31.248443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1360/2750] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:49:31.252650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7bf90-4daf-4008-bbec-a63584b91b67 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:31.282381 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7bf90-4daf-4008-bbec-a63584b91b67 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:31.282381 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5361bfa-c43b-4326-b42e-002760bf4c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:31.282381 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5361bfa-c43b-4326-b42e-002760bf4c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:31.282381 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5361bfa-c43b-4326-b42e-002760bf4c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:31.283066 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5361bfa-c43b-4326-b42e-002760bf4c29 admin admin] PATH_INFO: `/v3/projects/74381027cfcc459389b495269b70aa61/users/60a8b8d8443b43b6af0739bf4c57c3e8/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:31.292824 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5361bfa-c43b-4326-b42e-002760bf4c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74381027cfcc459389b495269b70aa61, user_id=60a8b8d8443b43b6af0739bf4c57c3e8, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:31.295538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5361bfa-c43b-4326-b42e-002760bf4c29 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:31.394132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1391/2751] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:49:31 2022] PUT /identity/v3/projects/74381027cfcc459389b495269b70aa61/users/60a8b8d8443b43b6af0739bf4c57c3e8/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:31.406083 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c54e16-1d9e-45a0-bde4-992ecc303a93 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:31.406458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c54e16-1d9e-45a0-bde4-992ecc303a93 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:31.406803 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c54e16-1d9e-45a0-bde4-992ecc303a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:31.438812 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-34c54e16-1d9e-45a0-bde4-992ecc303a93 None None] MFA Rules not processed for user `60a8b8d8443b43b6af0739bf4c57c3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:49:31.439992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-34c54e16-1d9e-45a0-bde4-992ecc303a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:31.511208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1361/2752] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:49:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:49:31.522841 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5361bfa-c43b-4326-b42e-002760bf4c29 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:31.524935 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d5361bfa-c43b-4326-b42e-002760bf4c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:31.536753 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:31.586313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5361bfa-c43b-4326-b42e-002760bf4c29 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:31.590026 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9469f5-d820-4d26-9242-ce90a14d5368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:31.590706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9469f5-d820-4d26-9242-ce90a14d5368 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:31.590970 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9469f5-d820-4d26-9242-ce90a14d5368 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:31.591250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9469f5-d820-4d26-9242-ce90a14d5368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:31.600373 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9469f5-d820-4d26-9242-ce90a14d5368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:31.601811 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9469f5-d820-4d26-9242-ce90a14d5368 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:31.611163 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1392/2753] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:49:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:49:41.507837 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:41.739462 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=22 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:57.677142 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c54e16-1d9e-45a0-bde4-992ecc303a93 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:57.741673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c54e16-1d9e-45a0-bde4-992ecc303a93 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:57.746534 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e5c53-fb82-49de-ab33-f90f422e220d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:57.747411 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e5c53-fb82-49de-ab33-f90f422e220d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:57.747721 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e5c53-fb82-49de-ab33-f90f422e220d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:57.747996 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e5c53-fb82-49de-ab33-f90f422e220d admin admin] PATH_INFO: `/v3/users/60a8b8d8443b43b6af0739bf4c57c3e8` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:57.749191 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e5c53-fb82-49de-ab33-f90f422e220d admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a8b8d8443b43b6af0739bf4c57c3e8)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:57.751156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e5c53-fb82-49de-ab33-f90f422e220d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:58.000469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-609e5c53-fb82-49de-ab33-f90f422e220d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a8b8d8443b43b6af0739bf4c57c3e8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:58.013920 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-609e5c53-fb82-49de-ab33-f90f422e220d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a8b8d8443b43b6af0739bf4c57c3e8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:58.014655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-609e5c53-fb82-49de-ab33-f90f422e220d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a8b8d8443b43b6af0739bf4c57c3e8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:58.015267 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-609e5c53-fb82-49de-ab33-f90f422e220d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a8b8d8443b43b6af0739bf4c57c3e8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:58.022292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-609e5c53-fb82-49de-ab33-f90f422e220d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a8b8d8443b43b6af0739bf4c57c3e8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:58.099654 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1362/2754] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:49:57 2022] DELETE /identity/v3/users/60a8b8d8443b43b6af0739bf4c57c3e8 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:49:58.104368 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa3249-fcb1-4120-a273-3e3ee9e24734 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:58.104905 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa3249-fcb1-4120-a273-3e3ee9e24734 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:58.105030 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa3249-fcb1-4120-a273-3e3ee9e24734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:58.123520 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b7fa3249-fcb1-4120-a273-3e3ee9e24734 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:49:58.124747 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b7fa3249-fcb1-4120-a273-3e3ee9e24734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:58.185515 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1393/2755] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:49:58.196184 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e5c53-fb82-49de-ab33-f90f422e220d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:58.197752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-609e5c53-fb82-49de-ab33-f90f422e220d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:58.258349 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e5c53-fb82-49de-ab33-f90f422e220d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:58.261819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb34b0-19e2-4c51-9481-1a01df622529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:58.262463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb34b0-19e2-4c51-9481-1a01df622529 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:58.262741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb34b0-19e2-4c51-9481-1a01df622529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:58.263015 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb34b0-19e2-4c51-9481-1a01df622529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:58.272470 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb34b0-19e2-4c51-9481-1a01df622529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:58.274126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb34b0-19e2-4c51-9481-1a01df622529 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:58.284386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1363/2756] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:49:58.723820 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa3249-fcb1-4120-a273-3e3ee9e24734 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:49:58.726431 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b7fa3249-fcb1-4120-a273-3e3ee9e24734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:49:58.738175 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa3249-fcb1-4120-a273-3e3ee9e24734 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:49:58.743917 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783eec77-c671-41b6-8b34-89a99f02fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:49:58.744809 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eec77-c671-41b6-8b34-89a99f02fd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:49:58.745095 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eec77-c671-41b6-8b34-89a99f02fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:49:58.745428 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eec77-c671-41b6-8b34-89a99f02fd6d admin admin] PATH_INFO: `/v3/projects/74381027cfcc459389b495269b70aa61` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:49:58.746844 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783eec77-c671-41b6-8b34-89a99f02fd6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=74381027cfcc459389b495269b70aa61)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:49:58.748656 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783eec77-c671-41b6-8b34-89a99f02fd6d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:49:58.895139 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-783eec77-c671-41b6-8b34-89a99f02fd6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74381027cfcc459389b495269b70aa61', 'request_id': 'req-783eec77-c671-41b6-8b34-89a99f02fd6d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:58.973674 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-783eec77-c671-41b6-8b34-89a99f02fd6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74381027cfcc459389b495269b70aa61', 'request_id': 'req-783eec77-c671-41b6-8b34-89a99f02fd6d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:58.981584 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-783eec77-c671-41b6-8b34-89a99f02fd6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74381027cfcc459389b495269b70aa61', 'request_id': 'req-783eec77-c671-41b6-8b34-89a99f02fd6d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:58.992640 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-783eec77-c671-41b6-8b34-89a99f02fd6d admin admin] The token cache is being invalidate because project 74381027cfcc459389b495269b70aa61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:49:58.992934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-783eec77-c671-41b6-8b34-89a99f02fd6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:58.993646 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-783eec77-c671-41b6-8b34-89a99f02fd6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:49:58.995395 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1394/2757] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:49:58 2022] DELETE /identity/v3/projects/74381027cfcc459389b495269b70aa61 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:50:08.279671 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:50:08.989189 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:50:19.617285 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77507f58-1f4a-4bba-94e6-27af68c60a59 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:50:19.617777 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77507f58-1f4a-4bba-94e6-27af68c60a59 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:50:19.617956 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77507f58-1f4a-4bba-94e6-27af68c60a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:50:19.674790 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-77507f58-1f4a-4bba-94e6-27af68c60a59 None None] MFA Rules not processed for user `9144d74a341b4e08ae353b384fe1186e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:50:19.676040 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-77507f58-1f4a-4bba-94e6-27af68c60a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:50:19.741446 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1364/2758] 10.222.0.52 () {58 vars in 967 bytes} [Fri Jun 17 07:50:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:50:19.782483 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783eec77-c671-41b6-8b34-89a99f02fd6d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:50:19.783861 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-783eec77-c671-41b6-8b34-89a99f02fd6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:50:19.873742 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783eec77-c671-41b6-8b34-89a99f02fd6d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:50:19.878792 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b58884-010b-4a18-af67-9173ec8509a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a18b07c033224d2085773936dad33eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:50:19.879438 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b58884-010b-4a18-af67-9173ec8509a5 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:50:19.879723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b58884-010b-4a18-af67-9173ec8509a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:50:19.880001 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b58884-010b-4a18-af67-9173ec8509a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:50:19.888432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b58884-010b-4a18-af67-9173ec8509a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:50:19.890101 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b58884-010b-4a18-af67-9173ec8509a5 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:50:19.898163 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1395/2759] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Jun 17 07:50:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:50:24.365433 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77507f58-1f4a-4bba-94e6-27af68c60a59 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:50:24.366843 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-77507f58-1f4a-4bba-94e6-27af68c60a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:50:24.456090 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77507f58-1f4a-4bba-94e6-27af68c60a59 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:50:24.461313 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e6f1f-da79-44c9-bac1-dfca2529863a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adc8b93e5c41929b928002e004df6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:50:24.462033 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e6f1f-da79-44c9-bac1-dfca2529863a service placement] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:50:24.463094 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e6f1f-da79-44c9-bac1-dfca2529863a service placement] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:50:24.463382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e6f1f-da79-44c9-bac1-dfca2529863a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:50:24.465270 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5a3e6f1f-da79-44c9-bac1-dfca2529863a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:50:24.477424 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e6f1f-da79-44c9-bac1-dfca2529863a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:50:24.479314 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e6f1f-da79-44c9-bac1-dfca2529863a service placement] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:50:24.489507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1365/2760] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:50:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:50:28.409486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b58884-010b-4a18-af67-9173ec8509a5 service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:50:28.431984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b58884-010b-4a18-af67-9173ec8509a5 service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:50:28.439430 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6019b1-cfbb-4a53-888e-fd2339e1450b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adc8b93e5c41929b928002e004df6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:50:28.440357 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6019b1-cfbb-4a53-888e-fd2339e1450b service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:50:28.440903 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6019b1-cfbb-4a53-888e-fd2339e1450b service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:50:28.441289 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6019b1-cfbb-4a53-888e-fd2339e1450b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:50:28.443863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6a6019b1-cfbb-4a53-888e-fd2339e1450b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:50:28.479914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6019b1-cfbb-4a53-888e-fd2339e1450b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:50:28.479914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6019b1-cfbb-4a53-888e-fd2339e1450b service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:50:28.479914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1396/2761] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:50:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:50:28.610260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e6f1f-da79-44c9-bac1-dfca2529863a service placement] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:50:28.611747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5a3e6f1f-da79-44c9-bac1-dfca2529863a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:50:28.667882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:50:28.681296 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e6f1f-da79-44c9-bac1-dfca2529863a service placement] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:50:28.686616 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a8304-0c7f-40f3-8008-c3323b0d050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:50:28.687530 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a8304-0c7f-40f3-8008-c3323b0d050f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:50:28.687841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a8304-0c7f-40f3-8008-c3323b0d050f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:50:28.688139 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a8304-0c7f-40f3-8008-c3323b0d050f admin admin] PATH_INFO: `/v3/users/c4a915f6c02d4facb64d5332904f9fe6` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:50:28.689530 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a8304-0c7f-40f3-8008-c3323b0d050f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a915f6c02d4facb64d5332904f9fe6)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:50:28.691598 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a8304-0c7f-40f3-8008-c3323b0d050f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:50:28.873919 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ae3a8304-0c7f-40f3-8008-c3323b0d050f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a915f6c02d4facb64d5332904f9fe6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:28.886321 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ae3a8304-0c7f-40f3-8008-c3323b0d050f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a915f6c02d4facb64d5332904f9fe6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:28.887166 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ae3a8304-0c7f-40f3-8008-c3323b0d050f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a915f6c02d4facb64d5332904f9fe6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:28.887788 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ae3a8304-0c7f-40f3-8008-c3323b0d050f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a915f6c02d4facb64d5332904f9fe6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:28.895691 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ae3a8304-0c7f-40f3-8008-c3323b0d050f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a915f6c02d4facb64d5332904f9fe6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:28.976522 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1366/2762] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:50:28 2022] DELETE /identity/v3/users/c4a915f6c02d4facb64d5332904f9fe6 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:50:29.239040 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6019b1-cfbb-4a53-888e-fd2339e1450b service placement] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:50:29.251253 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6019b1-cfbb-4a53-888e-fd2339e1450b service placement] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:50:29.322293 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1733e-5527-4475-9004-3864f62c113b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:50:29.323158 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1733e-5527-4475-9004-3864f62c113b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:50:29.323438 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1733e-5527-4475-9004-3864f62c113b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:50:29.323705 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1733e-5527-4475-9004-3864f62c113b admin admin] PATH_INFO: `/v3/projects/7b7f8de890ca4b1a82898a24488b32dd` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:50:29.324893 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1733e-5527-4475-9004-3864f62c113b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7f8de890ca4b1a82898a24488b32dd)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:50:29.326815 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1733e-5527-4475-9004-3864f62c113b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:50:29.436899 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-35e1733e-5527-4475-9004-3864f62c113b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7f8de890ca4b1a82898a24488b32dd', 'request_id': 'req-35e1733e-5527-4475-9004-3864f62c113b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:29.524707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-35e1733e-5527-4475-9004-3864f62c113b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7f8de890ca4b1a82898a24488b32dd', 'request_id': 'req-35e1733e-5527-4475-9004-3864f62c113b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:29.526919 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:50:29.531635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-35e1733e-5527-4475-9004-3864f62c113b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7f8de890ca4b1a82898a24488b32dd', 'request_id': 'req-35e1733e-5527-4475-9004-3864f62c113b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:29.542573 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-35e1733e-5527-4475-9004-3864f62c113b admin admin] The token cache is being invalidate because project 7b7f8de890ca4b1a82898a24488b32dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:50:29.542863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-35e1733e-5527-4475-9004-3864f62c113b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:29.543532 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-35e1733e-5527-4475-9004-3864f62c113b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:29.545538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1397/2763] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:50:29 2022] DELETE /identity/v3/projects/7b7f8de890ca4b1a82898a24488b32dd => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:50:29.549570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a8304-0c7f-40f3-8008-c3323b0d050f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:50:29.557627 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ae3a8304-0c7f-40f3-8008-c3323b0d050f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:50:29.572664 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a8304-0c7f-40f3-8008-c3323b0d050f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:50:29.631054 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10db3e-60ec-4f36-935b-05aaf472c2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:50:29.631953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10db3e-60ec-4f36-935b-05aaf472c2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:50:29.632218 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10db3e-60ec-4f36-935b-05aaf472c2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:50:29.632494 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10db3e-60ec-4f36-935b-05aaf472c2c2 admin admin] PATH_INFO: `/v3/users/799ae61a570740ae95e70903f80d4066` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:50:29.634375 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10db3e-60ec-4f36-935b-05aaf472c2c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=799ae61a570740ae95e70903f80d4066)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:50:29.636382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10db3e-60ec-4f36-935b-05aaf472c2c2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:50:29.830906 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fa10db3e-60ec-4f36-935b-05aaf472c2c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '799ae61a570740ae95e70903f80d4066'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:29.842941 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fa10db3e-60ec-4f36-935b-05aaf472c2c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '799ae61a570740ae95e70903f80d4066'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:29.844838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fa10db3e-60ec-4f36-935b-05aaf472c2c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '799ae61a570740ae95e70903f80d4066'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:29.844838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fa10db3e-60ec-4f36-935b-05aaf472c2c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '799ae61a570740ae95e70903f80d4066'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:29.851095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fa10db3e-60ec-4f36-935b-05aaf472c2c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '799ae61a570740ae95e70903f80d4066'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:29.853536 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:50:29.959505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1367/2764] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:50:29 2022] DELETE /identity/v3/users/799ae61a570740ae95e70903f80d4066 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:50:30.210046 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1733e-5527-4475-9004-3864f62c113b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:50:30.211552 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-35e1733e-5527-4475-9004-3864f62c113b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:50:30.229569 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1733e-5527-4475-9004-3864f62c113b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:50:30.288600 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b80669-08c2-40d9-9c6f-7bf0818e82da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:50:30.289500 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b80669-08c2-40d9-9c6f-7bf0818e82da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:50:30.289781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b80669-08c2-40d9-9c6f-7bf0818e82da admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:50:30.290931 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b80669-08c2-40d9-9c6f-7bf0818e82da admin admin] PATH_INFO: `/v3/projects/850c79a1c40a40b88eee619a828bda8b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:50:30.292127 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b80669-08c2-40d9-9c6f-7bf0818e82da admin admin] RBAC: Authorizing `identity:delete_project(project_id=850c79a1c40a40b88eee619a828bda8b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:50:30.294075 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b80669-08c2-40d9-9c6f-7bf0818e82da admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:50:30.412790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e4b80669-08c2-40d9-9c6f-7bf0818e82da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '850c79a1c40a40b88eee619a828bda8b', 'request_id': 'req-e4b80669-08c2-40d9-9c6f-7bf0818e82da'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:30.500038 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e4b80669-08c2-40d9-9c6f-7bf0818e82da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '850c79a1c40a40b88eee619a828bda8b', 'request_id': 'req-e4b80669-08c2-40d9-9c6f-7bf0818e82da'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:30.506647 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e4b80669-08c2-40d9-9c6f-7bf0818e82da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '850c79a1c40a40b88eee619a828bda8b', 'request_id': 'req-e4b80669-08c2-40d9-9c6f-7bf0818e82da'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:30.517852 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e4b80669-08c2-40d9-9c6f-7bf0818e82da admin admin] The token cache is being invalidate because project 850c79a1c40a40b88eee619a828bda8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:50:30.518140 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e4b80669-08c2-40d9-9c6f-7bf0818e82da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:30.518784 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e4b80669-08c2-40d9-9c6f-7bf0818e82da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:50:30.520348 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1398/2765] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:50:30 2022] DELETE /identity/v3/projects/850c79a1c40a40b88eee619a828bda8b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:50:33.073279 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10db3e-60ec-4f36-935b-05aaf472c2c2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:50:33.074704 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fa10db3e-60ec-4f36-935b-05aaf472c2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:50:33.134298 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10db3e-60ec-4f36-935b-05aaf472c2c2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:50:33.184838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb02b1-a11e-45ac-94dd-b27e81d6449c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:50:33.185527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb02b1-a11e-45ac-94dd-b27e81d6449c service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:50:33.185811 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb02b1-a11e-45ac-94dd-b27e81d6449c service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:50:33.186088 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb02b1-a11e-45ac-94dd-b27e81d6449c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:50:33.188528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0cfb02b1-a11e-45ac-94dd-b27e81d6449c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:50:33.205383 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb02b1-a11e-45ac-94dd-b27e81d6449c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:50:33.210557 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb02b1-a11e-45ac-94dd-b27e81d6449c service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:50:33.216260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1368/2766] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:50:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:50:40.514827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=55,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:50:43.211611 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=48 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:51:24.963951 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827a90-f433-4558-a798-43f933d03b85 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:51:24.966922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827a90-f433-4558-a798-43f933d03b85 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:51:24.966922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827a90-f433-4558-a798-43f933d03b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:51:24.982875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3e827a90-f433-4558-a798-43f933d03b85 None None] MFA Rules not processed for user `3af78d3ebe2548f280d84fff4d6cb644`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:51:24.984099 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3e827a90-f433-4558-a798-43f933d03b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:51:25.039205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1399/2767] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:51:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:51:25.340150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb02b1-a11e-45ac-94dd-b27e81d6449c service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:51:25.341698 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0cfb02b1-a11e-45ac-94dd-b27e81d6449c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:51:25.352097 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb02b1-a11e-45ac-94dd-b27e81d6449c service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:51:25.355798 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16828d3f-127b-4202-9c85-636188d445d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:51:25.356440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16828d3f-127b-4202-9c85-636188d445d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:51:25.357301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16828d3f-127b-4202-9c85-636188d445d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:51:25.357610 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16828d3f-127b-4202-9c85-636188d445d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:51:25.359365 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-16828d3f-127b-4202-9c85-636188d445d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:51:25.368730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16828d3f-127b-4202-9c85-636188d445d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:51:25.370208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16828d3f-127b-4202-9c85-636188d445d6 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:51:25.378480 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1369/2768] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:51:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:51:35.032182 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=25 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:51:35.374655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=6 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:51:36.026132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e827a90-f433-4558-a798-43f933d03b85 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:51:36.027756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3e827a90-f433-4558-a798-43f933d03b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:51:36.101575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e827a90-f433-4558-a798-43f933d03b85 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:51:36.107774 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95058a5a-169c-41ef-b607-f36d984b49f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:51:36.108427 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95058a5a-169c-41ef-b607-f36d984b49f7 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:51:36.108708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95058a5a-169c-41ef-b607-f36d984b49f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:51:36.108984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95058a5a-169c-41ef-b607-f36d984b49f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:51:36.110778 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-95058a5a-169c-41ef-b607-f36d984b49f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:51:36.123286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95058a5a-169c-41ef-b607-f36d984b49f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:51:36.124953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95058a5a-169c-41ef-b607-f36d984b49f7 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:51:36.135389 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1400/2769] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:51:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:51:46.131029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=34 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:52:54.835313 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16828d3f-127b-4202-9c85-636188d445d6 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:52:54.848943 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16828d3f-127b-4202-9c85-636188d445d6 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:52:54.855731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fa793-7e6a-4785-afc8-5f1c0a1b0966 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:52:54.856480 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fa793-7e6a-4785-afc8-5f1c0a1b0966 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:52:54.856757 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fa793-7e6a-4785-afc8-5f1c0a1b0966 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:52:54.857030 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fa793-7e6a-4785-afc8-5f1c0a1b0966 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:52:54.859333 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d74fa793-7e6a-4785-afc8-5f1c0a1b0966 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:52:54.871672 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fa793-7e6a-4785-afc8-5f1c0a1b0966 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:52:54.873188 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fa793-7e6a-4785-afc8-5f1c0a1b0966 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:52:54.883143 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1370/2770] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:52:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:53:04.878440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=6 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:53:12.298356 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95058a5a-169c-41ef-b607-f36d984b49f7 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:53:12.300929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-95058a5a-169c-41ef-b607-f36d984b49f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:53:12.317558 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95058a5a-169c-41ef-b607-f36d984b49f7 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:53:12.324756 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d5e00-6616-484f-8ca1-83da56cbd50d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:53:12.325603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d5e00-6616-484f-8ca1-83da56cbd50d service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:53:12.325969 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d5e00-6616-484f-8ca1-83da56cbd50d service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:53:12.326313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d5e00-6616-484f-8ca1-83da56cbd50d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:53:12.328263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-973d5e00-6616-484f-8ca1-83da56cbd50d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:53:12.340976 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d5e00-6616-484f-8ca1-83da56cbd50d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:53:12.342690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d5e00-6616-484f-8ca1-83da56cbd50d service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:53:12.354085 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1401/2771] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:53:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:53:17.138152 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294c953-74a7-4c74-bb90-a54efe8a75be None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:53:17.138748 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294c953-74a7-4c74-bb90-a54efe8a75be None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:53:17.138748 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294c953-74a7-4c74-bb90-a54efe8a75be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:53:17.156604 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c294c953-74a7-4c74-bb90-a54efe8a75be None None] MFA Rules not processed for user `3af78d3ebe2548f280d84fff4d6cb644`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:53:17.157828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c294c953-74a7-4c74-bb90-a54efe8a75be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:53:17.164687 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1371/2772] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:53:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:53:17.471409 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d5e00-6616-484f-8ca1-83da56cbd50d service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:53:17.474233 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-973d5e00-6616-484f-8ca1-83da56cbd50d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:53:17.484706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d5e00-6616-484f-8ca1-83da56cbd50d service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:53:17.488298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015465d7-3dfb-4964-878a-9673a2c79c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:53:17.488934 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015465d7-3dfb-4964-878a-9673a2c79c43 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:53:17.489228 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015465d7-3dfb-4964-878a-9673a2c79c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:53:17.489524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015465d7-3dfb-4964-878a-9673a2c79c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:53:17.491262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-015465d7-3dfb-4964-878a-9673a2c79c43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:53:17.501519 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015465d7-3dfb-4964-878a-9673a2c79c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:53:17.502952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015465d7-3dfb-4964-878a-9673a2c79c43 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:53:17.512465 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1402/2773] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:53:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:53:17.990472 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294c953-74a7-4c74-bb90-a54efe8a75be None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:53:17.991888 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c294c953-74a7-4c74-bb90-a54efe8a75be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:53:18.063821 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294c953-74a7-4c74-bb90-a54efe8a75be None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:53:18.069202 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bead9e-c876-46ba-9536-192071d39752 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adc8b93e5c41929b928002e004df6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:53:18.069881 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bead9e-c876-46ba-9536-192071d39752 service placement] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:53:18.070164 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bead9e-c876-46ba-9536-192071d39752 service placement] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:53:18.070440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bead9e-c876-46ba-9536-192071d39752 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:53:18.072253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b0bead9e-c876-46ba-9536-192071d39752 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:53:18.083727 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bead9e-c876-46ba-9536-192071d39752 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:53:18.085310 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bead9e-c876-46ba-9536-192071d39752 service placement] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:53:18.095461 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1372/2774] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:53:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:53:27.507710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=12 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:53:28.091126 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=35 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:53:33.286914 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015465d7-3dfb-4964-878a-9673a2c79c43 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:53:33.301257 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015465d7-3dfb-4964-878a-9673a2c79c43 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:53:33.307187 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ac118-f09b-4d99-8ee0-6c681a28d412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e1572d22c048b09699a2fe50900f92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:53:33.311617 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ac118-f09b-4d99-8ee0-6c681a28d412 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:53:33.311617 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ac118-f09b-4d99-8ee0-6c681a28d412 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:53:33.311617 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ac118-f09b-4d99-8ee0-6c681a28d412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:53:33.311617 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-427ac118-f09b-4d99-8ee0-6c681a28d412 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:53:33.323476 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ac118-f09b-4d99-8ee0-6c681a28d412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:53:33.325054 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ac118-f09b-4d99-8ee0-6c681a28d412 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:53:33.335839 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1403/2775] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:53:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:53:43.331186 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:53:43.374258 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bead9e-c876-46ba-9536-192071d39752 service placement] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:53:43.386096 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bead9e-c876-46ba-9536-192071d39752 service placement] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:53:43.391274 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea801c-2a06-41ec-a848-333cc54c8649 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adc8b93e5c41929b928002e004df6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:53:43.391915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea801c-2a06-41ec-a848-333cc54c8649 service placement] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:53:43.392222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea801c-2a06-41ec-a848-333cc54c8649 service placement] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:53:43.392523 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea801c-2a06-41ec-a848-333cc54c8649 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:53:43.394404 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-23ea801c-2a06-41ec-a848-333cc54c8649 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:53:43.407527 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea801c-2a06-41ec-a848-333cc54c8649 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:53:43.409137 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea801c-2a06-41ec-a848-333cc54c8649 service placement] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:53:43.420210 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1373/2776] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:53:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:53:53.415076 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=6 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:54:40.809913 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ac118-f09b-4d99-8ee0-6c681a28d412 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:54:40.812011 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-427ac118-f09b-4d99-8ee0-6c681a28d412 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:54:40.881927 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ac118-f09b-4d99-8ee0-6c681a28d412 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:54:40.888953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb00b5-bf3f-4819-852d-13dba7f7d56d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:54:40.890132 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb00b5-bf3f-4819-852d-13dba7f7d56d service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:54:40.890602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb00b5-bf3f-4819-852d-13dba7f7d56d service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:54:40.890958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb00b5-bf3f-4819-852d-13dba7f7d56d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:54:40.893204 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-14fb00b5-bf3f-4819-852d-13dba7f7d56d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:54:40.908303 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb00b5-bf3f-4819-852d-13dba7f7d56d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:54:40.910013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb00b5-bf3f-4819-852d-13dba7f7d56d service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:54:40.922641 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1404/2777] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:54:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:54:50.814063 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea801c-2a06-41ec-a848-333cc54c8649 service placement] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:54:50.816873 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-23ea801c-2a06-41ec-a848-333cc54c8649 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:54:50.828552 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea801c-2a06-41ec-a848-333cc54c8649 service placement] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:54:50.832478 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cb45d-4f49-4fae-b5bf-8759417514ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:54:50.833138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cb45d-4f49-4fae-b5bf-8759417514ab service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:54:50.833463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cb45d-4f49-4fae-b5bf-8759417514ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:54:50.833742 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cb45d-4f49-4fae-b5bf-8759417514ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:54:50.835921 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d15cb45d-4f49-4fae-b5bf-8759417514ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:54:50.851725 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cb45d-4f49-4fae-b5bf-8759417514ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:54:50.856934 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cb45d-4f49-4fae-b5bf-8759417514ab service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:54:50.866870 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1374/2778] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:54:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:54:50.916994 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=26 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:00.860230 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=6 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:05.363646 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb00b5-bf3f-4819-852d-13dba7f7d56d service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:05.374627 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb00b5-bf3f-4819-852d-13dba7f7d56d service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:05.378648 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea4ce7-34bb-46cf-8623-5f4bd5356363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:05.379556 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4ce7-34bb-46cf-8623-5f4bd5356363 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:05.380562 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4ce7-34bb-46cf-8623-5f4bd5356363 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:05.380950 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4ce7-34bb-46cf-8623-5f4bd5356363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:05.383255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-98ea4ce7-34bb-46cf-8623-5f4bd5356363 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:05.456441 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea4ce7-34bb-46cf-8623-5f4bd5356363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:05.465560 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea4ce7-34bb-46cf-8623-5f4bd5356363 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:05.469513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1405/2779] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:55:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:55:09.995433 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cb45d-4f49-4fae-b5bf-8759417514ab service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:09.997935 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d15cb45d-4f49-4fae-b5bf-8759417514ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:10.018337 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cb45d-4f49-4fae-b5bf-8759417514ab service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:10.024419 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9629a1-2491-41a7-b494-9534d76bf93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:10.025559 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9629a1-2491-41a7-b494-9534d76bf93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:10.025886 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9629a1-2491-41a7-b494-9534d76bf93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:10.026199 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9629a1-2491-41a7-b494-9534d76bf93b admin admin] PATH_INFO: `/v3/users/3af78d3ebe2548f280d84fff4d6cb644` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:10.027478 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9629a1-2491-41a7-b494-9534d76bf93b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3af78d3ebe2548f280d84fff4d6cb644)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:10.029961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9629a1-2491-41a7-b494-9534d76bf93b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:10.250885 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2b9629a1-2491-41a7-b494-9534d76bf93b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3af78d3ebe2548f280d84fff4d6cb644'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:10.263913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2b9629a1-2491-41a7-b494-9534d76bf93b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3af78d3ebe2548f280d84fff4d6cb644'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:10.264670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2b9629a1-2491-41a7-b494-9534d76bf93b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3af78d3ebe2548f280d84fff4d6cb644'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:10.265292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2b9629a1-2491-41a7-b494-9534d76bf93b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3af78d3ebe2548f280d84fff4d6cb644'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:10.272879 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2b9629a1-2491-41a7-b494-9534d76bf93b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3af78d3ebe2548f280d84fff4d6cb644'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:10.362238 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1375/2780] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:55:09 2022] DELETE /identity/v3/users/3af78d3ebe2548f280d84fff4d6cb644 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:10.627041 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea4ce7-34bb-46cf-8623-5f4bd5356363 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:10.649111 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea4ce7-34bb-46cf-8623-5f4bd5356363 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:10.735588 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55412428-6d92-4560-ae6c-8b7e38cd0748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:10.736673 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55412428-6d92-4560-ae6c-8b7e38cd0748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:10.737057 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55412428-6d92-4560-ae6c-8b7e38cd0748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:10.737498 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55412428-6d92-4560-ae6c-8b7e38cd0748 admin admin] PATH_INFO: `/v3/projects/2b6698fe4fa84871a3685aac8856970a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:10.739988 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55412428-6d92-4560-ae6c-8b7e38cd0748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b6698fe4fa84871a3685aac8856970a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:10.742206 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55412428-6d92-4560-ae6c-8b7e38cd0748 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:10.870947 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-55412428-6d92-4560-ae6c-8b7e38cd0748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b6698fe4fa84871a3685aac8856970a', 'request_id': 'req-55412428-6d92-4560-ae6c-8b7e38cd0748'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:10.947108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-55412428-6d92-4560-ae6c-8b7e38cd0748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b6698fe4fa84871a3685aac8856970a', 'request_id': 'req-55412428-6d92-4560-ae6c-8b7e38cd0748'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:10.959655 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-55412428-6d92-4560-ae6c-8b7e38cd0748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b6698fe4fa84871a3685aac8856970a', 'request_id': 'req-55412428-6d92-4560-ae6c-8b7e38cd0748'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:10.978996 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-55412428-6d92-4560-ae6c-8b7e38cd0748 admin admin] The token cache is being invalidate because project 2b6698fe4fa84871a3685aac8856970a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:55:10.979512 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-55412428-6d92-4560-ae6c-8b7e38cd0748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:10.980604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-55412428-6d92-4560-ae6c-8b7e38cd0748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:10.983206 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1406/2781] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:55:10 2022] DELETE /identity/v3/projects/2b6698fe4fa84871a3685aac8856970a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:55:10.989772 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4138e-6549-4e94-938c-7740bc32b65d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:10.990115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4138e-6549-4e94-938c-7740bc32b65d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:10.990464 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4138e-6549-4e94-938c-7740bc32b65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:11.011437 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-18c4138e-6549-4e94-938c-7740bc32b65d None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:11.012845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-18c4138e-6549-4e94-938c-7740bc32b65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:11.084540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1376/2782] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:11.099330 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68af4d9-c28b-4c18-9418-d713ab106e0e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:11.099788 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68af4d9-c28b-4c18-9418-d713ab106e0e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:11.100249 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68af4d9-c28b-4c18-9418-d713ab106e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:11.131629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c68af4d9-c28b-4c18-9418-d713ab106e0e None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:11.133708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c68af4d9-c28b-4c18-9418-d713ab106e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:11.146105 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1407/2783] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:11.150666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4138e-6549-4e94-938c-7740bc32b65d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:11.161773 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4138e-6549-4e94-938c-7740bc32b65d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:11.166859 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030863f1-0c20-4f6d-9811-a4da5ba0196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:11.167656 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030863f1-0c20-4f6d-9811-a4da5ba0196f admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:11.167997 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030863f1-0c20-4f6d-9811-a4da5ba0196f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:11.168330 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030863f1-0c20-4f6d-9811-a4da5ba0196f admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:11.169125 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030863f1-0c20-4f6d-9811-a4da5ba0196f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:55:11.169552 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030863f1-0c20-4f6d-9811-a4da5ba0196f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:11.171321 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030863f1-0c20-4f6d-9811-a4da5ba0196f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:11.185443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1377/2784] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:55:11.190188 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68af4d9-c28b-4c18-9418-d713ab106e0e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:11.201290 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68af4d9-c28b-4c18-9418-d713ab106e0e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:11.206513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424c3bd-e299-4e48-a499-d2433443811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:11.207235 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424c3bd-e299-4e48-a499-d2433443811c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:11.207645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424c3bd-e299-4e48-a499-d2433443811c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:11.208462 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424c3bd-e299-4e48-a499-d2433443811c admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:11.209378 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424c3bd-e299-4e48-a499-d2433443811c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:11.211501 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424c3bd-e299-4e48-a499-d2433443811c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:11.227911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:11.327723 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1408/2785] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:55:11 2022] POST /identity/v3/projects => generated 405 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:55:11.332724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030863f1-0c20-4f6d-9811-a4da5ba0196f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:11.343737 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030863f1-0c20-4f6d-9811-a4da5ba0196f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:11.416101 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a523e-73bf-4e2b-9e91-c78bf93cd47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:11.416961 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a523e-73bf-4e2b-9e91-c78bf93cd47f admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:11.417281 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a523e-73bf-4e2b-9e91-c78bf93cd47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:11.417634 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a523e-73bf-4e2b-9e91-c78bf93cd47f admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:11.418454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a523e-73bf-4e2b-9e91-c78bf93cd47f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:11.420468 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a523e-73bf-4e2b-9e91-c78bf93cd47f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:11.428454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:11.550636 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1378/2786] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:55:11 2022] POST /identity/v3/users => generated 303 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:55:11.557647 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424c3bd-e299-4e48-a499-d2433443811c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:11.570847 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424c3bd-e299-4e48-a499-d2433443811c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:11.576014 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d4bb0-f588-4e05-8fee-c5f988d85d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:11.576722 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d4bb0-f588-4e05-8fee-c5f988d85d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:11.576997 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d4bb0-f588-4e05-8fee-c5f988d85d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:11.577275 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d4bb0-f588-4e05-8fee-c5f988d85d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:11.578069 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d4bb0-f588-4e05-8fee-c5f988d85d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:11.579774 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d4bb0-f588-4e05-8fee-c5f988d85d27 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:11.591875 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1409/2787] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:55:11.596298 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a523e-73bf-4e2b-9e91-c78bf93cd47f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:11.607276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a523e-73bf-4e2b-9e91-c78bf93cd47f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:11.613270 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31b89e-b7eb-437f-8f04-d28d5e005896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:11.617809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31b89e-b7eb-437f-8f04-d28d5e005896 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:11.617809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31b89e-b7eb-437f-8f04-d28d5e005896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:11.617809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31b89e-b7eb-437f-8f04-d28d5e005896 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:11.617809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31b89e-b7eb-437f-8f04-d28d5e005896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:11.618443 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31b89e-b7eb-437f-8f04-d28d5e005896 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:11.633024 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1379/2788] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:55:11.637699 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d4bb0-f588-4e05-8fee-c5f988d85d27 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:11.649293 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d4bb0-f588-4e05-8fee-c5f988d85d27 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:11.654741 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba8996-2b3a-424c-9ddc-66ec42da3c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:11.655658 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba8996-2b3a-424c-9ddc-66ec42da3c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:11.655937 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba8996-2b3a-424c-9ddc-66ec42da3c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:11.656214 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba8996-2b3a-424c-9ddc-66ec42da3c71 admin admin] PATH_INFO: `/v3/projects/bb0915cef6e24de0a6da25e07c90b6fa/users/b3a27115aed44c7a8035b85252e6ec1a/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:11.674688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba8996-2b3a-424c-9ddc-66ec42da3c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0915cef6e24de0a6da25e07c90b6fa, user_id=b3a27115aed44c7a8035b85252e6ec1a, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:11.678915 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba8996-2b3a-424c-9ddc-66ec42da3c71 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:11.759120 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1410/2789] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:55:11 2022] PUT /identity/v3/projects/bb0915cef6e24de0a6da25e07c90b6fa/users/b3a27115aed44c7a8035b85252e6ec1a/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:11.771513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c341eb9-3e2d-47a0-baaa-46ba47b4ace2 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:11.771866 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c341eb9-3e2d-47a0-baaa-46ba47b4ace2 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:11.772127 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c341eb9-3e2d-47a0-baaa-46ba47b4ace2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:11.805177 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0c341eb9-3e2d-47a0-baaa-46ba47b4ace2 None None] MFA Rules not processed for user `b3a27115aed44c7a8035b85252e6ec1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:11.806549 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0c341eb9-3e2d-47a0-baaa-46ba47b4ace2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:11.899857 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1380/2790] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:11 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:11.904791 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba8996-2b3a-424c-9ddc-66ec42da3c71 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:11.988088 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba8996-2b3a-424c-9ddc-66ec42da3c71 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:11.994102 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a92aa-a05e-4fb8-ab08-a0a1e452d10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:11.994790 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a92aa-a05e-4fb8-ab08-a0a1e452d10f admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:11.995076 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a92aa-a05e-4fb8-ab08-a0a1e452d10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:11.995354 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a92aa-a05e-4fb8-ab08-a0a1e452d10f admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:11.996269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a92aa-a05e-4fb8-ab08-a0a1e452d10f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:11.999269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a92aa-a05e-4fb8-ab08-a0a1e452d10f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:12.098103 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1411/2791] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:55:11 2022] POST /identity/v3/projects => generated 409 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:55:12.103383 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c341eb9-3e2d-47a0-baaa-46ba47b4ace2 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:12.116478 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c341eb9-3e2d-47a0-baaa-46ba47b4ace2 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:12.201863 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227bd0f-a8c6-43b4-aeda-43dbc0197a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:12.202617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227bd0f-a8c6-43b4-aeda-43dbc0197a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:12.203062 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227bd0f-a8c6-43b4-aeda-43dbc0197a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:12.203465 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227bd0f-a8c6-43b4-aeda-43dbc0197a03 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:12.204297 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227bd0f-a8c6-43b4-aeda-43dbc0197a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:12.206452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227bd0f-a8c6-43b4-aeda-43dbc0197a03 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:12.308255 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1381/2792] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:55:12 2022] POST /identity/v3/users => generated 311 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:55:12.312964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a92aa-a05e-4fb8-ab08-a0a1e452d10f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:12.325431 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a92aa-a05e-4fb8-ab08-a0a1e452d10f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:12.330091 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0be2-2545-49ee-b5a3-2ee6cf32a010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:12.330772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0be2-2545-49ee-b5a3-2ee6cf32a010 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:12.331127 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0be2-2545-49ee-b5a3-2ee6cf32a010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:12.331380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0be2-2545-49ee-b5a3-2ee6cf32a010 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:12.332104 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed0be2-2545-49ee-b5a3-2ee6cf32a010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:12.333958 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed0be2-2545-49ee-b5a3-2ee6cf32a010 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:12.346191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1412/2793] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:55:12.351429 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227bd0f-a8c6-43b4-aeda-43dbc0197a03 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:12.369458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227bd0f-a8c6-43b4-aeda-43dbc0197a03 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:12.377040 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055778b-3fcd-4c1f-b044-627c898a44a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:12.378647 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055778b-3fcd-4c1f-b044-627c898a44a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:12.379146 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055778b-3fcd-4c1f-b044-627c898a44a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:12.381371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055778b-3fcd-4c1f-b044-627c898a44a4 admin admin] PATH_INFO: `/v3/projects/060e3920b1874d9ab9edea290eff46c9/users/e75d231e616e4c17913507ac149202f8/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:12.399463 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055778b-3fcd-4c1f-b044-627c898a44a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=060e3920b1874d9ab9edea290eff46c9, user_id=e75d231e616e4c17913507ac149202f8, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:12.402203 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055778b-3fcd-4c1f-b044-627c898a44a4 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:12.474783 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1382/2794] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:55:12 2022] PUT /identity/v3/projects/060e3920b1874d9ab9edea290eff46c9/users/e75d231e616e4c17913507ac149202f8/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:12.479240 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0be2-2545-49ee-b5a3-2ee6cf32a010 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:12.491603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0be2-2545-49ee-b5a3-2ee6cf32a010 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:12.561837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713433af-a07e-4943-96a7-178acf288c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:12.562554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713433af-a07e-4943-96a7-178acf288c62 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:12.562831 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713433af-a07e-4943-96a7-178acf288c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:12.563108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713433af-a07e-4943-96a7-178acf288c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:12.563858 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713433af-a07e-4943-96a7-178acf288c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:12.565565 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713433af-a07e-4943-96a7-178acf288c62 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:12.578157 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1413/2795] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:55:12.583614 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055778b-3fcd-4c1f-b044-627c898a44a4 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:12.595456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055778b-3fcd-4c1f-b044-627c898a44a4 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:12.601377 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e22588-2ace-4f4f-a91c-3d71d3f497fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:12.602293 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e22588-2ace-4f4f-a91c-3d71d3f497fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:12.602574 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e22588-2ace-4f4f-a91c-3d71d3f497fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:12.602853 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e22588-2ace-4f4f-a91c-3d71d3f497fc admin admin] PATH_INFO: `/v3/projects/060e3920b1874d9ab9edea290eff46c9/users/e75d231e616e4c17913507ac149202f8/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:12.604976 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e22588-2ace-4f4f-a91c-3d71d3f497fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=060e3920b1874d9ab9edea290eff46c9, user_id=e75d231e616e4c17913507ac149202f8, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:12.608106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e22588-2ace-4f4f-a91c-3d71d3f497fc admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:12.621205 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1383/2796] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:55:12 2022] PUT /identity/v3/projects/060e3920b1874d9ab9edea290eff46c9/users/e75d231e616e4c17913507ac149202f8/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:12.638505 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cadb0-989c-41c1-a405-4cd59db4d8f3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:12.639178 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cadb0-989c-41c1-a405-4cd59db4d8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:12.639178 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cadb0-989c-41c1-a405-4cd59db4d8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:12.685576 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-600cadb0-989c-41c1-a405-4cd59db4d8f3 None None] MFA Rules not processed for user `e75d231e616e4c17913507ac149202f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:12.687690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-600cadb0-989c-41c1-a405-4cd59db4d8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:12.702795 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:12.778173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1414/2797] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:12 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:12.790631 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e22588-2ace-4f4f-a91c-3d71d3f497fc admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:12.795848 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-30e22588-2ace-4f4f-a91c-3d71d3f497fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:12.818554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:12.862373 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e22588-2ace-4f4f-a91c-3d71d3f497fc admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:12.869040 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe3019-86f5-427d-b258-e37282ca7803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:12.870119 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe3019-86f5-427d-b258-e37282ca7803 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:12.870556 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe3019-86f5-427d-b258-e37282ca7803 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:12.871020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe3019-86f5-427d-b258-e37282ca7803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:12.888973 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe3019-86f5-427d-b258-e37282ca7803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:12.891692 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe3019-86f5-427d-b258-e37282ca7803 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:12.910289 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1384/2798] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:55:12 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:55:13.278338 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cadb0-989c-41c1-a405-4cd59db4d8f3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:13.289713 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cadb0-989c-41c1-a405-4cd59db4d8f3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:13.293602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498ed06-1dab-4055-8e8d-f1c11ebd1b8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:13.294275 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498ed06-1dab-4055-8e8d-f1c11ebd1b8a service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:13.294554 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498ed06-1dab-4055-8e8d-f1c11ebd1b8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:13.294828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498ed06-1dab-4055-8e8d-f1c11ebd1b8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:13.376705 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498ed06-1dab-4055-8e8d-f1c11ebd1b8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:13.378205 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498ed06-1dab-4055-8e8d-f1c11ebd1b8a service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:13.388629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1415/2799] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:55:13 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:55:23.333012 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=17 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:23.383669 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=52 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:24.828977 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe3019-86f5-427d-b258-e37282ca7803 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:24.904555 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe3019-86f5-427d-b258-e37282ca7803 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:24.909628 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9347ec4-5768-4b22-8624-5b6554d2be2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:24.911380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9347ec4-5768-4b22-8624-5b6554d2be2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:24.911705 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9347ec4-5768-4b22-8624-5b6554d2be2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:24.912021 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9347ec4-5768-4b22-8624-5b6554d2be2c admin admin] PATH_INFO: `/v3/users/b3a27115aed44c7a8035b85252e6ec1a` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:24.913572 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9347ec4-5768-4b22-8624-5b6554d2be2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3a27115aed44c7a8035b85252e6ec1a)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:24.915693 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9347ec4-5768-4b22-8624-5b6554d2be2c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:25.118550 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c9347ec4-5768-4b22-8624-5b6554d2be2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3a27115aed44c7a8035b85252e6ec1a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:25.132411 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c9347ec4-5768-4b22-8624-5b6554d2be2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3a27115aed44c7a8035b85252e6ec1a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:25.133226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c9347ec4-5768-4b22-8624-5b6554d2be2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3a27115aed44c7a8035b85252e6ec1a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:25.133940 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c9347ec4-5768-4b22-8624-5b6554d2be2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3a27115aed44c7a8035b85252e6ec1a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:25.143898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c9347ec4-5768-4b22-8624-5b6554d2be2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3a27115aed44c7a8035b85252e6ec1a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:25.232234 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1385/2800] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:55:24 2022] DELETE /identity/v3/users/b3a27115aed44c7a8035b85252e6ec1a => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:25.237139 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff5c2c-95fa-4f9e-990a-3536a2faa234 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:25.237706 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff5c2c-95fa-4f9e-990a-3536a2faa234 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:25.237889 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff5c2c-95fa-4f9e-990a-3536a2faa234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:25.256365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-06ff5c2c-95fa-4f9e-990a-3536a2faa234 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:25.257605 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-06ff5c2c-95fa-4f9e-990a-3536a2faa234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:25.319342 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1416/2801] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:25.329212 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9347ec4-5768-4b22-8624-5b6554d2be2c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:25.330670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c9347ec4-5768-4b22-8624-5b6554d2be2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:25.396217 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9347ec4-5768-4b22-8624-5b6554d2be2c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:25.399883 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd47ce5-d255-4e55-9cb4-a12bf785611e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:25.400563 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd47ce5-d255-4e55-9cb4-a12bf785611e service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:25.400847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd47ce5-d255-4e55-9cb4-a12bf785611e service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:25.401118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd47ce5-d255-4e55-9cb4-a12bf785611e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:25.412051 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd47ce5-d255-4e55-9cb4-a12bf785611e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:25.413643 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd47ce5-d255-4e55-9cb4-a12bf785611e service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:25.424226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1386/2802] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:55:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:55:25.959456 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff5c2c-95fa-4f9e-990a-3536a2faa234 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:25.961510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-06ff5c2c-95fa-4f9e-990a-3536a2faa234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:25.981011 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff5c2c-95fa-4f9e-990a-3536a2faa234 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:25.989190 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84230cd7-ee21-4933-9d7b-06a2fb86baa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:25.990186 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84230cd7-ee21-4933-9d7b-06a2fb86baa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:25.990575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84230cd7-ee21-4933-9d7b-06a2fb86baa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:25.990752 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84230cd7-ee21-4933-9d7b-06a2fb86baa2 admin admin] PATH_INFO: `/v3/projects/bb0915cef6e24de0a6da25e07c90b6fa` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:25.991984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84230cd7-ee21-4933-9d7b-06a2fb86baa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb0915cef6e24de0a6da25e07c90b6fa)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:25.994029 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84230cd7-ee21-4933-9d7b-06a2fb86baa2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:26.105475 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-84230cd7-ee21-4933-9d7b-06a2fb86baa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb0915cef6e24de0a6da25e07c90b6fa', 'request_id': 'req-84230cd7-ee21-4933-9d7b-06a2fb86baa2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:26.191650 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-84230cd7-ee21-4933-9d7b-06a2fb86baa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb0915cef6e24de0a6da25e07c90b6fa', 'request_id': 'req-84230cd7-ee21-4933-9d7b-06a2fb86baa2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:26.199209 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-84230cd7-ee21-4933-9d7b-06a2fb86baa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb0915cef6e24de0a6da25e07c90b6fa', 'request_id': 'req-84230cd7-ee21-4933-9d7b-06a2fb86baa2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:26.212604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-84230cd7-ee21-4933-9d7b-06a2fb86baa2 admin admin] The token cache is being invalidate because project bb0915cef6e24de0a6da25e07c90b6fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:55:26.212852 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-84230cd7-ee21-4933-9d7b-06a2fb86baa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:26.213525 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-84230cd7-ee21-4933-9d7b-06a2fb86baa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:26.215146 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1417/2803] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:55:25 2022] DELETE /identity/v3/projects/bb0915cef6e24de0a6da25e07c90b6fa => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:26.219698 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd47ce5-d255-4e55-9cb4-a12bf785611e service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:26.231952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd47ce5-d255-4e55-9cb4-a12bf785611e service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:26.254391 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:26.303041 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a932b7-9dd8-4653-a66d-38e2434695bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:26.304208 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a932b7-9dd8-4653-a66d-38e2434695bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:26.304569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a932b7-9dd8-4653-a66d-38e2434695bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:26.305358 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a932b7-9dd8-4653-a66d-38e2434695bb admin admin] PATH_INFO: `/v3/users/e75d231e616e4c17913507ac149202f8` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:26.306735 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a932b7-9dd8-4653-a66d-38e2434695bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e75d231e616e4c17913507ac149202f8)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:26.308771 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a932b7-9dd8-4653-a66d-38e2434695bb admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:26.526929 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-57a932b7-9dd8-4653-a66d-38e2434695bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e75d231e616e4c17913507ac149202f8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:26.543048 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-57a932b7-9dd8-4653-a66d-38e2434695bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e75d231e616e4c17913507ac149202f8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:26.543779 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-57a932b7-9dd8-4653-a66d-38e2434695bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e75d231e616e4c17913507ac149202f8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:26.544458 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-57a932b7-9dd8-4653-a66d-38e2434695bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e75d231e616e4c17913507ac149202f8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:26.553552 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-57a932b7-9dd8-4653-a66d-38e2434695bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e75d231e616e4c17913507ac149202f8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:26.655012 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1387/2804] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:55:26 2022] DELETE /identity/v3/users/e75d231e616e4c17913507ac149202f8 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:55:27.091491 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84230cd7-ee21-4933-9d7b-06a2fb86baa2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:27.093403 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-84230cd7-ee21-4933-9d7b-06a2fb86baa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:27.113409 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84230cd7-ee21-4933-9d7b-06a2fb86baa2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:27.185370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3773de-d847-49ba-bf31-ec124f9cdb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:27.186471 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3773de-d847-49ba-bf31-ec124f9cdb51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:27.186905 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3773de-d847-49ba-bf31-ec124f9cdb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:27.187282 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3773de-d847-49ba-bf31-ec124f9cdb51 admin admin] PATH_INFO: `/v3/projects/060e3920b1874d9ab9edea290eff46c9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:27.188785 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3773de-d847-49ba-bf31-ec124f9cdb51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=060e3920b1874d9ab9edea290eff46c9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:27.190867 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3773de-d847-49ba-bf31-ec124f9cdb51 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:27.284286 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:27.302895 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cf3773de-d847-49ba-bf31-ec124f9cdb51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060e3920b1874d9ab9edea290eff46c9', 'request_id': 'req-cf3773de-d847-49ba-bf31-ec124f9cdb51'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:27.381127 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cf3773de-d847-49ba-bf31-ec124f9cdb51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060e3920b1874d9ab9edea290eff46c9', 'request_id': 'req-cf3773de-d847-49ba-bf31-ec124f9cdb51'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:27.393566 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cf3773de-d847-49ba-bf31-ec124f9cdb51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060e3920b1874d9ab9edea290eff46c9', 'request_id': 'req-cf3773de-d847-49ba-bf31-ec124f9cdb51'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:27.406238 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cf3773de-d847-49ba-bf31-ec124f9cdb51 admin admin] The token cache is being invalidate because project 060e3920b1874d9ab9edea290eff46c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:55:27.406529 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cf3773de-d847-49ba-bf31-ec124f9cdb51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:27.407306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cf3773de-d847-49ba-bf31-ec124f9cdb51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:27.408913 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1418/2805] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:55:27 2022] DELETE /identity/v3/projects/060e3920b1874d9ab9edea290eff46c9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:55:27.414397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d411b7b-8aaf-4a1d-b076-6af293672237 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:27.414999 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d411b7b-8aaf-4a1d-b076-6af293672237 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:27.414999 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d411b7b-8aaf-4a1d-b076-6af293672237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:27.435792 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-2d411b7b-8aaf-4a1d-b076-6af293672237 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:27.437048 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2d411b7b-8aaf-4a1d-b076-6af293672237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:27.504185 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1388/2806] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:55:27.513631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a84a6-0ba6-48fd-a353-f04038341e24 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:27.514187 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a84a6-0ba6-48fd-a353-f04038341e24 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:27.514618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a84a6-0ba6-48fd-a353-f04038341e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:27.546812 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-108a84a6-0ba6-48fd-a353-f04038341e24 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:27.548893 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-108a84a6-0ba6-48fd-a353-f04038341e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:27.563439 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1419/2807] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:27.568254 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d411b7b-8aaf-4a1d-b076-6af293672237 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:27.578501 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d411b7b-8aaf-4a1d-b076-6af293672237 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:27.584253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bcc9a-3384-47c6-96a1-a7b9ca2b6b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:27.584930 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bcc9a-3384-47c6-96a1-a7b9ca2b6b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:27.585209 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bcc9a-3384-47c6-96a1-a7b9ca2b6b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:27.585514 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bcc9a-3384-47c6-96a1-a7b9ca2b6b21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:27.586242 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bcc9a-3384-47c6-96a1-a7b9ca2b6b21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:55:27.586542 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bcc9a-3384-47c6-96a1-a7b9ca2b6b21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:27.588156 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bcc9a-3384-47c6-96a1-a7b9ca2b6b21 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:27.601087 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1389/2808] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:55:27.605810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a84a6-0ba6-48fd-a353-f04038341e24 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:27.616793 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a84a6-0ba6-48fd-a353-f04038341e24 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:27.621555 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd52a7-eb9f-4afb-8023-279ca0b8c7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:27.622227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd52a7-eb9f-4afb-8023-279ca0b8c7ad admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:27.622506 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd52a7-eb9f-4afb-8023-279ca0b8c7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:27.622779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd52a7-eb9f-4afb-8023-279ca0b8c7ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:27.623492 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd52a7-eb9f-4afb-8023-279ca0b8c7ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:27.625443 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd52a7-eb9f-4afb-8023-279ca0b8c7ad admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:27.719335 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1420/2809] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:55:27 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:55:27.724670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bcc9a-3384-47c6-96a1-a7b9ca2b6b21 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:27.735509 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bcc9a-3384-47c6-96a1-a7b9ca2b6b21 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:27.767631 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:27.802594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8509e-f036-48d1-9a29-1dbe177cfd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:27.803347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8509e-f036-48d1-9a29-1dbe177cfd8b admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:27.803767 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8509e-f036-48d1-9a29-1dbe177cfd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:27.804032 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8509e-f036-48d1-9a29-1dbe177cfd8b admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:27.804805 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8509e-f036-48d1-9a29-1dbe177cfd8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:27.807447 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8509e-f036-48d1-9a29-1dbe177cfd8b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:27.906577 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1390/2810] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:55:27 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:55:27.911259 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd52a7-eb9f-4afb-8023-279ca0b8c7ad admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:27.922592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd52a7-eb9f-4afb-8023-279ca0b8c7ad admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:27.928589 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc9342-c578-4707-aed6-0f742b38a2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:27.929307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc9342-c578-4707-aed6-0f742b38a2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:27.929686 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc9342-c578-4707-aed6-0f742b38a2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:27.930026 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc9342-c578-4707-aed6-0f742b38a2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:27.930922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc9342-c578-4707-aed6-0f742b38a2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:27.932715 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc9342-c578-4707-aed6-0f742b38a2b9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:27.946795 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1421/2811] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:55:27.953410 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8509e-f036-48d1-9a29-1dbe177cfd8b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:27.971867 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8509e-f036-48d1-9a29-1dbe177cfd8b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:27.989490 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cef012-e3db-4bcd-8b33-53452b952ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:27.990324 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cef012-e3db-4bcd-8b33-53452b952ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:27.990712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cef012-e3db-4bcd-8b33-53452b952ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:27.991091 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cef012-e3db-4bcd-8b33-53452b952ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:27.991963 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cef012-e3db-4bcd-8b33-53452b952ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:27.993736 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cef012-e3db-4bcd-8b33-53452b952ad9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:28.005435 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1391/2812] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:55:28.010070 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc9342-c578-4707-aed6-0f742b38a2b9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:28.021439 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc9342-c578-4707-aed6-0f742b38a2b9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:28.026654 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5729d2-fb5c-4075-af97-27685ef9df29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:28.027664 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5729d2-fb5c-4075-af97-27685ef9df29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:28.028038 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5729d2-fb5c-4075-af97-27685ef9df29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:28.028416 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5729d2-fb5c-4075-af97-27685ef9df29 admin admin] PATH_INFO: `/v3/projects/5c82f5022379468382c7a6f791a0723a/users/c84d1b591b314b079514c42df4aab8c7/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:28.045767 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5729d2-fb5c-4075-af97-27685ef9df29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c82f5022379468382c7a6f791a0723a, user_id=c84d1b591b314b079514c42df4aab8c7, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:28.048559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5729d2-fb5c-4075-af97-27685ef9df29 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:28.121721 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1422/2813] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:55:28 2022] PUT /identity/v3/projects/5c82f5022379468382c7a6f791a0723a/users/c84d1b591b314b079514c42df4aab8c7/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:55:28.132892 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddde66c-1405-4249-83a5-01ed362833ca None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:28.133239 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddde66c-1405-4249-83a5-01ed362833ca None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:28.133591 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddde66c-1405-4249-83a5-01ed362833ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:28.164054 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-9ddde66c-1405-4249-83a5-01ed362833ca None None] MFA Rules not processed for user `c84d1b591b314b079514c42df4aab8c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:28.165501 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9ddde66c-1405-4249-83a5-01ed362833ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:28.257264 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1392/2814] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:28.264276 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5729d2-fb5c-4075-af97-27685ef9df29 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:28.369712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5729d2-fb5c-4075-af97-27685ef9df29 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:28.375385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0440f69-6b8e-47a3-8192-b5056c53e292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:28.376212 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440f69-6b8e-47a3-8192-b5056c53e292 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:28.376592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440f69-6b8e-47a3-8192-b5056c53e292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:28.376920 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440f69-6b8e-47a3-8192-b5056c53e292 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:28.377772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0440f69-6b8e-47a3-8192-b5056c53e292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:28.380600 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0440f69-6b8e-47a3-8192-b5056c53e292 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:28.480156 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1423/2815] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:55:28 2022] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:55:28.486568 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddde66c-1405-4249-83a5-01ed362833ca None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:28.505663 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddde66c-1405-4249-83a5-01ed362833ca None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:28.586926 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5ff34-d1a1-4cc3-b017-02b45024acf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:28.587752 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5ff34-d1a1-4cc3-b017-02b45024acf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:28.588129 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5ff34-d1a1-4cc3-b017-02b45024acf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:28.588518 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5ff34-d1a1-4cc3-b017-02b45024acf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:28.589347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5ff34-d1a1-4cc3-b017-02b45024acf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:28.591491 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5ff34-d1a1-4cc3-b017-02b45024acf1 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:28.695968 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1393/2816] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:55:28 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:55:28.700087 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0440f69-6b8e-47a3-8192-b5056c53e292 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:28.712086 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0440f69-6b8e-47a3-8192-b5056c53e292 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:28.717311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d10445-9fd1-4d3e-9ea5-a6dc208e56fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:28.718145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d10445-9fd1-4d3e-9ea5-a6dc208e56fb admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:28.718501 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d10445-9fd1-4d3e-9ea5-a6dc208e56fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:28.718827 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d10445-9fd1-4d3e-9ea5-a6dc208e56fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:28.719607 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d10445-9fd1-4d3e-9ea5-a6dc208e56fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:28.721430 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d10445-9fd1-4d3e-9ea5-a6dc208e56fb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:28.733605 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1424/2817] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:55:28.739106 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5ff34-d1a1-4cc3-b017-02b45024acf1 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:28.749624 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5ff34-d1a1-4cc3-b017-02b45024acf1 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:28.755371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808e783-86f7-486e-bece-9ce417b6bffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:28.756277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808e783-86f7-486e-bece-9ce417b6bffa admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:28.756562 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808e783-86f7-486e-bece-9ce417b6bffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:28.756840 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808e783-86f7-486e-bece-9ce417b6bffa admin admin] PATH_INFO: `/v3/projects/aa8e16e132664002a3dd9e910f5cecdf/users/242f7b8fa8c04c3cb612f1cb4c3b7179/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:28.773440 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808e783-86f7-486e-bece-9ce417b6bffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8e16e132664002a3dd9e910f5cecdf, user_id=242f7b8fa8c04c3cb612f1cb4c3b7179, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:28.776125 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808e783-86f7-486e-bece-9ce417b6bffa admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:28.859020 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1394/2818] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:55:28 2022] PUT /identity/v3/projects/aa8e16e132664002a3dd9e910f5cecdf/users/242f7b8fa8c04c3cb612f1cb4c3b7179/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:28.863902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d10445-9fd1-4d3e-9ea5-a6dc208e56fb admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:28.874982 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d10445-9fd1-4d3e-9ea5-a6dc208e56fb admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:28.898548 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:28.940380 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4fa36-aead-4977-bd80-4c846d6d24c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:28.942577 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4fa36-aead-4977-bd80-4c846d6d24c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:28.946479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4fa36-aead-4977-bd80-4c846d6d24c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:28.946479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4fa36-aead-4977-bd80-4c846d6d24c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:28.946479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4fa36-aead-4977-bd80-4c846d6d24c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:28.946479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4fa36-aead-4977-bd80-4c846d6d24c9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:28.959677 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1425/2819] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:55:28.964828 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808e783-86f7-486e-bece-9ce417b6bffa admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:28.971373 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:28.979018 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808e783-86f7-486e-bece-9ce417b6bffa admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:28.984768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b057a6-1f51-4f6f-ad5a-63ac33ed58c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:28.985878 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b057a6-1f51-4f6f-ad5a-63ac33ed58c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:28.986232 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b057a6-1f51-4f6f-ad5a-63ac33ed58c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:28.986552 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b057a6-1f51-4f6f-ad5a-63ac33ed58c6 admin admin] PATH_INFO: `/v3/projects/aa8e16e132664002a3dd9e910f5cecdf/users/242f7b8fa8c04c3cb612f1cb4c3b7179/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:28.989095 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b057a6-1f51-4f6f-ad5a-63ac33ed58c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8e16e132664002a3dd9e910f5cecdf, user_id=242f7b8fa8c04c3cb612f1cb4c3b7179, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:28.991976 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b057a6-1f51-4f6f-ad5a-63ac33ed58c6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:29.004430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1395/2820] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:55:28 2022] PUT /identity/v3/projects/aa8e16e132664002a3dd9e910f5cecdf/users/242f7b8fa8c04c3cb612f1cb4c3b7179/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:29.016662 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668a41c-ec95-4fb1-b03c-15df89215158 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:29.017004 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668a41c-ec95-4fb1-b03c-15df89215158 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:29.017349 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668a41c-ec95-4fb1-b03c-15df89215158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:29.048610 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b668a41c-ec95-4fb1-b03c-15df89215158 None None] MFA Rules not processed for user `242f7b8fa8c04c3cb612f1cb4c3b7179`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:29.049989 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b668a41c-ec95-4fb1-b03c-15df89215158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:29.124690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1426/2821] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:29.136636 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b057a6-1f51-4f6f-ad5a-63ac33ed58c6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:29.138702 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f2b057a6-1f51-4f6f-ad5a-63ac33ed58c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:29.202341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b057a6-1f51-4f6f-ad5a-63ac33ed58c6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:29.206229 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ea189-2444-4f48-96a3-a94653fb202c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:29.207565 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ea189-2444-4f48-96a3-a94653fb202c service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:29.207847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ea189-2444-4f48-96a3-a94653fb202c service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:29.208130 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ea189-2444-4f48-96a3-a94653fb202c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:29.218808 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ea189-2444-4f48-96a3-a94653fb202c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:29.220316 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ea189-2444-4f48-96a3-a94653fb202c service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:29.231936 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1396/2822] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:55:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:55:29.829023 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668a41c-ec95-4fb1-b03c-15df89215158 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:29.911777 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668a41c-ec95-4fb1-b03c-15df89215158 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:29.916754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c9236-1cbf-421b-b1fe-29311f612e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:29.917688 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c9236-1cbf-421b-b1fe-29311f612e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:29.917974 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c9236-1cbf-421b-b1fe-29311f612e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:29.918258 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c9236-1cbf-421b-b1fe-29311f612e1f admin admin] PATH_INFO: `/v3/users/c84d1b591b314b079514c42df4aab8c7` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:29.919604 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c9236-1cbf-421b-b1fe-29311f612e1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84d1b591b314b079514c42df4aab8c7)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:29.921627 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c9236-1cbf-421b-b1fe-29311f612e1f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:30.119864 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-498c9236-1cbf-421b-b1fe-29311f612e1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84d1b591b314b079514c42df4aab8c7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:30.121152 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:30.135033 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-498c9236-1cbf-421b-b1fe-29311f612e1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84d1b591b314b079514c42df4aab8c7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:30.143080 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-498c9236-1cbf-421b-b1fe-29311f612e1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84d1b591b314b079514c42df4aab8c7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:30.144444 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-498c9236-1cbf-421b-b1fe-29311f612e1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84d1b591b314b079514c42df4aab8c7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:30.145870 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-498c9236-1cbf-421b-b1fe-29311f612e1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84d1b591b314b079514c42df4aab8c7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:30.231982 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1427/2823] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:55:29 2022] DELETE /identity/v3/users/c84d1b591b314b079514c42df4aab8c7 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:30.237473 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f740-cc84-4003-80a2-f363c61b54b7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:30.238217 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f740-cc84-4003-80a2-f363c61b54b7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:30.238217 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f740-cc84-4003-80a2-f363c61b54b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:30.258420 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-ca66f740-cc84-4003-80a2-f363c61b54b7 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:30.259670 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ca66f740-cc84-4003-80a2-f363c61b54b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:30.337523 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1397/2824] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:55:30.348351 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c9236-1cbf-421b-b1fe-29311f612e1f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:30.350271 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-498c9236-1cbf-421b-b1fe-29311f612e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:30.443390 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c9236-1cbf-421b-b1fe-29311f612e1f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:30.449720 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f8c79-ca99-461c-8962-64fbc291d457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:30.450748 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f8c79-ca99-461c-8962-64fbc291d457 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:30.451218 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f8c79-ca99-461c-8962-64fbc291d457 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:30.451987 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f8c79-ca99-461c-8962-64fbc291d457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:30.467379 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f8c79-ca99-461c-8962-64fbc291d457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:30.469180 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f8c79-ca99-461c-8962-64fbc291d457 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:30.485273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1428/2825] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:55:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:55:30.959138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66f740-cc84-4003-80a2-f363c61b54b7 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:30.961914 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ca66f740-cc84-4003-80a2-f363c61b54b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:30.984405 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66f740-cc84-4003-80a2-f363c61b54b7 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:30.993452 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37052d8-03c9-4be2-b4c0-9bd385a3518b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:30.994934 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37052d8-03c9-4be2-b4c0-9bd385a3518b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:30.995445 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37052d8-03c9-4be2-b4c0-9bd385a3518b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:30.995958 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37052d8-03c9-4be2-b4c0-9bd385a3518b admin admin] PATH_INFO: `/v3/projects/5c82f5022379468382c7a6f791a0723a` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:30.998246 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37052d8-03c9-4be2-b4c0-9bd385a3518b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c82f5022379468382c7a6f791a0723a)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:31.002131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37052d8-03c9-4be2-b4c0-9bd385a3518b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:31.137938 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b37052d8-03c9-4be2-b4c0-9bd385a3518b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c82f5022379468382c7a6f791a0723a', 'request_id': 'req-b37052d8-03c9-4be2-b4c0-9bd385a3518b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:31.145057 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b37052d8-03c9-4be2-b4c0-9bd385a3518b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c82f5022379468382c7a6f791a0723a', 'request_id': 'req-b37052d8-03c9-4be2-b4c0-9bd385a3518b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:31.219959 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b37052d8-03c9-4be2-b4c0-9bd385a3518b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c82f5022379468382c7a6f791a0723a', 'request_id': 'req-b37052d8-03c9-4be2-b4c0-9bd385a3518b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:31.233742 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b37052d8-03c9-4be2-b4c0-9bd385a3518b admin admin] The token cache is being invalidate because project 5c82f5022379468382c7a6f791a0723a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:55:31.234041 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b37052d8-03c9-4be2-b4c0-9bd385a3518b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:31.234684 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b37052d8-03c9-4be2-b4c0-9bd385a3518b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:31.236904 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1398/2826] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:55:30 2022] DELETE /identity/v3/projects/5c82f5022379468382c7a6f791a0723a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:31.242833 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f8c79-ca99-461c-8962-64fbc291d457 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:31.255563 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f8c79-ca99-461c-8962-64fbc291d457 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:31.353641 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ea6a4-8b50-4a20-8853-16c1a33ac628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:31.355217 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ea6a4-8b50-4a20-8853-16c1a33ac628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:31.355737 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ea6a4-8b50-4a20-8853-16c1a33ac628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:31.356242 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ea6a4-8b50-4a20-8853-16c1a33ac628 admin admin] PATH_INFO: `/v3/users/242f7b8fa8c04c3cb612f1cb4c3b7179` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:31.358479 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ea6a4-8b50-4a20-8853-16c1a33ac628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=242f7b8fa8c04c3cb612f1cb4c3b7179)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:31.362360 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ea6a4-8b50-4a20-8853-16c1a33ac628 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:31.571384 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-669ea6a4-8b50-4a20-8853-16c1a33ac628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242f7b8fa8c04c3cb612f1cb4c3b7179'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:31.585108 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-669ea6a4-8b50-4a20-8853-16c1a33ac628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242f7b8fa8c04c3cb612f1cb4c3b7179'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:31.590106 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:31.593541 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-669ea6a4-8b50-4a20-8853-16c1a33ac628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242f7b8fa8c04c3cb612f1cb4c3b7179'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:31.597956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-669ea6a4-8b50-4a20-8853-16c1a33ac628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242f7b8fa8c04c3cb612f1cb4c3b7179'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:31.597956 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-669ea6a4-8b50-4a20-8853-16c1a33ac628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242f7b8fa8c04c3cb612f1cb4c3b7179'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:31.689256 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1429/2827] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:55:31 2022] DELETE /identity/v3/users/242f7b8fa8c04c3cb612f1cb4c3b7179 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:32.169413 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37052d8-03c9-4be2-b4c0-9bd385a3518b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:32.171175 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b37052d8-03c9-4be2-b4c0-9bd385a3518b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:32.189484 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37052d8-03c9-4be2-b4c0-9bd385a3518b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:32.210038 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:32.264483 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400a7ea-053d-489a-adea-e26f7fc9081f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:32.265526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400a7ea-053d-489a-adea-e26f7fc9081f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:32.265856 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400a7ea-053d-489a-adea-e26f7fc9081f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:32.266179 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400a7ea-053d-489a-adea-e26f7fc9081f admin admin] PATH_INFO: `/v3/projects/aa8e16e132664002a3dd9e910f5cecdf` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:32.267757 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400a7ea-053d-489a-adea-e26f7fc9081f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa8e16e132664002a3dd9e910f5cecdf)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:32.270593 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400a7ea-053d-489a-adea-e26f7fc9081f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:32.376247 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c400a7ea-053d-489a-adea-e26f7fc9081f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa8e16e132664002a3dd9e910f5cecdf', 'request_id': 'req-c400a7ea-053d-489a-adea-e26f7fc9081f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:32.384094 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c400a7ea-053d-489a-adea-e26f7fc9081f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa8e16e132664002a3dd9e910f5cecdf', 'request_id': 'req-c400a7ea-053d-489a-adea-e26f7fc9081f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:32.483277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c400a7ea-053d-489a-adea-e26f7fc9081f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa8e16e132664002a3dd9e910f5cecdf', 'request_id': 'req-c400a7ea-053d-489a-adea-e26f7fc9081f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:32.504446 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c400a7ea-053d-489a-adea-e26f7fc9081f admin admin] The token cache is being invalidate because project aa8e16e132664002a3dd9e910f5cecdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:55:32.504983 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c400a7ea-053d-489a-adea-e26f7fc9081f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:32.506417 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c400a7ea-053d-489a-adea-e26f7fc9081f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:32.509291 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1399/2828] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:55:32 2022] DELETE /identity/v3/projects/aa8e16e132664002a3dd9e910f5cecdf => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:32.517732 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3171091-bff4-4cc1-86f8-de36e910f4d2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:32.518319 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3171091-bff4-4cc1-86f8-de36e910f4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:32.518789 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3171091-bff4-4cc1-86f8-de36e910f4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:32.553559 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a3171091-bff4-4cc1-86f8-de36e910f4d2 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:32.555712 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a3171091-bff4-4cc1-86f8-de36e910f4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:32.639982 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1430/2829] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:32.648949 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166d61d-478e-4604-946f-f19fafa59b1e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:32.649469 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166d61d-478e-4604-946f-f19fafa59b1e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:32.649751 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166d61d-478e-4604-946f-f19fafa59b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:32.669317 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-5166d61d-478e-4604-946f-f19fafa59b1e None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:32.670608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5166d61d-478e-4604-946f-f19fafa59b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:32.679504 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1400/2830] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:32.684665 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3171091-bff4-4cc1-86f8-de36e910f4d2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:32.699015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3171091-bff4-4cc1-86f8-de36e910f4d2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:32.704710 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612127de-0290-48d2-a788-f5675ccd044b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:32.705506 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612127de-0290-48d2-a788-f5675ccd044b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:32.705830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612127de-0290-48d2-a788-f5675ccd044b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:32.706523 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612127de-0290-48d2-a788-f5675ccd044b admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:32.707748 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612127de-0290-48d2-a788-f5675ccd044b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:55:32.708226 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612127de-0290-48d2-a788-f5675ccd044b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:32.710593 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612127de-0290-48d2-a788-f5675ccd044b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:32.728278 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1431/2831] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:55:32.734666 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166d61d-478e-4604-946f-f19fafa59b1e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:32.744567 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166d61d-478e-4604-946f-f19fafa59b1e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:32.749845 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12757a4b-f4c2-42ad-b2de-8ba746563178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:32.750517 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12757a4b-f4c2-42ad-b2de-8ba746563178 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:32.750797 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12757a4b-f4c2-42ad-b2de-8ba746563178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:32.751078 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12757a4b-f4c2-42ad-b2de-8ba746563178 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:32.751770 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12757a4b-f4c2-42ad-b2de-8ba746563178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:32.753872 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12757a4b-f4c2-42ad-b2de-8ba746563178 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:32.859871 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1401/2832] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:55:32 2022] POST /identity/v3/projects => generated 361 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:55:32.867096 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612127de-0290-48d2-a788-f5675ccd044b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:32.878040 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612127de-0290-48d2-a788-f5675ccd044b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:32.942978 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7d8d1-44c0-4d19-8989-d836ea037a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:32.943672 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7d8d1-44c0-4d19-8989-d836ea037a61 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:32.943965 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7d8d1-44c0-4d19-8989-d836ea037a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:32.944247 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7d8d1-44c0-4d19-8989-d836ea037a61 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:32.944967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7d8d1-44c0-4d19-8989-d836ea037a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:32.946964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7d8d1-44c0-4d19-8989-d836ea037a61 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:33.030135 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1432/2833] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:55:32 2022] POST /identity/v3/users => generated 281 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:55:33.035528 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12757a4b-f4c2-42ad-b2de-8ba746563178 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:33.047397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12757a4b-f4c2-42ad-b2de-8ba746563178 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:33.053608 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b93535-9595-4fa3-994b-278f26619fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:33.054301 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b93535-9595-4fa3-994b-278f26619fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:33.054587 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b93535-9595-4fa3-994b-278f26619fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:33.054875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b93535-9595-4fa3-994b-278f26619fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:33.055749 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b93535-9595-4fa3-994b-278f26619fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:33.057691 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b93535-9595-4fa3-994b-278f26619fbf admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:33.070128 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1402/2834] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:55:33.074470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7d8d1-44c0-4d19-8989-d836ea037a61 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:33.086039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7d8d1-44c0-4d19-8989-d836ea037a61 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:33.091306 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd96385-0972-4e03-b8a4-4476a46d5cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:33.091894 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd96385-0972-4e03-b8a4-4476a46d5cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:33.092179 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd96385-0972-4e03-b8a4-4476a46d5cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:33.092460 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd96385-0972-4e03-b8a4-4476a46d5cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:33.093197 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd96385-0972-4e03-b8a4-4476a46d5cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:33.094874 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd96385-0972-4e03-b8a4-4476a46d5cd6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:33.107240 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1433/2835] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:55:33.113622 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b93535-9595-4fa3-994b-278f26619fbf admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:33.124376 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b93535-9595-4fa3-994b-278f26619fbf admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:33.129536 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5814d-84d0-4350-a7a3-3fdec7ff5073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:33.130457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5814d-84d0-4350-a7a3-3fdec7ff5073 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:33.130764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5814d-84d0-4350-a7a3-3fdec7ff5073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:33.131045 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5814d-84d0-4350-a7a3-3fdec7ff5073 admin admin] PATH_INFO: `/v3/projects/3302132a93024b3bb3d33f7b0e1623de/users/dd1a35ea7fc44c15aac1b3236bb024de/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:33.147819 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5814d-84d0-4350-a7a3-3fdec7ff5073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3302132a93024b3bb3d33f7b0e1623de, user_id=dd1a35ea7fc44c15aac1b3236bb024de, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:33.150617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5814d-84d0-4350-a7a3-3fdec7ff5073 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:33.227253 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1403/2836] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:55:33 2022] PUT /identity/v3/projects/3302132a93024b3bb3d33f7b0e1623de/users/dd1a35ea7fc44c15aac1b3236bb024de/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:55:33.239492 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014658c-9f6a-4d02-9c71-20f4279b5979 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:33.239862 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014658c-9f6a-4d02-9c71-20f4279b5979 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:33.240191 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014658c-9f6a-4d02-9c71-20f4279b5979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:33.271922 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6014658c-9f6a-4d02-9c71-20f4279b5979 None None] MFA Rules not processed for user `dd1a35ea7fc44c15aac1b3236bb024de`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:33.273192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6014658c-9f6a-4d02-9c71-20f4279b5979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:33.330222 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:33.355240 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1434/2837] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:55:33.393271 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5814d-84d0-4350-a7a3-3fdec7ff5073 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:33.395697 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-78b5814d-84d0-4350-a7a3-3fdec7ff5073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:33.450302 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:33.467557 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5814d-84d0-4350-a7a3-3fdec7ff5073 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:33.471282 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642698d-fffe-49bb-aac2-e50f3700e568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:33.472124 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642698d-fffe-49bb-aac2-e50f3700e568 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:33.472505 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642698d-fffe-49bb-aac2-e50f3700e568 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:33.473222 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642698d-fffe-49bb-aac2-e50f3700e568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:33.481915 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642698d-fffe-49bb-aac2-e50f3700e568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:33.483404 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642698d-fffe-49bb-aac2-e50f3700e568 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:33.496623 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1404/2838] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:55:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:55:33.512869 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014658c-9f6a-4d02-9c71-20f4279b5979 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:33.601802 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014658c-9f6a-4d02-9c71-20f4279b5979 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:33.606830 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488702d-e242-4a27-96b7-b1a48dd2e387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:33.607728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488702d-e242-4a27-96b7-b1a48dd2e387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:33.608013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488702d-e242-4a27-96b7-b1a48dd2e387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:33.609897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488702d-e242-4a27-96b7-b1a48dd2e387 admin admin] PATH_INFO: `/v3/users/dd1a35ea7fc44c15aac1b3236bb024de` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:33.609897 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488702d-e242-4a27-96b7-b1a48dd2e387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd1a35ea7fc44c15aac1b3236bb024de)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:33.611582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488702d-e242-4a27-96b7-b1a48dd2e387 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:33.838754 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a488702d-e242-4a27-96b7-b1a48dd2e387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd1a35ea7fc44c15aac1b3236bb024de'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:33.858967 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a488702d-e242-4a27-96b7-b1a48dd2e387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd1a35ea7fc44c15aac1b3236bb024de'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:33.875045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a488702d-e242-4a27-96b7-b1a48dd2e387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd1a35ea7fc44c15aac1b3236bb024de'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:33.875045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a488702d-e242-4a27-96b7-b1a48dd2e387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd1a35ea7fc44c15aac1b3236bb024de'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:33.875045 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a488702d-e242-4a27-96b7-b1a48dd2e387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd1a35ea7fc44c15aac1b3236bb024de'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:33.939911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1435/2839] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:55:33 2022] DELETE /identity/v3/users/dd1a35ea7fc44c15aac1b3236bb024de => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:33.945038 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d6d38-59c8-44cb-a23a-66fab603bad7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:33.945353 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d6d38-59c8-44cb-a23a-66fab603bad7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:33.945650 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d6d38-59c8-44cb-a23a-66fab603bad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:33.965228 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-fa9d6d38-59c8-44cb-a23a-66fab603bad7 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:33.966486 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fa9d6d38-59c8-44cb-a23a-66fab603bad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:34.028436 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1405/2840] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:34.038955 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488702d-e242-4a27-96b7-b1a48dd2e387 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:34.040377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a488702d-e242-4a27-96b7-b1a48dd2e387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:34.111666 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488702d-e242-4a27-96b7-b1a48dd2e387 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:34.115433 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9d816-52c6-4349-a1d8-2e511572b978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:34.116091 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9d816-52c6-4349-a1d8-2e511572b978 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:34.116370 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9d816-52c6-4349-a1d8-2e511572b978 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:34.116644 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9d816-52c6-4349-a1d8-2e511572b978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:34.126775 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9d816-52c6-4349-a1d8-2e511572b978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:34.128262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9d816-52c6-4349-a1d8-2e511572b978 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:34.138771 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1436/2841] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:55:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:55:34.742534 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d6d38-59c8-44cb-a23a-66fab603bad7 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:34.749498 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fa9d6d38-59c8-44cb-a23a-66fab603bad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:34.760926 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d6d38-59c8-44cb-a23a-66fab603bad7 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:34.767290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf7491-375c-446d-ab4c-66a1f60e36ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:34.768302 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf7491-375c-446d-ab4c-66a1f60e36ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:34.768526 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf7491-375c-446d-ab4c-66a1f60e36ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:34.769140 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf7491-375c-446d-ab4c-66a1f60e36ca admin admin] PATH_INFO: `/v3/projects/3302132a93024b3bb3d33f7b0e1623de` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:34.770421 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf7491-375c-446d-ab4c-66a1f60e36ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3302132a93024b3bb3d33f7b0e1623de)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:34.772516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf7491-375c-446d-ab4c-66a1f60e36ca admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:34.890145 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ebaf7491-375c-446d-ab4c-66a1f60e36ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3302132a93024b3bb3d33f7b0e1623de', 'request_id': 'req-ebaf7491-375c-446d-ab4c-66a1f60e36ca'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:34.896733 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ebaf7491-375c-446d-ab4c-66a1f60e36ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3302132a93024b3bb3d33f7b0e1623de', 'request_id': 'req-ebaf7491-375c-446d-ab4c-66a1f60e36ca'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:34.956476 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ebaf7491-375c-446d-ab4c-66a1f60e36ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3302132a93024b3bb3d33f7b0e1623de', 'request_id': 'req-ebaf7491-375c-446d-ab4c-66a1f60e36ca'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:34.967682 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ebaf7491-375c-446d-ab4c-66a1f60e36ca admin admin] The token cache is being invalidate because project 3302132a93024b3bb3d33f7b0e1623de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:55:34.967994 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ebaf7491-375c-446d-ab4c-66a1f60e36ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:34.968629 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ebaf7491-375c-446d-ab4c-66a1f60e36ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:34.970245 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1406/2842] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:55:34 2022] DELETE /identity/v3/projects/3302132a93024b3bb3d33f7b0e1623de => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:34.975837 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4e71-619a-484e-b245-648265583067 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:34.976385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4e71-619a-484e-b245-648265583067 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:34.976385 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4e71-619a-484e-b245-648265583067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:34.983828 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:34.995507 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-062d4e71-619a-484e-b245-648265583067 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:34.996729 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-062d4e71-619a-484e-b245-648265583067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:35.057765 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1437/2843] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:35.125927 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466469f-8ecf-4fac-834a-976bb62a8673 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:35.126290 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466469f-8ecf-4fac-834a-976bb62a8673 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:35.126623 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466469f-8ecf-4fac-834a-976bb62a8673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:35.149184 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e466469f-8ecf-4fac-834a-976bb62a8673 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:35.151568 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e466469f-8ecf-4fac-834a-976bb62a8673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:35.159066 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1407/2844] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:55:35.164129 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4e71-619a-484e-b245-648265583067 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:35.175088 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4e71-619a-484e-b245-648265583067 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:35.180221 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c58f00-e816-4e5f-92f5-8d4b2eeaee89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:35.180800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c58f00-e816-4e5f-92f5-8d4b2eeaee89 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:35.181093 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c58f00-e816-4e5f-92f5-8d4b2eeaee89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:35.181540 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c58f00-e816-4e5f-92f5-8d4b2eeaee89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:35.182315 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c58f00-e816-4e5f-92f5-8d4b2eeaee89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:55:35.182623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c58f00-e816-4e5f-92f5-8d4b2eeaee89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:35.184690 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c58f00-e816-4e5f-92f5-8d4b2eeaee89 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:35.202803 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1438/2845] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:55:35.208687 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466469f-8ecf-4fac-834a-976bb62a8673 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:35.218838 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466469f-8ecf-4fac-834a-976bb62a8673 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:35.224231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed32ec-7e33-474f-b5a1-4d13eeced770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:35.224913 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed32ec-7e33-474f-b5a1-4d13eeced770 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:35.225200 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed32ec-7e33-474f-b5a1-4d13eeced770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:35.225579 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed32ec-7e33-474f-b5a1-4d13eeced770 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:35.231810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed32ec-7e33-474f-b5a1-4d13eeced770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:35.231810 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed32ec-7e33-474f-b5a1-4d13eeced770 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:35.318098 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1408/2846] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:55:35 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:55:35.322694 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c58f00-e816-4e5f-92f5-8d4b2eeaee89 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:35.341273 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c58f00-e816-4e5f-92f5-8d4b2eeaee89 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:35.406269 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e62fb-0092-48c9-bfc4-b1f2f7814e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:35.406964 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e62fb-0092-48c9-bfc4-b1f2f7814e68 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:35.407237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e62fb-0092-48c9-bfc4-b1f2f7814e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:35.407516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e62fb-0092-48c9-bfc4-b1f2f7814e68 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:35.408219 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e62fb-0092-48c9-bfc4-b1f2f7814e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:35.410952 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e62fb-0092-48c9-bfc4-b1f2f7814e68 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:35.543786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1439/2847] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:55:35 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:55:35.548244 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed32ec-7e33-474f-b5a1-4d13eeced770 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:35.560773 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed32ec-7e33-474f-b5a1-4d13eeced770 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:35.567686 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1bdbd-ac05-4842-9104-32cbb7db7d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:35.568964 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1bdbd-ac05-4842-9104-32cbb7db7d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:35.569454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1bdbd-ac05-4842-9104-32cbb7db7d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:35.569955 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1bdbd-ac05-4842-9104-32cbb7db7d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:35.571371 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1bdbd-ac05-4842-9104-32cbb7db7d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:35.574418 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1bdbd-ac05-4842-9104-32cbb7db7d38 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:35.590264 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1409/2848] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:55:35.594495 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e62fb-0092-48c9-bfc4-b1f2f7814e68 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:35.606009 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e62fb-0092-48c9-bfc4-b1f2f7814e68 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:35.610854 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c8d22-7319-4a2b-8a85-a18a381f521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:35.611545 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c8d22-7319-4a2b-8a85-a18a381f521d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:35.611825 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c8d22-7319-4a2b-8a85-a18a381f521d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:35.612106 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c8d22-7319-4a2b-8a85-a18a381f521d admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:35.613996 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c8d22-7319-4a2b-8a85-a18a381f521d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:35.615644 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c8d22-7319-4a2b-8a85-a18a381f521d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:35.626590 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1440/2849] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:55:35.632625 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1bdbd-ac05-4842-9104-32cbb7db7d38 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:35.645549 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1bdbd-ac05-4842-9104-32cbb7db7d38 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:35.651111 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ac981-0aca-4afc-aec8-e3b9e5f10913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:35.652331 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ac981-0aca-4afc-aec8-e3b9e5f10913 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:35.652617 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ac981-0aca-4afc-aec8-e3b9e5f10913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:35.652896 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ac981-0aca-4afc-aec8-e3b9e5f10913 admin admin] PATH_INFO: `/v3/projects/adbe29903c8541f393584d1d2f476b91/users/38923dcd307d45168b3df04ef9e26110/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:35.670636 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ac981-0aca-4afc-aec8-e3b9e5f10913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbe29903c8541f393584d1d2f476b91, user_id=38923dcd307d45168b3df04ef9e26110, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:35.673417 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ac981-0aca-4afc-aec8-e3b9e5f10913 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:35.778062 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1410/2850] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:55:35 2022] PUT /identity/v3/projects/adbe29903c8541f393584d1d2f476b91/users/38923dcd307d45168b3df04ef9e26110/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:35.789986 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871ece1-5fc0-482c-b9b2-ec098fd40b84 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:35.790335 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871ece1-5fc0-482c-b9b2-ec098fd40b84 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:35.790652 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871ece1-5fc0-482c-b9b2-ec098fd40b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:35.821645 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9871ece1-5fc0-482c-b9b2-ec098fd40b84 None None] MFA Rules not processed for user `38923dcd307d45168b3df04ef9e26110`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:35.822798 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9871ece1-5fc0-482c-b9b2-ec098fd40b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:35.911300 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:35.915376 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1441/2851] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:35.926673 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ac981-0aca-4afc-aec8-e3b9e5f10913 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:35.936604 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:35.997987 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ac981-0aca-4afc-aec8-e3b9e5f10913 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:36.002865 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c13d6-f290-4906-9930-780a34b1d3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:36.003703 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c13d6-f290-4906-9930-780a34b1d3be admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:36.004140 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c13d6-f290-4906-9930-780a34b1d3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:36.004460 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c13d6-f290-4906-9930-780a34b1d3be admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:36.005209 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c13d6-f290-4906-9930-780a34b1d3be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:36.007723 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c13d6-f290-4906-9930-780a34b1d3be admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:36.127569 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1411/2852] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:55:35 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:55:36.132088 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871ece1-5fc0-482c-b9b2-ec098fd40b84 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:36.142985 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871ece1-5fc0-482c-b9b2-ec098fd40b84 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:36.208297 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260c788-3769-4456-804c-09963428ef13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:36.208985 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c788-3769-4456-804c-09963428ef13 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:36.209268 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c788-3769-4456-804c-09963428ef13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:36.209577 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c788-3769-4456-804c-09963428ef13 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:36.210296 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260c788-3769-4456-804c-09963428ef13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:36.212283 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260c788-3769-4456-804c-09963428ef13 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:36.341308 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1442/2853] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:55:36 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:55:36.345985 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c13d6-f290-4906-9930-780a34b1d3be admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:36.356995 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c13d6-f290-4906-9930-780a34b1d3be admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:36.361764 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3461a-acbd-4bc3-bae8-a05626aff891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:36.362992 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3461a-acbd-4bc3-bae8-a05626aff891 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:36.363276 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3461a-acbd-4bc3-bae8-a05626aff891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:36.363553 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3461a-acbd-4bc3-bae8-a05626aff891 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:36.364288 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3461a-acbd-4bc3-bae8-a05626aff891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:36.365953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3461a-acbd-4bc3-bae8-a05626aff891 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:36.379359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1412/2854] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:55:36.383599 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260c788-3769-4456-804c-09963428ef13 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:36.394326 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260c788-3769-4456-804c-09963428ef13 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:36.399015 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df25ac7-4efd-4750-ac14-07f9edad96b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:36.399695 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df25ac7-4efd-4750-ac14-07f9edad96b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:36.399975 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df25ac7-4efd-4750-ac14-07f9edad96b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:36.400249 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df25ac7-4efd-4750-ac14-07f9edad96b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:36.401010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df25ac7-4efd-4750-ac14-07f9edad96b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:36.402623 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df25ac7-4efd-4750-ac14-07f9edad96b3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:36.413815 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1443/2855] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:55:36.418182 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3461a-acbd-4bc3-bae8-a05626aff891 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:36.429192 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3461a-acbd-4bc3-bae8-a05626aff891 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:36.434414 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f14689-eb33-444b-9208-b2e6baad4b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:36.435307 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f14689-eb33-444b-9208-b2e6baad4b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:36.435585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f14689-eb33-444b-9208-b2e6baad4b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:36.435858 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f14689-eb33-444b-9208-b2e6baad4b7b admin admin] PATH_INFO: `/v3/projects/712e7d959d2640f8a1c70cf172271d47/users/842610be5ce24bb0883c0c0c2dbd1b62/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:36.453830 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f14689-eb33-444b-9208-b2e6baad4b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=712e7d959d2640f8a1c70cf172271d47, user_id=842610be5ce24bb0883c0c0c2dbd1b62, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:36.457341 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f14689-eb33-444b-9208-b2e6baad4b7b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:36.598161 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1413/2856] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:55:36 2022] PUT /identity/v3/projects/712e7d959d2640f8a1c70cf172271d47/users/842610be5ce24bb0883c0c0c2dbd1b62/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:36.609187 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be77241-c18c-48a2-80f9-596f9c87eb17 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:36.609505 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be77241-c18c-48a2-80f9-596f9c87eb17 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:36.609799 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be77241-c18c-48a2-80f9-596f9c87eb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:36.639629 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9be77241-c18c-48a2-80f9-596f9c87eb17 None None] MFA Rules not processed for user `842610be5ce24bb0883c0c0c2dbd1b62`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:36.640910 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9be77241-c18c-48a2-80f9-596f9c87eb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:36.748169 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1444/2857] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:36.753944 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f14689-eb33-444b-9208-b2e6baad4b7b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:36.831778 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f14689-eb33-444b-9208-b2e6baad4b7b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:36.837101 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14bd0c-f71e-457b-b973-208d3ac5603b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:36.837887 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14bd0c-f71e-457b-b973-208d3ac5603b admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:36.838240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14bd0c-f71e-457b-b973-208d3ac5603b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:36.838566 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14bd0c-f71e-457b-b973-208d3ac5603b admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:36.839359 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14bd0c-f71e-457b-b973-208d3ac5603b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:36.841496 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14bd0c-f71e-457b-b973-208d3ac5603b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:36.968289 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1414/2858] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:55:36 2022] POST /identity/v3/projects => generated 375 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:55:36.973599 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be77241-c18c-48a2-80f9-596f9c87eb17 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:36.986463 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be77241-c18c-48a2-80f9-596f9c87eb17 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:37.057421 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0a56d-b86b-405c-ac79-ff5881174836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:37.058118 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0a56d-b86b-405c-ac79-ff5881174836 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:37.058402 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0a56d-b86b-405c-ac79-ff5881174836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:37.058953 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0a56d-b86b-405c-ac79-ff5881174836 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:37.059679 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0a56d-b86b-405c-ac79-ff5881174836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:37.061671 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0a56d-b86b-405c-ac79-ff5881174836 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:37.177998 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:37.185495 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1445/2859] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:55:36 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:55:37.191501 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14bd0c-f71e-457b-b973-208d3ac5603b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:37.210657 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14bd0c-f71e-457b-b973-208d3ac5603b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:37.218170 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2e407-e03a-4def-8abb-692318ea7a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:37.219316 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2e407-e03a-4def-8abb-692318ea7a60 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:37.219783 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2e407-e03a-4def-8abb-692318ea7a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:37.220249 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2e407-e03a-4def-8abb-692318ea7a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:37.222183 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2e407-e03a-4def-8abb-692318ea7a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:37.226115 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2e407-e03a-4def-8abb-692318ea7a60 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:37.247431 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1415/2860] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:55:37.252466 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0a56d-b86b-405c-ac79-ff5881174836 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:37.264501 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0a56d-b86b-405c-ac79-ff5881174836 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:37.270139 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b07ee-df9e-4274-a148-2ac609666eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:37.271339 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b07ee-df9e-4274-a148-2ac609666eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:37.271624 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b07ee-df9e-4274-a148-2ac609666eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:37.271906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b07ee-df9e-4274-a148-2ac609666eb8 admin admin] PATH_INFO: `/v3/projects/663f9a008ff549fb85cdf9da33f7970a/users/9953282457f14e3ebfd6f3313ea5424b/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:37.291505 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b07ee-df9e-4274-a148-2ac609666eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=663f9a008ff549fb85cdf9da33f7970a, user_id=9953282457f14e3ebfd6f3313ea5424b, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:37.294309 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b07ee-df9e-4274-a148-2ac609666eb8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:37.352807 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1446/2861] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:55:37 2022] PUT /identity/v3/projects/663f9a008ff549fb85cdf9da33f7970a/users/9953282457f14e3ebfd6f3313ea5424b/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:55:37.357952 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2e407-e03a-4def-8abb-692318ea7a60 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:37.370397 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2e407-e03a-4def-8abb-692318ea7a60 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:37.401924 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:37.441579 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afce2c-ccc6-45dd-b5e7-26cf5917ad4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:37.442286 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afce2c-ccc6-45dd-b5e7-26cf5917ad4c admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:37.443950 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afce2c-ccc6-45dd-b5e7-26cf5917ad4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:37.444240 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afce2c-ccc6-45dd-b5e7-26cf5917ad4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:37.445010 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7afce2c-ccc6-45dd-b5e7-26cf5917ad4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:37.446736 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7afce2c-ccc6-45dd-b5e7-26cf5917ad4c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:37.459322 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1416/2862] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:55:37.464307 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b07ee-df9e-4274-a148-2ac609666eb8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:37.477374 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b07ee-df9e-4274-a148-2ac609666eb8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:37.483213 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0458f-2256-42f4-918c-29e842189575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:37.484298 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0458f-2256-42f4-918c-29e842189575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:37.484631 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0458f-2256-42f4-918c-29e842189575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:37.484955 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0458f-2256-42f4-918c-29e842189575 admin admin] PATH_INFO: `/v3/projects/663f9a008ff549fb85cdf9da33f7970a/users/9953282457f14e3ebfd6f3313ea5424b/roles/456b9cf0313d4ef38999b86ad7fbf268` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:37.488461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0458f-2256-42f4-918c-29e842189575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=663f9a008ff549fb85cdf9da33f7970a, user_id=9953282457f14e3ebfd6f3313ea5424b, role_id=456b9cf0313d4ef38999b86ad7fbf268)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:37.491898 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0458f-2256-42f4-918c-29e842189575 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:37.506527 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1447/2863] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:55:37 2022] PUT /identity/v3/projects/663f9a008ff549fb85cdf9da33f7970a/users/9953282457f14e3ebfd6f3313ea5424b/roles/456b9cf0313d4ef38999b86ad7fbf268 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:37.519412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd4e6e-e4d6-4be0-818c-f2281d87c1f5 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:37.519712 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd4e6e-e4d6-4be0-818c-f2281d87c1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:37.519976 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd4e6e-e4d6-4be0-818c-f2281d87c1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:37.552786 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-47cd4e6e-e4d6-4be0-818c-f2281d87c1f5 None None] MFA Rules not processed for user `9953282457f14e3ebfd6f3313ea5424b`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:37.554057 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-47cd4e6e-e4d6-4be0-818c-f2281d87c1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:37.629509 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1417/2864] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:55:37.641146 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0458f-2256-42f4-918c-29e842189575 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:37.642954 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c8d0458f-2256-42f4-918c-29e842189575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:37.713707 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0458f-2256-42f4-918c-29e842189575 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:37.721200 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f82581-c681-4397-bf55-aff12cb9916d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:37.721200 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f82581-c681-4397-bf55-aff12cb9916d service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:37.721200 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f82581-c681-4397-bf55-aff12cb9916d service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:37.721200 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f82581-c681-4397-bf55-aff12cb9916d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:37.793713 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f82581-c681-4397-bf55-aff12cb9916d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:37.795208 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f82581-c681-4397-bf55-aff12cb9916d service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:37.805781 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1448/2865] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:55:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:55:39.856134 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd4e6e-e4d6-4be0-818c-f2281d87c1f5 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:39.858076 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-47cd4e6e-e4d6-4be0-818c-f2281d87c1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:39.871861 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd4e6e-e4d6-4be0-818c-f2281d87c1f5 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:39.875702 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eca71f-5b1a-4df8-8124-97317080fad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:39.876456 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eca71f-5b1a-4df8-8124-97317080fad8 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:39.876736 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eca71f-5b1a-4df8-8124-97317080fad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:39.877011 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eca71f-5b1a-4df8-8124-97317080fad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:39.943337 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eca71f-5b1a-4df8-8124-97317080fad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:39.944807 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eca71f-5b1a-4df8-8124-97317080fad8 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:39.954884 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1418/2866] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:55:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:55:41.517810 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f82581-c681-4397-bf55-aff12cb9916d service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:41.530002 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f82581-c681-4397-bf55-aff12cb9916d service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:41.534942 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59d189-41a2-42f5-a226-dd069f289fa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:41.535642 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d189-41a2-42f5-a226-dd069f289fa8 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:41.535927 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d189-41a2-42f5-a226-dd069f289fa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:41.536203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d189-41a2-42f5-a226-dd069f289fa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:41.546331 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59d189-41a2-42f5-a226-dd069f289fa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:41.547786 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59d189-41a2-42f5-a226-dd069f289fa8 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:41.559772 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1449/2867] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:55:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:55:47.302860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eca71f-5b1a-4df8-8124-97317080fad8 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:47.361706 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:47.387725 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eca71f-5b1a-4df8-8124-97317080fad8 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:47.395859 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753944ed-38d3-4ba6-8fcb-e35b15761785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:47.397451 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753944ed-38d3-4ba6-8fcb-e35b15761785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:47.397957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753944ed-38d3-4ba6-8fcb-e35b15761785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:47.398441 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753944ed-38d3-4ba6-8fcb-e35b15761785 admin admin] PATH_INFO: `/v3/users/38923dcd307d45168b3df04ef9e26110` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:47.400724 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753944ed-38d3-4ba6-8fcb-e35b15761785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38923dcd307d45168b3df04ef9e26110)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:47.404430 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753944ed-38d3-4ba6-8fcb-e35b15761785 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:47.607971 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-753944ed-38d3-4ba6-8fcb-e35b15761785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38923dcd307d45168b3df04ef9e26110'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:47.621613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-753944ed-38d3-4ba6-8fcb-e35b15761785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38923dcd307d45168b3df04ef9e26110'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:47.622378 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-753944ed-38d3-4ba6-8fcb-e35b15761785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38923dcd307d45168b3df04ef9e26110'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:47.623032 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-753944ed-38d3-4ba6-8fcb-e35b15761785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38923dcd307d45168b3df04ef9e26110'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:47.631272 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-753944ed-38d3-4ba6-8fcb-e35b15761785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38923dcd307d45168b3df04ef9e26110'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:47.712589 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1419/2868] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:55:47 2022] DELETE /identity/v3/users/38923dcd307d45168b3df04ef9e26110 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:55:47.717804 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751880f-2e7b-4c8c-87ae-bde0479b7af3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:47.718646 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751880f-2e7b-4c8c-87ae-bde0479b7af3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:47.718824 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751880f-2e7b-4c8c-87ae-bde0479b7af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:47.738013 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9751880f-2e7b-4c8c-87ae-bde0479b7af3 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:47.739241 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9751880f-2e7b-4c8c-87ae-bde0479b7af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:47.803823 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1450/2869] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:47.815178 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753944ed-38d3-4ba6-8fcb-e35b15761785 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:47.816722 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-753944ed-38d3-4ba6-8fcb-e35b15761785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:47.898572 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753944ed-38d3-4ba6-8fcb-e35b15761785 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:47.902273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc84e8b-9fba-4bef-9506-52d0a97ca70e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:47.902945 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc84e8b-9fba-4bef-9506-52d0a97ca70e service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:47.903231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc84e8b-9fba-4bef-9506-52d0a97ca70e service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:47.903507 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc84e8b-9fba-4bef-9506-52d0a97ca70e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:47.914118 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc84e8b-9fba-4bef-9506-52d0a97ca70e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:47.915629 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc84e8b-9fba-4bef-9506-52d0a97ca70e service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:47.926813 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1420/2870] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:55:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:55:48.423491 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751880f-2e7b-4c8c-87ae-bde0479b7af3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:48.425061 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9751880f-2e7b-4c8c-87ae-bde0479b7af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:48.432417 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:48.442263 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751880f-2e7b-4c8c-87ae-bde0479b7af3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:48.452186 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:48.454314 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:48.454853 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:48.455933 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b admin admin] PATH_INFO: `/v3/projects/adbe29903c8541f393584d1d2f476b91` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:48.458383 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b admin admin] RBAC: Authorizing `identity:delete_project(project_id=adbe29903c8541f393584d1d2f476b91)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:48.462635 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:48.700250 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adbe29903c8541f393584d1d2f476b91', 'request_id': 'req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:48.772866 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adbe29903c8541f393584d1d2f476b91', 'request_id': 'req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:48.783939 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adbe29903c8541f393584d1d2f476b91', 'request_id': 'req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:48.795516 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b admin admin] The token cache is being invalidate because project adbe29903c8541f393584d1d2f476b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:55:48.795797 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:48.796463 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:48.798073 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1451/2871] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:55:48 2022] DELETE /identity/v3/projects/adbe29903c8541f393584d1d2f476b91 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:48.802753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc84e8b-9fba-4bef-9506-52d0a97ca70e service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:48.813200 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc84e8b-9fba-4bef-9506-52d0a97ca70e service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:48.875820 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c1c76-38da-475a-8296-d4c4b0183585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:48.877002 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c1c76-38da-475a-8296-d4c4b0183585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:48.877937 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c1c76-38da-475a-8296-d4c4b0183585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:48.879871 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c1c76-38da-475a-8296-d4c4b0183585 admin admin] PATH_INFO: `/v3/users/842610be5ce24bb0883c0c0c2dbd1b62` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:48.879871 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c1c76-38da-475a-8296-d4c4b0183585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=842610be5ce24bb0883c0c0c2dbd1b62)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:48.881540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c1c76-38da-475a-8296-d4c4b0183585 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:48.896584 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:49.069039 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c91c1c76-38da-475a-8296-d4c4b0183585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842610be5ce24bb0883c0c0c2dbd1b62'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:49.083955 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c91c1c76-38da-475a-8296-d4c4b0183585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842610be5ce24bb0883c0c0c2dbd1b62'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:49.084701 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c91c1c76-38da-475a-8296-d4c4b0183585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842610be5ce24bb0883c0c0c2dbd1b62'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:49.085345 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c91c1c76-38da-475a-8296-d4c4b0183585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842610be5ce24bb0883c0c0c2dbd1b62'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:49.092513 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c91c1c76-38da-475a-8296-d4c4b0183585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842610be5ce24bb0883c0c0c2dbd1b62'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:49.201747 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1421/2872] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:55:48 2022] DELETE /identity/v3/users/842610be5ce24bb0883c0c0c2dbd1b62 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:49.662807 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:49.664946 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:49.687274 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55d886-1a91-4c31-9e4a-c9b17aa0a95b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:49.757549 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5478ef-a155-4b0e-b0cc-937e53c0edef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:49.758433 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5478ef-a155-4b0e-b0cc-937e53c0edef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:49.758719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5478ef-a155-4b0e-b0cc-937e53c0edef admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:49.758996 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5478ef-a155-4b0e-b0cc-937e53c0edef admin admin] PATH_INFO: `/v3/projects/712e7d959d2640f8a1c70cf172271d47` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:49.760225 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5478ef-a155-4b0e-b0cc-937e53c0edef admin admin] RBAC: Authorizing `identity:delete_project(project_id=712e7d959d2640f8a1c70cf172271d47)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:49.762212 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5478ef-a155-4b0e-b0cc-937e53c0edef admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:49.888425 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0c5478ef-a155-4b0e-b0cc-937e53c0edef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712e7d959d2640f8a1c70cf172271d47', 'request_id': 'req-0c5478ef-a155-4b0e-b0cc-937e53c0edef'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:50.001299 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0c5478ef-a155-4b0e-b0cc-937e53c0edef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712e7d959d2640f8a1c70cf172271d47', 'request_id': 'req-0c5478ef-a155-4b0e-b0cc-937e53c0edef'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:50.008779 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0c5478ef-a155-4b0e-b0cc-937e53c0edef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712e7d959d2640f8a1c70cf172271d47', 'request_id': 'req-0c5478ef-a155-4b0e-b0cc-937e53c0edef'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:50.019889 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0c5478ef-a155-4b0e-b0cc-937e53c0edef admin admin] The token cache is being invalidate because project 712e7d959d2640f8a1c70cf172271d47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:55:50.020393 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0c5478ef-a155-4b0e-b0cc-937e53c0edef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:50.020841 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0c5478ef-a155-4b0e-b0cc-937e53c0edef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:50.022420 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1452/2873] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:55:49 2022] DELETE /identity/v3/projects/712e7d959d2640f8a1c70cf172271d47 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:50.026942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c1c76-38da-475a-8296-d4c4b0183585 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:50.028748 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c91c1c76-38da-475a-8296-d4c4b0183585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:50.045348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c1c76-38da-475a-8296-d4c4b0183585 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:50.106328 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da16077-f075-4174-b85b-0515cf99b8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:50.107262 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da16077-f075-4174-b85b-0515cf99b8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:50.107549 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da16077-f075-4174-b85b-0515cf99b8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:50.107832 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da16077-f075-4174-b85b-0515cf99b8d5 admin admin] PATH_INFO: `/v3/users/9953282457f14e3ebfd6f3313ea5424b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:50.109075 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da16077-f075-4174-b85b-0515cf99b8d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9953282457f14e3ebfd6f3313ea5424b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:50.111304 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da16077-f075-4174-b85b-0515cf99b8d5 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:50.339766 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9da16077-f075-4174-b85b-0515cf99b8d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9953282457f14e3ebfd6f3313ea5424b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:50.352210 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9da16077-f075-4174-b85b-0515cf99b8d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9953282457f14e3ebfd6f3313ea5424b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:50.352942 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9da16077-f075-4174-b85b-0515cf99b8d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9953282457f14e3ebfd6f3313ea5424b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:50.353570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9da16077-f075-4174-b85b-0515cf99b8d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9953282457f14e3ebfd6f3313ea5424b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:50.360679 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9da16077-f075-4174-b85b-0515cf99b8d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9953282457f14e3ebfd6f3313ea5424b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:50.459521 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1422/2874] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:55:50 2022] DELETE /identity/v3/users/9953282457f14e3ebfd6f3313ea5424b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:50.900538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5478ef-a155-4b0e-b0cc-937e53c0edef admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:50.902069 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0c5478ef-a155-4b0e-b0cc-937e53c0edef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:50.916221 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5478ef-a155-4b0e-b0cc-937e53c0edef admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:50.932062 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:50.983066 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e74169-7bdb-45fc-9c63-1ce88dd032a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:50.984222 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e74169-7bdb-45fc-9c63-1ce88dd032a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:50.984839 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e74169-7bdb-45fc-9c63-1ce88dd032a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:50.985737 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e74169-7bdb-45fc-9c63-1ce88dd032a0 admin admin] PATH_INFO: `/v3/projects/663f9a008ff549fb85cdf9da33f7970a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:50.987763 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e74169-7bdb-45fc-9c63-1ce88dd032a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=663f9a008ff549fb85cdf9da33f7970a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:50.990010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e74169-7bdb-45fc-9c63-1ce88dd032a0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:51.116977 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-19e74169-7bdb-45fc-9c63-1ce88dd032a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663f9a008ff549fb85cdf9da33f7970a', 'request_id': 'req-19e74169-7bdb-45fc-9c63-1ce88dd032a0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:51.179907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-19e74169-7bdb-45fc-9c63-1ce88dd032a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663f9a008ff549fb85cdf9da33f7970a', 'request_id': 'req-19e74169-7bdb-45fc-9c63-1ce88dd032a0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:51.187577 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-19e74169-7bdb-45fc-9c63-1ce88dd032a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663f9a008ff549fb85cdf9da33f7970a', 'request_id': 'req-19e74169-7bdb-45fc-9c63-1ce88dd032a0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:51.199602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-19e74169-7bdb-45fc-9c63-1ce88dd032a0 admin admin] The token cache is being invalidate because project 663f9a008ff549fb85cdf9da33f7970a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:55:51.199929 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-19e74169-7bdb-45fc-9c63-1ce88dd032a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:51.200893 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-19e74169-7bdb-45fc-9c63-1ce88dd032a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:51.203825 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1453/2875] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:55:50 2022] DELETE /identity/v3/projects/663f9a008ff549fb85cdf9da33f7970a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:51.211315 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e91db-def4-4d6f-ab07-cb2ef00e95e5 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:51.211861 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e91db-def4-4d6f-ab07-cb2ef00e95e5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:51.211861 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e91db-def4-4d6f-ab07-cb2ef00e95e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:51.231898 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f89e91db-def4-4d6f-ab07-cb2ef00e95e5 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:51.233138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f89e91db-def4-4d6f-ab07-cb2ef00e95e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:51.239092 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:51.296844 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1423/2876] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:51.305878 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9587b-0403-4f1a-8338-9f08ebfd6874 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:51.306148 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9587b-0403-4f1a-8338-9f08ebfd6874 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:51.306470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9587b-0403-4f1a-8338-9f08ebfd6874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:51.330917 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-86c9587b-0403-4f1a-8338-9f08ebfd6874 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:51.332454 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-86c9587b-0403-4f1a-8338-9f08ebfd6874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:51.342933 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1454/2877] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:51.348464 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e91db-def4-4d6f-ab07-cb2ef00e95e5 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:51.359167 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e91db-def4-4d6f-ab07-cb2ef00e95e5 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:51.365159 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e704660-01e8-487b-8687-b3cf93d05889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:51.365957 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e704660-01e8-487b-8687-b3cf93d05889 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:51.366237 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e704660-01e8-487b-8687-b3cf93d05889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:51.366516 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e704660-01e8-487b-8687-b3cf93d05889 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:51.367251 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e704660-01e8-487b-8687-b3cf93d05889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:55:51.367596 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e704660-01e8-487b-8687-b3cf93d05889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:51.369226 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e704660-01e8-487b-8687-b3cf93d05889 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:51.382924 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1424/2878] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:55:51.388497 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9587b-0403-4f1a-8338-9f08ebfd6874 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:51.400542 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9587b-0403-4f1a-8338-9f08ebfd6874 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:51.405620 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd850493-dd79-49e3-aad7-8467258edfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:51.406311 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd850493-dd79-49e3-aad7-8467258edfe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:51.406595 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd850493-dd79-49e3-aad7-8467258edfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:51.407304 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd850493-dd79-49e3-aad7-8467258edfe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:51.407583 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd850493-dd79-49e3-aad7-8467258edfe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:51.410101 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd850493-dd79-49e3-aad7-8467258edfe7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:51.506432 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1455/2879] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:55:51 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:55:51.510775 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e704660-01e8-487b-8687-b3cf93d05889 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:51.521605 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e704660-01e8-487b-8687-b3cf93d05889 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:51.590305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63782674-1243-4cab-858d-d67241fc54d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:51.590979 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63782674-1243-4cab-858d-d67241fc54d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:51.591282 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63782674-1243-4cab-858d-d67241fc54d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:51.591561 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63782674-1243-4cab-858d-d67241fc54d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:51.592251 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63782674-1243-4cab-858d-d67241fc54d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:51.594249 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63782674-1243-4cab-858d-d67241fc54d6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:51.701421 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1425/2880] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:55:51 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:55:51.706458 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd850493-dd79-49e3-aad7-8467258edfe7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:51.718574 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd850493-dd79-49e3-aad7-8467258edfe7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:51.724850 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0e24f-3b6d-42ab-9a79-16c5f0999cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:51.725870 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0e24f-3b6d-42ab-9a79-16c5f0999cec admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:51.726262 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0e24f-3b6d-42ab-9a79-16c5f0999cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:51.726646 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0e24f-3b6d-42ab-9a79-16c5f0999cec admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:51.727524 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0e24f-3b6d-42ab-9a79-16c5f0999cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:51.729682 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0e24f-3b6d-42ab-9a79-16c5f0999cec admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:51.743335 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1456/2881] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:55:51.750026 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63782674-1243-4cab-858d-d67241fc54d6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:51.768419 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63782674-1243-4cab-858d-d67241fc54d6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:51.776131 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd0c51-d8a0-47de-aeb6-8234d241acb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:51.777273 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd0c51-d8a0-47de-aeb6-8234d241acb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:51.777814 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd0c51-d8a0-47de-aeb6-8234d241acb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:51.778307 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd0c51-d8a0-47de-aeb6-8234d241acb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:51.779741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd0c51-d8a0-47de-aeb6-8234d241acb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:51.782524 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd0c51-d8a0-47de-aeb6-8234d241acb5 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:51.803586 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1426/2882] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:55:51.808291 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0e24f-3b6d-42ab-9a79-16c5f0999cec admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:51.819575 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0e24f-3b6d-42ab-9a79-16c5f0999cec admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:51.824539 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a8382-9636-4079-b93f-55de324ef6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:51.825510 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a8382-9636-4079-b93f-55de324ef6fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:51.825800 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a8382-9636-4079-b93f-55de324ef6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:51.826082 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a8382-9636-4079-b93f-55de324ef6fa admin admin] PATH_INFO: `/v3/projects/98f21708783e43b69cff7da252a2e6f6/users/ddf8055c595b44d4aa9b96dfa59936bf/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:51.844285 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a8382-9636-4079-b93f-55de324ef6fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f21708783e43b69cff7da252a2e6f6, user_id=ddf8055c595b44d4aa9b96dfa59936bf, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:51.847784 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a8382-9636-4079-b93f-55de324ef6fa admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:51.982906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1457/2883] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:55:51 2022] PUT /identity/v3/projects/98f21708783e43b69cff7da252a2e6f6/users/ddf8055c595b44d4aa9b96dfa59936bf/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:55:51.995198 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a455d3-fdc9-4dc2-8bd0-a4414f08adeb None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:51.995774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a455d3-fdc9-4dc2-8bd0-a4414f08adeb None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:51.996111 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a455d3-fdc9-4dc2-8bd0-a4414f08adeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:52.026003 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a6a455d3-fdc9-4dc2-8bd0-a4414f08adeb None None] MFA Rules not processed for user `ddf8055c595b44d4aa9b96dfa59936bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:52.027150 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a6a455d3-fdc9-4dc2-8bd0-a4414f08adeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:52.098160 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1427/2884] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:55:52.110039 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a8382-9636-4079-b93f-55de324ef6fa admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:52.112923 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bc5a8382-9636-4079-b93f-55de324ef6fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:52.163917 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:52.177435 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a8382-9636-4079-b93f-55de324ef6fa admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:52.184255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612e677-b188-4e9f-8743-1edde1c51d1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:52.184255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612e677-b188-4e9f-8743-1edde1c51d1a service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:52.184255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612e677-b188-4e9f-8743-1edde1c51d1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:52.184255 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612e677-b188-4e9f-8743-1edde1c51d1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:52.193760 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612e677-b188-4e9f-8743-1edde1c51d1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:52.195229 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612e677-b188-4e9f-8743-1edde1c51d1a service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:52.205465 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1458/2885] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:55:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:55:52.232244 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a455d3-fdc9-4dc2-8bd0-a4414f08adeb None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:52.239314 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:52.321662 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a455d3-fdc9-4dc2-8bd0-a4414f08adeb None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:52.329612 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3f85b-733b-4891-b2ed-85d12d4482af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:52.331847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3f85b-733b-4891-b2ed-85d12d4482af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:52.332348 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3f85b-733b-4891-b2ed-85d12d4482af admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:52.332891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3f85b-733b-4891-b2ed-85d12d4482af admin admin] PATH_INFO: `/v3/users/ddf8055c595b44d4aa9b96dfa59936bf` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:52.335412 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3f85b-733b-4891-b2ed-85d12d4482af admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf8055c595b44d4aa9b96dfa59936bf)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:52.339482 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3f85b-733b-4891-b2ed-85d12d4482af admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:52.573490 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-54c3f85b-733b-4891-b2ed-85d12d4482af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf8055c595b44d4aa9b96dfa59936bf'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:52.590285 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-54c3f85b-733b-4891-b2ed-85d12d4482af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf8055c595b44d4aa9b96dfa59936bf'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:52.591140 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-54c3f85b-733b-4891-b2ed-85d12d4482af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf8055c595b44d4aa9b96dfa59936bf'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:52.591990 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-54c3f85b-733b-4891-b2ed-85d12d4482af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf8055c595b44d4aa9b96dfa59936bf'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:52.603035 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-54c3f85b-733b-4891-b2ed-85d12d4482af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf8055c595b44d4aa9b96dfa59936bf'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:52.717847 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1428/2886] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:55:52 2022] DELETE /identity/v3/users/ddf8055c595b44d4aa9b96dfa59936bf => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:52.723731 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb95598-933f-4e74-a700-f8501a665552 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:52.724126 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb95598-933f-4e74-a700-f8501a665552 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:52.724628 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb95598-933f-4e74-a700-f8501a665552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:52.746890 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ecb95598-933f-4e74-a700-f8501a665552 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:52.748292 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ecb95598-933f-4e74-a700-f8501a665552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:52.816577 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1459/2887] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:52.827860 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3f85b-733b-4891-b2ed-85d12d4482af admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:52.829560 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-54c3f85b-733b-4891-b2ed-85d12d4482af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:52.916698 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3f85b-733b-4891-b2ed-85d12d4482af admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:52.922707 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b8a23-09f5-4594-a661-13d746902475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:52.924411 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b8a23-09f5-4594-a661-13d746902475 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:52.924875 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b8a23-09f5-4594-a661-13d746902475 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:52.925350 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b8a23-09f5-4594-a661-13d746902475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:52.942624 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b8a23-09f5-4594-a661-13d746902475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:52.945374 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b8a23-09f5-4594-a661-13d746902475 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:52.964454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1429/2888] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:55:53.505906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb95598-933f-4e74-a700-f8501a665552 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:53.508198 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ecb95598-933f-4e74-a700-f8501a665552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:53.526365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb95598-933f-4e74-a700-f8501a665552 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:53.534881 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e84ea2-4e1f-4629-ba00-f7d50f430b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:53.536669 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e84ea2-4e1f-4629-ba00-f7d50f430b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:53.537287 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e84ea2-4e1f-4629-ba00-f7d50f430b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:53.538669 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e84ea2-4e1f-4629-ba00-f7d50f430b30 admin admin] PATH_INFO: `/v3/projects/98f21708783e43b69cff7da252a2e6f6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:53.540911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e84ea2-4e1f-4629-ba00-f7d50f430b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98f21708783e43b69cff7da252a2e6f6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:53.543434 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e84ea2-4e1f-4629-ba00-f7d50f430b30 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:53.688965 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-57e84ea2-4e1f-4629-ba00-f7d50f430b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98f21708783e43b69cff7da252a2e6f6', 'request_id': 'req-57e84ea2-4e1f-4629-ba00-f7d50f430b30'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:53.795811 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-57e84ea2-4e1f-4629-ba00-f7d50f430b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98f21708783e43b69cff7da252a2e6f6', 'request_id': 'req-57e84ea2-4e1f-4629-ba00-f7d50f430b30'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:53.808253 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-57e84ea2-4e1f-4629-ba00-f7d50f430b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98f21708783e43b69cff7da252a2e6f6', 'request_id': 'req-57e84ea2-4e1f-4629-ba00-f7d50f430b30'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:53.827459 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-57e84ea2-4e1f-4629-ba00-f7d50f430b30 admin admin] The token cache is being invalidate because project 98f21708783e43b69cff7da252a2e6f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:55:53.827983 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-57e84ea2-4e1f-4629-ba00-f7d50f430b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:53.829064 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-57e84ea2-4e1f-4629-ba00-f7d50f430b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:55:53.832619 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1460/2889] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:55:53 2022] DELETE /identity/v3/projects/98f21708783e43b69cff7da252a2e6f6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:53.840554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b88239-9f2c-40ab-9485-d115009a7533 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:53.841133 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b88239-9f2c-40ab-9485-d115009a7533 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:53.841597 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b88239-9f2c-40ab-9485-d115009a7533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:53.867138 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e1b88239-9f2c-40ab-9485-d115009a7533 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:53.868396 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e1b88239-9f2c-40ab-9485-d115009a7533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:53.891705 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:53.938776 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1430/2890] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:55:53.947010 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19fb96-fd85-4391-a2d6-1fdffa48c246 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:53.947388 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19fb96-fd85-4391-a2d6-1fdffa48c246 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:53.947731 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19fb96-fd85-4391-a2d6-1fdffa48c246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:53.968313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9e19fb96-fd85-4391-a2d6-1fdffa48c246 None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:53.969582 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9e19fb96-fd85-4391-a2d6-1fdffa48c246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:53.979173 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1461/2891] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:55:53.983738 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b88239-9f2c-40ab-9485-d115009a7533 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:53.995603 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b88239-9f2c-40ab-9485-d115009a7533 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:54.000668 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dacdca-cf5d-4bce-b1bb-9c1f746f436a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:54.001380 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dacdca-cf5d-4bce-b1bb-9c1f746f436a admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:54.001870 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dacdca-cf5d-4bce-b1bb-9c1f746f436a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:54.002292 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dacdca-cf5d-4bce-b1bb-9c1f746f436a admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:54.003381 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dacdca-cf5d-4bce-b1bb-9c1f746f436a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:55:54.003689 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dacdca-cf5d-4bce-b1bb-9c1f746f436a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:54.005426 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dacdca-cf5d-4bce-b1bb-9c1f746f436a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:54.019447 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1431/2892] 10.222.0.52 () {58 vars in 1152 bytes} [Fri Jun 17 07:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:55:54.026602 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19fb96-fd85-4391-a2d6-1fdffa48c246 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:54.043207 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19fb96-fd85-4391-a2d6-1fdffa48c246 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:54.049493 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56852ddb-b11a-4007-9dfb-7f5ead1c7c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:54.050570 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56852ddb-b11a-4007-9dfb-7f5ead1c7c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:54.050859 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56852ddb-b11a-4007-9dfb-7f5ead1c7c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:54.051142 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56852ddb-b11a-4007-9dfb-7f5ead1c7c58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:54.051911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56852ddb-b11a-4007-9dfb-7f5ead1c7c58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:54.053984 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56852ddb-b11a-4007-9dfb-7f5ead1c7c58 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:54.147719 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1462/2893] 10.222.0.52 () {60 vars in 1152 bytes} [Fri Jun 17 07:55:54 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:55:54.152300 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dacdca-cf5d-4bce-b1bb-9c1f746f436a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:54.163742 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dacdca-cf5d-4bce-b1bb-9c1f746f436a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:54.229594 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd574a-f927-4563-81b1-48bf8cd30fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:54.230289 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd574a-f927-4563-81b1-48bf8cd30fca admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:54.230571 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd574a-f927-4563-81b1-48bf8cd30fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:54.230852 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd574a-f927-4563-81b1-48bf8cd30fca admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:54.231570 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd574a-f927-4563-81b1-48bf8cd30fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:54.233535 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd574a-f927-4563-81b1-48bf8cd30fca admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:54.340655 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1432/2894] 10.222.0.52 () {60 vars in 1143 bytes} [Fri Jun 17 07:55:54 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:55:54.345187 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56852ddb-b11a-4007-9dfb-7f5ead1c7c58 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:54.356665 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56852ddb-b11a-4007-9dfb-7f5ead1c7c58 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:54.362459 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d18c55-4cca-4031-96e8-3245e350c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:54.363227 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d18c55-4cca-4031-96e8-3245e350c498 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:54.363592 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d18c55-4cca-4031-96e8-3245e350c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:54.363911 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d18c55-4cca-4031-96e8-3245e350c498 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:54.364728 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d18c55-4cca-4031-96e8-3245e350c498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:54.366614 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d18c55-4cca-4031-96e8-3245e350c498 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:54.380422 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1463/2895] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:55:54.384733 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd574a-f927-4563-81b1-48bf8cd30fca admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:54.396352 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd574a-f927-4563-81b1-48bf8cd30fca admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:54.402232 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314be950-8c16-408c-99f5-8d052c8503cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:54.403076 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314be950-8c16-408c-99f5-8d052c8503cb admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:54.403428 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314be950-8c16-408c-99f5-8d052c8503cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:54.403708 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314be950-8c16-408c-99f5-8d052c8503cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:54.404474 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314be950-8c16-408c-99f5-8d052c8503cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:54.406085 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314be950-8c16-408c-99f5-8d052c8503cb admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:54.418538 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1433/2896] 10.222.0.52 () {58 vars in 1121 bytes} [Fri Jun 17 07:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:55:54.423113 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d18c55-4cca-4031-96e8-3245e350c498 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:54.434237 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d18c55-4cca-4031-96e8-3245e350c498 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:54.440930 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b76de-fd46-4d51-8ae6-78b4c3e6916a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:54.441973 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b76de-fd46-4d51-8ae6-78b4c3e6916a admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:54.442355 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b76de-fd46-4d51-8ae6-78b4c3e6916a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:54.442680 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b76de-fd46-4d51-8ae6-78b4c3e6916a admin admin] PATH_INFO: `/v3/projects/19ea4843b80b4a529d904ddd98b95ba2/users/b69c8285100b41338d6a85c4bc7ffdef/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:54.461718 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b76de-fd46-4d51-8ae6-78b4c3e6916a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ea4843b80b4a529d904ddd98b95ba2, user_id=b69c8285100b41338d6a85c4bc7ffdef, role_id=cfda2bc304b84d1a8f1bb2b8b3d6f6d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:54.465030 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b76de-fd46-4d51-8ae6-78b4c3e6916a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:54.600535 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1464/2897] 10.222.0.52 () {60 vars in 1482 bytes} [Fri Jun 17 07:55:54 2022] PUT /identity/v3/projects/19ea4843b80b4a529d904ddd98b95ba2/users/b69c8285100b41338d6a85c4bc7ffdef/roles/cfda2bc304b84d1a8f1bb2b8b3d6f6d0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:55:54.609882 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0e1a5-7778-4b78-ae2c-4bcb7572e2e8 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:54.610556 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0e1a5-7778-4b78-ae2c-4bcb7572e2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:54.610904 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0e1a5-7778-4b78-ae2c-4bcb7572e2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:54.658891 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-30e0e1a5-7778-4b78-ae2c-4bcb7572e2e8 None None] MFA Rules not processed for user `b69c8285100b41338d6a85c4bc7ffdef`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:54.660965 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-30e0e1a5-7778-4b78-ae2c-4bcb7572e2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:54.779784 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1434/2898] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:55:54.791907 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b76de-fd46-4d51-8ae6-78b4c3e6916a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:55:54.794634 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fb4b76de-fd46-4d51-8ae6-78b4c3e6916a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:54.806618 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:54.900662 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b76de-fd46-4d51-8ae6-78b4c3e6916a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:55:54.906845 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d280f6f-93f6-4611-a72f-cf2176034dce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afefcf9ac054459c9585d8be3c604fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:55:54.908011 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d280f6f-93f6-4611-a72f-cf2176034dce service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:54.908486 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d280f6f-93f6-4611-a72f-cf2176034dce service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:54.908989 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d280f6f-93f6-4611-a72f-cf2176034dce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:54.925377 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d280f6f-93f6-4611-a72f-cf2176034dce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:55:54.928249 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d280f6f-93f6-4611-a72f-cf2176034dce service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:55:54.947378 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1465/2899] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:55:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:55:56.717661 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d66c01-8973-44db-8bd9-80711b264619 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:55:56.718540 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d66c01-8973-44db-8bd9-80711b264619 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:55:56.718741 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d66c01-8973-44db-8bd9-80711b264619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:55:56.739758 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-93d66c01-8973-44db-8bd9-80711b264619 None None] MFA Rules not processed for user `b69c8285100b41338d6a85c4bc7ffdef`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:55:56.741001 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-93d66c01-8973-44db-8bd9-80711b264619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:55:56.749457 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1435/2900] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:55:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:56:01.144612 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d280f6f-93f6-4611-a72f-cf2176034dce service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:56:01.146399 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5d280f6f-93f6-4611-a72f-cf2176034dce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:56:01.229860 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d280f6f-93f6-4611-a72f-cf2176034dce service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:56:01.229860 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc0b7-2bfc-4112-aeab-a38c692b1c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:56:01.229860 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc0b7-2bfc-4112-aeab-a38c692b1c3e service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:56:01.229860 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc0b7-2bfc-4112-aeab-a38c692b1c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:56:01.230482 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc0b7-2bfc-4112-aeab-a38c692b1c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:56:01.232556 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d5dcc0b7-2bfc-4112-aeab-a38c692b1c3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:56:01.245669 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc0b7-2bfc-4112-aeab-a38c692b1c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:56:01.247159 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc0b7-2bfc-4112-aeab-a38c692b1c3e service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:56:01.257192 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1466/2901] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:56:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:56:06.732731 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:56:11.252708 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=50 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:56:17.333716 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f03397-70a4-4a0d-ab58-e9bbb729e7a9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:56:17.334809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f03397-70a4-4a0d-ab58-e9bbb729e7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:56:17.334809 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f03397-70a4-4a0d-ab58-e9bbb729e7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:56:17.354019 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d8f03397-70a4-4a0d-ab58-e9bbb729e7a9 None None] MFA Rules not processed for user `9144d74a341b4e08ae353b384fe1186e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:56:17.355425 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d8f03397-70a4-4a0d-ab58-e9bbb729e7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:56:17.420231 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1436/2902] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Jun 17 07:56:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:56:17.603962 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc0b7-2bfc-4112-aeab-a38c692b1c3e service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:56:17.605561 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d5dcc0b7-2bfc-4112-aeab-a38c692b1c3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:56:17.689081 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc0b7-2bfc-4112-aeab-a38c692b1c3e service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:56:17.694389 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a451656-5797-42da-8193-5e25146d966e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a18b07c033224d2085773936dad33eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:56:17.695133 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a451656-5797-42da-8193-5e25146d966e service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:56:17.695462 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a451656-5797-42da-8193-5e25146d966e service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:56:17.695776 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a451656-5797-42da-8193-5e25146d966e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:56:17.705902 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a451656-5797-42da-8193-5e25146d966e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:56:17.707581 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a451656-5797-42da-8193-5e25146d966e service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:56:17.717145 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1467/2903] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Jun 17 07:56:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:56:18.651055 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38614157-5d60-49ac-9961-38677ee02d8d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:56:18.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38614157-5d60-49ac-9961-38677ee02d8d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:56:18.651743 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38614157-5d60-49ac-9961-38677ee02d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:56:18.673753 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-38614157-5d60-49ac-9961-38677ee02d8d None None] MFA Rules not processed for user `9144d74a341b4e08ae353b384fe1186e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:56:18.675220 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-38614157-5d60-49ac-9961-38677ee02d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:56:18.683338 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1437/2904] 10.222.0.52 () {58 vars in 967 bytes} [Fri Jun 17 07:56:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:56:18.700691 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a451656-5797-42da-8193-5e25146d966e service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:56:18.712969 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a451656-5797-42da-8193-5e25146d966e service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:56:18.718639 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4db453-8067-4177-a5f3-11fa01fca32d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a18b07c033224d2085773936dad33eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:56:18.719888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4db453-8067-4177-a5f3-11fa01fca32d service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:56:18.720346 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4db453-8067-4177-a5f3-11fa01fca32d service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:56:18.720622 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4db453-8067-4177-a5f3-11fa01fca32d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:56:18.729926 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4db453-8067-4177-a5f3-11fa01fca32d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:56:18.731528 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4db453-8067-4177-a5f3-11fa01fca32d service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:56:18.741442 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1468/2905] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Jun 17 07:56:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:56:19.366824 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7760e-bebc-4a1c-bb42-dba9e3752cd5 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:56:19.367299 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7760e-bebc-4a1c-bb42-dba9e3752cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:56:19.367585 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7760e-bebc-4a1c-bb42-dba9e3752cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:56:19.386798 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-20a7760e-bebc-4a1c-bb42-dba9e3752cd5 None None] MFA Rules not processed for user `9144d74a341b4e08ae353b384fe1186e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:56:19.388038 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-20a7760e-bebc-4a1c-bb42-dba9e3752cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:56:19.396005 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1438/2906] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Jun 17 07:56:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:56:19.409550 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4db453-8067-4177-a5f3-11fa01fca32d service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:56:19.421603 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4db453-8067-4177-a5f3-11fa01fca32d service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:56:19.427947 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf459a9a-9f37-4651-b7cb-c0b7ab44ce40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a18b07c033224d2085773936dad33eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:56:19.428621 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf459a9a-9f37-4651-b7cb-c0b7ab44ce40 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:56:19.428906 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf459a9a-9f37-4651-b7cb-c0b7ab44ce40 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:56:19.429184 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf459a9a-9f37-4651-b7cb-c0b7ab44ce40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:56:19.438888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf459a9a-9f37-4651-b7cb-c0b7ab44ce40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:56:19.440513 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf459a9a-9f37-4651-b7cb-c0b7ab44ce40 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:56:19.449863 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1469/2907] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Jun 17 07:56:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:56:20.139823 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22e247-f4c0-48c9-be22-ddc868a202be None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:56:20.140382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22e247-f4c0-48c9-be22-ddc868a202be None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:56:20.140382 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22e247-f4c0-48c9-be22-ddc868a202be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:56:20.161554 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-af22e247-f4c0-48c9-be22-ddc868a202be None None] MFA Rules not processed for user `9144d74a341b4e08ae353b384fe1186e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:56:20.163693 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-af22e247-f4c0-48c9-be22-ddc868a202be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:56:20.176552 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1439/2908] 10.222.0.52 () {58 vars in 967 bytes} [Fri Jun 17 07:56:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:56:20.190704 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf459a9a-9f37-4651-b7cb-c0b7ab44ce40 service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:56:20.202203 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf459a9a-9f37-4651-b7cb-c0b7ab44ce40 service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:56:20.208224 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e861061-3b8c-403b-b8db-bc8b702da5a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a18b07c033224d2085773936dad33eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:56:20.208888 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e861061-3b8c-403b-b8db-bc8b702da5a2 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:56:20.209174 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e861061-3b8c-403b-b8db-bc8b702da5a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:56:20.209484 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e861061-3b8c-403b-b8db-bc8b702da5a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:56:20.219080 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e861061-3b8c-403b-b8db-bc8b702da5a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:56:20.220697 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e861061-3b8c-403b-b8db-bc8b702da5a2 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:56:20.233600 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1470/2909] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Jun 17 07:56:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:56:23.085734 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22e247-f4c0-48c9-be22-ddc868a202be None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:56:23.153890 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22e247-f4c0-48c9-be22-ddc868a202be None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:56:23.158914 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae98a2-823d-4f54-b62f-25c5c464b00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:56:23.159816 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae98a2-823d-4f54-b62f-25c5c464b00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:56:23.160104 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae98a2-823d-4f54-b62f-25c5c464b00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:56:23.160386 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae98a2-823d-4f54-b62f-25c5c464b00c admin admin] PATH_INFO: `/v3/users/b69c8285100b41338d6a85c4bc7ffdef` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:56:23.161768 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae98a2-823d-4f54-b62f-25c5c464b00c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b69c8285100b41338d6a85c4bc7ffdef)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:56:23.163841 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae98a2-823d-4f54-b62f-25c5c464b00c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:56:23.391775 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-33ae98a2-823d-4f54-b62f-25c5c464b00c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b69c8285100b41338d6a85c4bc7ffdef'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:56:23.407490 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-33ae98a2-823d-4f54-b62f-25c5c464b00c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b69c8285100b41338d6a85c4bc7ffdef'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:56:23.408305 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-33ae98a2-823d-4f54-b62f-25c5c464b00c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b69c8285100b41338d6a85c4bc7ffdef'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:56:23.409067 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-33ae98a2-823d-4f54-b62f-25c5c464b00c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b69c8285100b41338d6a85c4bc7ffdef'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:56:23.419757 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-33ae98a2-823d-4f54-b62f-25c5c464b00c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b69c8285100b41338d6a85c4bc7ffdef'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:56:23.514139 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1440/2910] 10.222.0.52 () {58 vars in 1223 bytes} [Fri Jun 17 07:56:23 2022] DELETE /identity/v3/users/b69c8285100b41338d6a85c4bc7ffdef => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:56:23.520021 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449d2da-eeb0-4a01-828c-e0ccc1e7fabd None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:56:23.520842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449d2da-eeb0-4a01-828c-e0ccc1e7fabd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:56:23.520842 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449d2da-eeb0-4a01-828c-e0ccc1e7fabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:56:23.547170 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0449d2da-eeb0-4a01-828c-e0ccc1e7fabd None None] MFA Rules not processed for user `5c26ce8b01664633a37c5e3b13519935`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:56:23.549365 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0449d2da-eeb0-4a01-828c-e0ccc1e7fabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:56:23.629313 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1471/2911] 10.222.0.52 () {58 vars in 957 bytes} [Fri Jun 17 07:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:56:23.639260 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae98a2-823d-4f54-b62f-25c5c464b00c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:56:23.641387 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-33ae98a2-823d-4f54-b62f-25c5c464b00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:56:23.648730 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:56:23.712215 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae98a2-823d-4f54-b62f-25c5c464b00c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:56:23.716953 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942db01d-41c3-4723-8358-9cd82fde8001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad436c2fecba4754875b7c7cb26852a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:56:23.717701 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942db01d-41c3-4723-8358-9cd82fde8001 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:56:23.717933 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942db01d-41c3-4723-8358-9cd82fde8001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:56:23.718211 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942db01d-41c3-4723-8358-9cd82fde8001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:56:23.728613 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942db01d-41c3-4723-8358-9cd82fde8001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:56:23.730136 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942db01d-41c3-4723-8358-9cd82fde8001 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:56:23.741774 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1441/2912] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:56:24.059642 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449d2da-eeb0-4a01-828c-e0ccc1e7fabd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:56:24.061392 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0449d2da-eeb0-4a01-828c-e0ccc1e7fabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:56:24.075482 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449d2da-eeb0-4a01-828c-e0ccc1e7fabd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:56:24.081538 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b54970-6b7e-4642-830b-39f1cffd8fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26ce8b01664633a37c5e3b13519935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be5f0ec6059e4393ac953e1a8c865e6d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:56:24.082430 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b54970-6b7e-4642-830b-39f1cffd8fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:56:24.082749 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b54970-6b7e-4642-830b-39f1cffd8fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:56:24.083095 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b54970-6b7e-4642-830b-39f1cffd8fcc admin admin] PATH_INFO: `/v3/projects/19ea4843b80b4a529d904ddd98b95ba2` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:56:24.089368 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b54970-6b7e-4642-830b-39f1cffd8fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ea4843b80b4a529d904ddd98b95ba2)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:56:24.089368 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b54970-6b7e-4642-830b-39f1cffd8fcc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:56:24.219636 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:56:24.223557 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c8b54970-6b7e-4642-830b-39f1cffd8fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ea4843b80b4a529d904ddd98b95ba2', 'request_id': 'req-c8b54970-6b7e-4642-830b-39f1cffd8fcc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:56:24.300693 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c8b54970-6b7e-4642-830b-39f1cffd8fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ea4843b80b4a529d904ddd98b95ba2', 'request_id': 'req-c8b54970-6b7e-4642-830b-39f1cffd8fcc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:56:24.309848 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c8b54970-6b7e-4642-830b-39f1cffd8fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ea4843b80b4a529d904ddd98b95ba2', 'request_id': 'req-c8b54970-6b7e-4642-830b-39f1cffd8fcc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:56:24.323093 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c8b54970-6b7e-4642-830b-39f1cffd8fcc admin admin] The token cache is being invalidate because project 19ea4843b80b4a529d904ddd98b95ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 07:56:24.323470 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c8b54970-6b7e-4642-830b-39f1cffd8fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:56:24.324461 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c8b54970-6b7e-4642-830b-39f1cffd8fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 07:56:24.326316 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1472/2913] 10.222.0.52 () {58 vars in 1232 bytes} [Fri Jun 17 07:56:24 2022] DELETE /identity/v3/projects/19ea4843b80b4a529d904ddd98b95ba2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:56:33.742984 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=24 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:56:34.330067 dv-cinder-797333-4-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:58:47.350454 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942db01d-41c3-4723-8358-9cd82fde8001 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:58:47.351857 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-942db01d-41c3-4723-8358-9cd82fde8001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:58:47.493213 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942db01d-41c3-4723-8358-9cd82fde8001 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:58:47.552277 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191db71-ca7d-4965-b784-a9eeea0671fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71adc8b93e5c41929b928002e004df6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dffdba97abf4f59b12c4fbdc6245e9e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:58:47.552960 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191db71-ca7d-4965-b784-a9eeea0671fe service placement] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:58:47.553247 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191db71-ca7d-4965-b784-a9eeea0671fe service placement] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:58:47.553600 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191db71-ca7d-4965-b784-a9eeea0671fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:58:47.555502 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7191db71-ca7d-4965-b784-a9eeea0671fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:58:47.568347 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191db71-ca7d-4965-b784-a9eeea0671fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:58:47.569951 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191db71-ca7d-4965-b784-a9eeea0671fe service placement] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:58:47.580599 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1442/2914] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Jun 17 07:58:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:58:57.576252 dv-cinder-797333-4-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}